Full-Time Engineer: AI Software Engineer

Position Overview

We are looking for a Rust Software Developer to join our team and work on cutting-edge local AI inference. This role is ideal for someone eager to grow their Rust development skills while contributing to our API front-end and core systems. You will be contributing to the customer-facing codebase that is the vehicle for us delivering our improvements to LLM inference. If you’re excited about Rust and AI, we’d love to hear from you!

Key Responsibilities

• Develop and maintain LLM inference engine written in Rust
• Deploy Rust to all major client platforms (Windows, Linux, MacOS, Android, iOS)
• Maintain GitHub actions to build & release software
• Maintain end-to-end integrations with Rust across major customer development platforms (React.Native, Java/Kotlin, Swift, C/C++, Python)
• Debug and troubleshoot issues in our API and related infrastructure
• Collaborate with product and AI teams to integrate new features

Required Qualifications

• Ideally at least 1-3 years of experience with Rust (personal projects, coursework, or previous work).
• Proficiency in async Rust and concurrent programming
• Strong generalist comfortable with learning and growth attained by tackling out-of-expertise problems.
• Strong problem-solving skills and attention to detail
• Nice to have Qualifications
• Familiarity with Axum, Actix, or other Rust web frameworks
• Understanding of containerization (Docker) and cloud services
• Familiarity with GitHub Actions and CI/CD
• 3 years experience in C++
• Experience with Android NDK and integrating Rust into mobile applications
• Working with LLMs and local inference engines like llama.cpp or Ollama
• Familiarity with REST design and FFI integration into C, Python, etc

What You’ll Gain

• Opportunity to work alongside industry experts in AI optimization, high-performance computing, and hardware acceleration.
• Hands-on experience with cutting-edge technologies at the intersection of AI and hardware acceleration.
• Exposure to open-source development and collaboration with a vibrant community.
• Extensive experience building and maintaining a Rust codebase

Benefits We Offer

• At OpenInfer we offer comprehensive benefits, some include:
• Medical, Dental, and Vision benefits
• Flexible Paid Time Off, 10 days
• Parental Leave
• 401(k) Plan with company matching
• Snacks and coffee to keep you energized

These benefits are further detailed in OpenInfer policies and are subject to change at any time, consistent with the terms of any applicable compensation or benefits plans.