On-device AI Frameworks Engineer (Staff)
Confirmed on the employer's own hiring board on Oct 17, 2026. First seen by Alion on Oct 29, 2025. Argmax scores B on the Alion truth index.
We are looking for a Staff Engineer to join our growing On-device AI Frameworks team at Argmax! In this role, you will design, implement and optimize software frameworks that expose developer-friendly APIs to run state-of-the-art inference workloads natively on Apple and Android devices. You will collaborate closely with industry-leader engineer and researcher colleagues, advancing the frontiers of on-device inference technology and accelerating its market adoption.
AI Frameworks are at the core of Argmax SDK, our flagship developer toolkit trusted by Enterprises and developers in high-stakes industries such as healthcare. Argmax is a customer-obsessed team and we work very closely with them, sometimes in forward-deployed capacity.
Responsibilities
- Productionize research prototypes: The Applied Research team will come to you with a Python prototype that provides the blueprints for a new feature (example) for one of our AI Frameworks. You will collaborate with them in turning this standalone prototype into a production-ready implementation in a test-driven development fashion. This collaboration may include experimentation and benchmarking that leads to top-tier AI research conference submissions (example).
- Contribute to SDK and Frameworks design: As the number of supported models and workloads grow, you will see around corners and recommend scalable design patterns to absorb the code growth while minimizing technical debt.
- Support Enterprise customers: You will directly work with the engineering teams of Enterprise customers during their onboarding journey. This could range from a Q&A session to customizing an Argmax feature to fit a particular customer requirement.
Qualifications
- 3+ years of hands-on experience in SDK or Frameworks development for iOS or macOS
- Fluency in Swift
- Fluency in profiling and optimizing native applications
- Familiarity with at least one of Core ML, MLX Swift, LiteRT, ONNX, WebGPU or ExecuTorch
Preferred Qualifications
- 5+ years of hands-on experience in SDK or Frameworks development for iOS or Android
- Track record of significant open-source contributions
- Fluency in Swift, Kotlin and Python
- Direct experience with Core ML, MLX Swift and LiteRT
Perks
- Top-of-market equity at a fast-growing early-stage startup with a unique mission
- Performance-based equity refreshers twice a year
- 3 days a week in the office from Palo Alto, CA or Manhattan, NY
- Palo Alto office offers comprehensive on-site amenities, including chef-catered meals
- Remote possible by exception for industry leader exceptional candidates
- Platinum-tier healthcare with 90% employer contribution, including dependents
- 401(k) match
- Quarterly in-person team-building weeks in Palo Alto, CA
About Argmax
AI applications are scaling in user adoption at unprecedented rates. The infrastructure is crumbling:
- Spinner wheels are back in fashion
- The most sensitive types of user data are uploaded to the cloud and occasionally leaked
- Spiky demand leads to infrastructure capacity crunch and underutilization at the same time
Argmax is building the critical infrastructure required to bring real-time AI workloads to the edge:
- Autoscaling instantly and infinitely
- Private and compliant by design
- Reliable beyond even the multi-cloud platforms
The hardest part: We are directly migrating cloud workloads to the edge, without compromising accuracy that our customers work so hard to achieve. This is a hard core technology problem and we built the mission-driven team with a long-term vision to make on-device the default way to build AI applications. Join us if this sounds like you and you have 3+ years to stake!