Backend Engineer (Multi-cloud Inference Platform)
Confirmed on the employer's own hiring board on Oct 19, 2026. First seen by Alion on Oct 18, 2026.
Join our Cloud Inference team as a Backend Engineer, where you'll be responsible for building a multi-cloud, multi-tenant platform for managing distributed LLM inference deployments. You'll work on optimizing performance, scalability, and observability while creating simple and effective deployment solutions. Enjoy a range of benefits, including health insurance, a 401k plan, a generous work-from-home stipend, and unlimited paid time off.
Missions
- Concevoir et construire une plateforme multi-cloud et multi-locataire pour les services d'inférence.
- Développer des services tolérants aux pannes et à faible effort, capables d'utiliser des ressources sur diverses plateformes matérielles.
- Améliorer l'excellence opérationnelle avec une observabilité de la demande au noyau, des déploiements multi-cloud, et des optimisations de démarrage à froid.
Profil recherché
- We're seeking engineers who are passionate about pushing the boundaries of distributed inference systems and enjoy working at the intersection of large-scale systems and machine learning- We are looking for candidates based on their breadth and depth of experience in backend engineering, AI inference, and distributed systems development. If this sounds exciting, we invite you to join our world-leading AI infrastructure team and help drive our industry forward
- Experience with kubernetes and operating your own services
- 5+ years of experience working in backend engineering
- A passion for building and operating high performance, low toil, observable systems
- Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture
- Strongly identifies with our core company cultural values
- Experience with Cloud Providers (AWS, GCP, Azure, neoclouds)
- Experience in machine learning technologies and use cases
- Practical experience implementing & maintaining security in multi-tenancy environments
- Experience working on high scale ML inference infrastructure (traditional AI or genAI)
- Familiarity with golang