Backend Software Engineer

Our client is seeking a high-caliber Backend Engineer to own the critical inference and orchestration layer that powers every single AI interaction in the platform. You'll sit right between state-of-the-art models and millions of user interactions, where latency, correctness, and absolute reliability determine product success.

What You'll Be Doing

• Inference & Orchestration: Design, build, and scale the core orchestration layers, service boundaries, and inference pipelines that serve production AI features across mobile and desktop apps.

• Tame Non-Deterministic AI: Build high-reliability, long-running workflows that handle multi-step reasoning, external tool interaction, and persistent context despite non-deterministic model behavior.

• Performance Optimization: Drive low-latency and high-throughput across inference, caching, batching, and streaming strategies.

• Production Excellence: Own end-to-end operational quality-from monitoring, logging, and alerting to rapid incident response for high-traffic API endpoints.

What We're Looking For

• Solid Backend Fundamentals: Proven track record building and operating high-throughput, low-latency production services.

• AI/LLM Familiarity: Practical experience with AI inference patterns (LLMs, embeddings, multimodal systems) and integrating providers like OpenAI, Anthropic, or open-source models.

• Distributed Systems Mastery: Comfortable debugging distributed backend architectures under heavy load.

• Product-Minded Execution: A strong bias toward shipping fast, learning from production metrics, and taking full ownership of your systems.

Tech Stack

• Languages: Python, Node.js

• AI/ML: PyTorch, OpenAI / Anthropic APIs, Open-Source LLMs

• Data: SQL & NoSQL databases

• Infra & Ops: Kubernetes, Docker, modern cloud architecture