Manager/Senior Manager - Lead AI Platform Engineer
First seen by Alion on Sep 23, 2026.
AI Platform Engineer Innovation Lab
Sector : Leading Financial Markets Infrastructure Organisation
Location : Mumbai
Experience : 6+ years
Grade : Manager / Senior Manager
Role Overview :
This is a specialist AI platform engineering role distinct from generic Data Science or application development. The position demands deep expertise in MLOps/LLMOps, distributed inference, and GPU based AI infrastructure, within regulated financial environments.
Key Responsibilities :
- Architect and scale production AI systems for mission-critical financial applications.
- Lead MLOps/LLMOps pipelines and distributed model inference frameworks.
- Engineer GPU infrastructure across sovereign/private cloud and on-premise environments.
- Implement enterprise AI gateways, semantic routing, failover mechanisms, observability, and guardrails.
- Drive GPU performance tuning, production troubleshooting, and CI/CD automation.
- Collaborate with cross-functional teams to deliver secure, scalable AI innovation.
Non-Negotiable Requirements :
Education : BE/BTech/MCA in Computer Science, IT, Data Science, or related discipline
Experience : 6 - 8 years in software engineering or DevOps, including:
i. 3+ years of hands-on production MLOps/LLMOps and distributed inference.
ii. 3+ years architecting and scaling production AI systems.
iii. Proven expertise in AI platform engineering, distributed systems, GPU infrastructure.
Hands-on proficiency with :
- Languages/Frameworks : Python, FastAPI, AsyncIO, gRPC
- Inference Platforms : vLLM, NVIDIA Triton, TensorRTLLM, Ray Serve, Hugging Face TGI, llama.cpp
- Containers/Orchestration : Kubernetes, Docker, Helm, NVIDIA GPU Operator, KEDA
- Strong background in enterprise AI gateways, semantic routing, failover, observability, and guardrails.
- Expertise in GPU performance tuning, production troubleshooting, GitOps/CICD.
Skills
MLOps, Python, Performance Tuning, Docker, Kubernetes, DevOps, AIOps