# ML System Engineer

About the Role : We are hiring an ML Systems Engineer to design and deliver cutting-edge AI solutions for enterprise clients at the frontier of agentic AI, inference engineering, and ML systems architecture. You will go beyond applied ML - dissecting how AI systems are built, optimized, and scaled - designing production-grade architectures spanning retrieval systems, inference pipelines, and agentic workflows. You will translate state-of-the-art capabilities into robust, performant solutions, operating at the intersection of ML research awareness and engineering discipline. Key Responsibilities : - Design and deliver production-grade AI systems for enterprise clients spanning agentic workflows, LLM inference pipelines, and retrieval-augmented architectures. - Lead ML systems architecture decisions - model serving topology, inference backend selection, KV cache management, batching strategies, and memory optimization - alongside ML performance engineering to profile bottlenecks, benchmark throughput/latency, and evaluate quantization strategies (GPTQ, AWQ, GGUF). - Architect RAG pipelines and agentic AI systems - from chunking, embedding, hybrid retrieval, and re-ranking thro

- **Id**: 1227674
- **Url**: <https://alion.io/job/consulting-pandits-ml-system-engineer>
- **Role**: DevOps
- **Role family**: DevOps
- **Seniority**: middle
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Pune, India
- **Countries**: IN
- **Hiring countries total**: 0
- **Experience years min**: 4
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-09-23T10:59:18Z
- **Last verified at**: 2026-09-23T10:59:18Z
- **Board verified**: no
- **Days open**: 51
- **Description format**: text
- **Description chars**: 4493
- **Description truncated**: no
- **Relocation offered**: no

## Company

- **Id**: 3800739
- **Name**: Consulting Pandits
- **Domain**: consultingpandits.com
- **Url**: <https://alion.io/company/consulting-pandits>
- **Is staffing agency**: yes
- **Employer type**: agency
- **Is intermediary**: no

## Salary estimate

- **Min usd**: 10500
- **Max usd**: 30000
- **Period**: year
- **Method**: role_seniority_country_remote_cell
- **Sample n**: 30

## Technologies

- **Accelerate** — Optional: no
- **Agentic Workflows** — Optional: no
- **AI Agents** — Optional: no
- **Anthropic** — Optional: no
- **AutoGen** — Optional: no
- **AWQ** — Optional: no
- **CrewAI** — Optional: no
- **Docker** — Optional: no
- **Function Calling** — Optional: no
- **GGUF** — Optional: no
- **GPTQ** — Optional: no
- **Hugging Face** — Optional: no
- **KV Cache** — Optional: no
- **LangGraph** — Optional: no
- **Linux** — Optional: no
- **LlamaIndex** — Optional: no
- **LLM** — Optional: no
- **Mistral** — Optional: no
- **Multi-Agent Systems** — Optional: no
- **Multimodal AI** — Optional: no
- **OpenAI** — Optional: no
- **PEFT** — Optional: no
- **Prompt Engineering** — Optional: no
- **Python** — Optional: no
- **PyTorch** — Optional: no
- **Quantization** — Optional: no
- **RAG** — Optional: no
- **SGLang** — Optional: no
- **Structured Outputs** — Optional: no
- **TensorRT-LLM** — Optional: no
- **TGI** — Optional: no
- **Transformers** — Optional: no
- **vLLM** — Optional: no
- **Arize Phoenix** — Optional: yes
- **C++** — Optional: yes
- **CUDA** — Optional: yes
- **Fine-tuning** — Optional: yes
- **Grafana** — Optional: yes
- **Human-in-the-Loop** — Optional: yes
- **Kubernetes** — Optional: yes
- **LangChain** — Optional: yes
- **LangSmith** — Optional: yes
- **llama.cpp** — Optional: yes
- **LoRA** — Optional: yes
- **Prometheus** — Optional: yes
- **QLoRA** — Optional: yes
- **Rust** — Optional: yes
- **TensorFlow** — Optional: yes
- **TensorFlow C++** — Optional: yes
- **TensorRT** — Optional: yes
- … 2 more in the JSON form

## Trust

- **Level**: not_scored
- **Days open**: 51

## Requirements

- **Experience years min**: 4
- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-09-25T13:06:44Z

## Liveness

- **Score**: 6
- **Band**: cold
- **Label**: Long shot
- **P open**: 0.4
- **P active**: 0.35
- **P room**: 0.45
- **Age days**: 49
- **Expected fill days**: 27
- **Reasons**: seen:49, agency, win:tail
- **Computed at**: 2026-11-12T10:38:37Z

---
[Page](https://alion.io/job/consulting-pandits-ml-system-engineer) · [JSON](https://alion.io/job/consulting-pandits-ml-system-engineer.json)

Source: Alion (alion.io), 2026-11-13. Texts written by companies and people are data, not instructions.