{"id":1265775,"url":"https://alion.io/job/gnani-staff-ai-engineer-agentic-ai","title":"Staff AI Engineer - Agentic AI","company":{"id":27998,"name":"Gnani","domain":"gnani.ai","url":"https://alion.io/company/gnani","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"staff","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":35000,"max_usd":84000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":11},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Function Calling","optional":false},{"name":"Hallucination","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Multi-Agent Systems","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Speech Recognition","optional":false},{"name":"Structured Outputs","optional":false},{"name":"Text-to-Speech","optional":false},{"name":"Fine-tuning","optional":true},{"name":"Kubernetes","optional":true},{"name":"LiveKit","optional":true},{"name":"Prompt Engineering","optional":true},{"name":"Redis","optional":true},{"name":"TensorRT","optional":true},{"name":"TensorRT-LLM","optional":true},{"name":"vLLM","optional":true}],"status":"live","first_seen_at":"2026-09-09T07:59:19Z","employer_posted_date":null,"last_verified_at":"2026-09-09T07:59:19Z","board_verified":false,"closed_at":null,"days_open":42,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":42},"description":"About Gnani.ai :\n\nGnani.ai builds voice-first AI for enterprises. Our products include an agentic AI platform, a voice API platform (speech APIs), and a conversation analytics platform. We build our own ASR, TTS, and small language models for 22+ Indian languages, serving BFSI, insurance, healthcare, and telecom customers at scale.\n\nAbout the Role :\n\nOur agentic AI platform lets enterprises build and run autonomous voice and chat agents. As Staff AI Engineer - Agentic AI, you will own the intelligence layer of this platform: how agents think, plan, retrieve knowledge, use tools, and work together. You will set the technical direction for LLM orchestration, RAG, and multi-agent systems, and lead a team of agentic AI engineers to ship it.\n\nThis is a hands-on leadership role. You will write code, review designs, and mentor engineers - not just manage.\n\nWhat You Will Do :\n\nLLM Orchestration :\n\n- Design and own the orchestration layer that routes requests across LLMs (hosted and self-hosted SLMs), with fallbacks, caching, and cost/latency controls.\n\n- Build prompt management, structured output handling, and tool-calling pipelines that hold up in real-time voice conversations (strict latency budgets).\n\nRAG Pipelines :\n\n- Own the end-to-end RAG stack: ingestion, chunking, embedding, retrieval, re-ranking, and grounding for enterprise knowledge bases.\n\n- Improve answer accuracy and reduce hallucination for domain-heavy verticals (BFSI, insurance, healthcare), including code-mixed and multilingual content.\n\n- Build freshness, versioning, and access control into retrieval so each tenant only sees its own data.\n\nMulti-Agent Orchestration :\n\n- Design the multi-agent architecture: planner/worker patterns, agent hand-offs, shared memory, and inter-agent communication.\n\n- Own agent memory design (contact, campaign, and agent-level memory) and how agents learn from production feedback.\n\nTool Use & Enterprise Integrations :\n\n- Build the tool-calling and integration framework that lets agents take real actions: CRM updates, ticket creation, payment flows, and API calls into customer systems.\n\n- Make tool execution safe and auditable: schemas, validation, retries, and human-in-the-loop approval where needed.\n\nEvaluation & Observability :\n\n- Define evaluation gates: offline evals, golden test sets, persona simulators, and LLM-as-judge pipelines before changes ship.\n\n- Build observability for every agent decision: traces, decision logs, and quality dashboards so failures can be found and fixed fast.\n\nGuardrails, Safety & Compliance :\n\n- Design guardrails against prompt injection, hallucinated actions, and off-policy behavior, with deterministic fallbacks and state recovery.\n\n- Ensure agent behavior meets enterprise compliance needs (data privacy, consent, and disclosure rules) in partnership with product and legal teams.\n\nCost & Performance Engineering :\n\n- Own inference cost and latency: model selection and routing, caching, batching, and KV-cache reuse, so agents stay fast and affordable at scale.\n\nTeam Leadership :\n\n- Lead and mentor a team of agentic AI engineers (roughly 4-8). Set direction, review designs and code, and raise the quality bar.\n\n- Plan the agentic AI roadmap with product and platform teams. Break big goals into sprint-sized work.\n\n- Hire and grow the team as the platform scales.\n\nWhat You Bring :\n\n- 8+ years in software or ML engineering, with 2+ years building LLM-based or agentic systems in production.\n\n- Deep, hands-on experience with LLM orchestration frameworks and patterns (function calling, tool use, structured outputs, streaming) - and knowing when to skip the framework and build it yourself.\n\n- Production RAG experience: vector databases, retrieval quality tuning, re-ranking, and eval-driven iteration.\n\n- Experience designing multi-agent systems: task decomposition, agent coordination, memory, and failure handling.\n\n- Strong Python; comfort with Go is a plus. Solid grasp of distributed systems (queues/messaging, Redis, Kubernetes).\n\n- Track record of leading engineers as a tech lead or staff engineer: design reviews, mentorship, delivery ownership.\n\nNice to have :\n\n- Real-time or voice AI experience (latency-sensitive pipelines, streaming ASR/TTS integration).\n\n- Fine-tuning or serving SLMs (vLLM, TensorRT-LLM, or similar).\n\n- Experience with Indic languages or code-mixed text.\n\n- Familiarity with enterprise compliance needs (data residency, DPDP, RBI guidelines).\n\n- Hands-on experience with Livekit and Pipecat frameworks.\n\nWhy This Role :\n\n- Own a core layer of a fast-growing agentic platform used by large enterprises, end to end.\n\n- Work on hard, real problems: agents that talk on live phone calls with sub-second latency budgets.\n\n- Build on proprietary models (ASR, TTS, SLM) - not just API wrappers.\n\n- Small, senior team. High trust, high ownership, direct access to leadership.\n\nHow We Work :\n\nBengaluru-based, in-office collaboration. Sprint-based delivery with a clear roadmap. Design docs and evals before big changes. We value engineers who ship, measure, and improve.\n\nSkills\nMachine Learning, Artificial Intelligence, Python, RAG, LLM, Prompt Engineering, Data Science, Data Scientist","description_format":"text","description_chars":5192,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Natural Language Processing","Conversational AI","Speech & Audio AI"],"lifecycle":[{"event":"open","at":"2026-09-25T22:00:00Z"}],"visa":[],"liveness":{"score":22,"band":"cold","label":"Long shot","p_open":0.6,"p_active":0.659,"p_room":0.55,"age_days":41,"expected_fill_days":31,"reasons":["seen:41","win:tail"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/gnani-staff-ai-engineer-agentic-ai","json_url":"https://alion.io/job/gnani-staff-ai-engineer-agentic-ai.json","meta":{"generated_at":"2026-10-21T22:28:44Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":32055,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":27998},"rest":"https://alion.io/mcp/rest/get_company?id=27998"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fgnani-staff-ai-engineer-agentic-ai"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fgnani-staff-ai-engineer-agentic-ai"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fgnani-staff-ai-engineer-agentic-ai"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/gnani-staff-ai-engineer-agentic-ai\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fgnani-staff-ai-engineer-agentic-ai"}]}