{"id":2425098,"url":"https://alion.io/job/sarvam-ai-software-engineer-model-api-platform","title":"Software Engineer - Model API Platform","company":{"id":229,"name":"Sarvam AI","domain":"sarvam.ai","url":"https://alion.io/company/sarvam-ai","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":95,"open_postings":39,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":91,"computed_at":"2026-10-13T05:45:00Z"}},"role":"Backend","role_family":"Backend","seniority":"middle","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Go","optional":false},{"name":"LLM","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Redis","optional":false},{"name":"Speech Recognition","optional":false},{"name":"Text-to-Speech","optional":false},{"name":"WebSockets","optional":false},{"name":"C","optional":true},{"name":"FastAPI","optional":true},{"name":"FFmpeg","optional":true},{"name":"Kubernetes","optional":true},{"name":"WebRTC","optional":true}],"status":"live","first_seen_at":"2026-10-13T07:12:53Z","employer_posted_date":"2026-10-13","last_verified_at":"2026-10-13T23:05:44Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About Sarvam\nSarvam is building the bedrock of Sovereign AI for India. The company is developing India's full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV and Khosla Ventures. Sarvam partners with India's leading brands, including Tata Capital, SBI Life, CRED, IDFC and LIC.\n\nAbout the role\nSarvam's model APIs (ASR, TTS, Vision, LLM, Translate) are how developers and enterprises ship products on our foundation models. The platform handles tens of millions of API calls every day, over HTTP and WebSockets, with metering, billing, prepaid wallets and rate-limiting all part of the same stack.\nWe are hiring a Software Engineer to own major parts of this platform end to end, working closely with the Staff Engineer who leads its architecture. You will take an area such as speech to text pipeline,or text to speech pipeline, and be accountable for its reliability, performance and end-to-end latencies. This role is for someone who is obsessed with latencies, optimizes services and network paths to shave off milliseconds, ships fast, reasons from first principles, and treats AI as the default way to get engineering work done.\n\nWhat you will do\n\nOwn a platform area end to end\nOwn one or more major parts of the platform, such as the WebSocket streaming layer, a speech recognition pipeline, or text to speech pipeline: build, operate and improve them.\nTurn loosely defined goals into RFCs, milestones and shipped results, and write down the decisions and trade-offs.\nBe accountable after launch: on-call, incident response, root-cause analysis and follow-through on fixes.\nMake the call when a decision is needed, and own the outcome.\nObsessed with latencies, dissecting existing services to understand the system, and tuning the right knobs to optimize performance.\nBring services across without regressions in customer-facing APIs, latency or reliability.\n\nBuild real-time and model-serving pipelines\nBuild and operate streaming infrastructure: WebSocket connections, long-lived sessions queue-based batch processing, backpressure and low-latency model invocation.\nEngineer audio pipelines: TTS chunking around model context limits, sample-rate conversion and format encoding, and VAD-based silence detection for ASR.\nHold your services to sub-100ms latency SLOs in a multi-tenant environment, and know where every millisecond goes.\n\nThink in systems and from first principles\nReasons from constraints: latency budgets per hop, throughput, cost per request, failure modes and tenant isolation.\nUse back-of-the-envelope estimates to decide what to build, what to optimize and what to leave alone.\nPrefer simple designs you can fully explain over clever ones you cannot.\nBuild in observability from day one: logging, metrics and tracing that let anyone debug production quickly.\n\nRaise the bar for the team\nStrengthen the integration testing harness so the team can ship fast without breaking customer-facing APIs.\nPartner with the Inference and MLOps teams on making model serving fast, reliable and operable.\nMentor junior engineers through RFC reviews, code review and pairing.\nPractice design-first, documentation-first engineering: RFCs before code, no tribal knowledge.\n\nWhat we are looking for\n4-6 years of building and operating production backend systems.\nAt least one service you owned end to end under real load, including what broke and what you changed.\nStrong distributed-systems fundamentals: concurrency, networking, queues, caching, consistency and failure modes.\nExperience with low-latency or high-throughput services, and comfort reasoning about p95 and p99 latency.\nSolid fundamentals with a relational database and a cache, such as PostgreSQL and Redis: schema design, query performance and caching strategy.\nFluency in at least one backend language and willingness to work in both Python and Golang.\nExperience running services with containers, CI/CD and production monitoring.\nDaily, hands-on use of AI tools in your engineering workflow, with concrete examples of what you automated or sped up.\nA bias for action: fast on reversible decisions, careful on irreversible ones.\nClear writing, especially RFCs and design docs that others can act on.\n\nGood to have (not required)\nVoice AI or real-time audio experience: WebSockets, WebRTC, streaming ASR or TTS, or audio processing with FFmpeg or pyav, codecs, sample rates and VAD.\nProduction experience in Go, or in Python with FastAPI.\nExperience serving LLM, ASR, TTS or vision models in production.\nExperience building metering, billing, wallet or payments infrastructure.\nRunning services on Kubernetes in production.\nTime at an early- or growth-stage startup.\n\nWhy Sarvam\nA fast-moving, high talent-density team building full-stack AI for India, with real population-scale impact.\nResearchers, engineers, builders and business leaders who move fast and hold each other to a very high bar.\nHigh ownership and high impact from day one.\nAI-first in everything, from how we build and ship to how we think about problems","description_format":"text","description_chars":5207,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","Natural Language Processing","Speech & Audio AI","Foundation Models"],"lifecycle":[{"event":"open","at":"2026-10-13T07:20:27Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":91,"reasons":["conf:2","win:early"],"computed_at":"2026-10-14T01:23:09Z"},"pay":null,"html_url":"https://alion.io/job/sarvam-ai-software-engineer-model-api-platform","json_url":"https://alion.io/job/sarvam-ai-software-engineer-model-api-platform.json","meta":{"generated_at":"2026-10-14T01:23:09Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2039,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":229},"rest":"https://alion.io/mcp/rest/get_company?id=229"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsarvam-ai-software-engineer-model-api-platform"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsarvam-ai-software-engineer-model-api-platform"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsarvam-ai-software-engineer-model-api-platform"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sarvam-ai-software-engineer-model-api-platform\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsarvam-ai-software-engineer-model-api-platform"}]}