{"id":40221,"url":"https://alion.io/job/sarvam-ai-infrastructure-sre-hpc","title":"Infrastructure SRE - HPC","company":{"id":229,"name":"Sarvam AI","domain":"sarvam.ai","url":"https://alion.io/company/sarvam-ai","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":95,"open_postings":39,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":91,"computed_at":"2026-10-23T05:54:15Z"}},"role":"DevOps","role_family":"DevOps","seniority":"junior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India","Chennai, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"InfiniBand","optional":false},{"name":"Kubernetes","optional":false},{"name":"NCCL","optional":false},{"name":"NVLink","optional":false},{"name":"Python","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"SLURM","optional":false},{"name":"SRE","optional":false},{"name":"CoreWeave","optional":true}],"status":"live","first_seen_at":"2026-06-26T09:18:02Z","employer_posted_date":"2026-06-26","last_verified_at":"2026-10-23T13:32:13Z","board_verified":true,"closed_at":null,"days_open":119,"trust":{"level":"ok","repost_count":0,"flags":[],"days_open":118},"description":"About Sarvam\nSarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.\nAbout the Role\nSarvam runs a large, multi-vendor GPU fleet that serves two demanding workloads on the same physical infrastructure: training jobs that span hundreds of GPUs and must run uninterrupted for weeks, and inference services that must hold a flat p99 under production load. Keeping both healthy at once is a hard, specialized reliability problem, and it is the problem this team exists to solve.\nThis is not a Kubernetes administration role. We assume Kubernetes fluency as a baseline. The difficulty lies above and below it - in parallel filesystems under heavy checkpoint load, in RDMA fabrics that degrade quietly, in NCCL hangs whose root cause may be the network or the kernel, in driver and firmware drift across heterogeneous hardware, and in distributed training failures that masquerade as infrastructure faults.\nWe are hiring a team of specialists rather than a set of identical generalists. This posting covers five areas of focus. We expect candidates to bring genuine depth in one and working fluency across the others, because on a shared fleet a storage problem often first appears as a training hang, and the engineer on call must route an incident correctly before anyone can resolve it.\nWhen you apply, please indicate the area of focus that best matches your experience. Strong generalists are welcome; we will place you where your depth is most useful.\nWhat You’ll Do\nOperate the GPU fleet end to end across training and serving - provisioning, observability, capacity, and fleet health.\n\nHold a meaningful on-call rotation, write runbooks that hold up under pressure, and drive postmortems that produce durable fixes.\n\nBuild the internal tooling the team relies on, rather than operating off-the-shelf systems alone.\n\nPartner with ML and platform teams to keep large runs alive and serving latency predictable.\n\nWhat We're Looking For\n5+ years in infrastructure or site reliability engineering, including 2+ years operating GPU clusters at scale.*\n\nDemonstrated on-call ownership of infrastructure that mattered, with a track record of postmortems that led to real change.\n\nProficiency in Python or Go, used to build and maintain internal tooling.\n\nWorking fluency across all five areas of focus below - enough to recognize, triage, and route a problem outside your specialty, even if the fix belongs to a teammate.\n\n* For the Storage and Fabric areas of focus, we will weigh deep domain expertise against the GPU-cluster requirement; exceptional specialists with less direct GPU-fleet time are encouraged to apply.\nBring depth in one of the five areas below; expect to be conversational across the rest.\nDistributed high-performance storage - operate a parallel filesystem (Lustre, GPFS, WEKA, or BeeGFS) at scale and keep it from stalling under checkpoint-write storms.\n\nFabric & RDMA networking - InfiniBand or RoCE health, NVLink/NVSwitch topology, and RDMA debugging that catches degradation before the workload feels it.\n\nGPU systems reliability - NCCL debugging, driver and firmware lifecycle across a mixed fleet, and DCGM-based node health at scale.\n\nKubernetes platform reliability - the GPU operator stack, scheduling (Slurm-on-k8s or pure k8s), multi-tenant isolation, and cost/SLO primitives.\n\nTraining & inference workload reliability - hang and straggler detection, checkpoint/restart, and protecting serving p99 with HA and DR.\n\nBonus Points\nSlurm and Kubernetes hybrid environments.\n\nOn-premise GPU deployment, including coordination with datacenter operations on power, cooling, and InfiniBand cabling.\n\nExperience with Indian NCPs, DGX SuperPOD, Lambda, CoreWeave, NeevCloud etc.\n\nMulti-tenant GPU isolation (MIG, MPS, time-slicing) in production.\n\nWhy Sarvam?\nSarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.\nWork alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar\nHigh ownership and high impact, from day one\nEverything we do is AI-first, from the way we build and ship to the way we think about problems\nYou can work on problems that could change how an entire country learns, works, and communicates\nIf you want to work on problems at the frontier of AI in India, Sarvam is the place to be.","description_format":"text","description_chars":4817,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","Natural Language Processing","Speech & Audio AI","Foundation Models"],"lifecycle":[{"event":"open","at":"2026-06-26T09:18:02Z"}],"visa":[],"liveness":{"score":28,"band":"fade","label":"Fading","p_open":1,"p_active":0.64,"p_room":0.44,"age_days":118,"expected_fill_days":91,"reasons":["conf:1","velocity","win:tail","crowd:junior"],"computed_at":"2026-10-23T05:54:15Z"},"pay":null,"html_url":"https://alion.io/job/sarvam-ai-infrastructure-sre-hpc","json_url":"https://alion.io/job/sarvam-ai-infrastructure-sre-hpc.json","meta":{"generated_at":"2026-10-23T14:42:31Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":22090,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-24T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":229},"rest":"https://alion.io/mcp/rest/get_company?id=229"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsarvam-ai-infrastructure-sre-hpc"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsarvam-ai-infrastructure-sre-hpc"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsarvam-ai-infrastructure-sre-hpc"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sarvam-ai-infrastructure-sre-hpc\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsarvam-ai-infrastructure-sre-hpc"}]}