{"id":4068547,"url":"https://alion.io/job/sarvam-ai-senior-software-engineer-data-infrastructure","title":"Senior Software Engineer - Data Infrastructure","company":{"id":229,"name":"Sarvam AI","domain":"sarvam.ai","url":"https://alion.io/company/sarvam-ai","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":95,"open_postings":47,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":85,"computed_at":"2026-11-14T05:58:10Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Redshift","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"ClickHouse","optional":false},{"name":"dbt","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Helm","optional":false},{"name":"Kubernetes","optional":false},{"name":"Python","optional":false},{"name":"RabbitMQ","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Langfuse","optional":true},{"name":"LLM","optional":true},{"name":"OpenTelemetry","optional":true}],"status":"live","first_seen_at":"2026-11-11T11:31:01Z","employer_posted_date":"2026-11-11","last_verified_at":"2026-11-14T12:44:15Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":2},"description":"The Role\nSarvam's products produce events, model traces, evals and billing data, and need to read that data back. The Data Platform team builds and runs the central data infrastructure every product uses: ingestion, streaming, the analytical warehouse, transformations, access control and audit.\nWe are hiring a Software Engineer / Senior Software Engineer (2-5 years of experience) to own this platform end to end. You will design, build and run systems that other teams depend on in production, and make real decisions on database internals, streaming and platform design. Stack: Go/Python, ClickHouse Cloud, Kafka, Avro, Airflow, dbt, Kubernetes, Terraform, AWS.\nWhat You'll Own & Do\nBuild and run the ingestion path: the service every product sends events to, Kafka behind it, and the pipes that land data in ClickHouse within seconds. Own schema validation, rate limits, dead-letter handling and the client SDKs.\n\nOwn the warehouse: ClickHouse Cloud. Design tables for the read path (sorting keys, partitions, materialized views, TTL), separate compute per workload, set per-user limits and per-tenant isolation, and attribute cost to the team that spent it.\n\nBuild reliable data pipelines and solve data problems: dbt models and Airflow DAGs with the BI engineers, CDC from product databases, sync and backfill jobs that are safe to re-run, and the data problems product teams bring you, such as a late source, a number that doesn't match or a query that has slowed down.\n\nMake the platform self-serve: a registry of every dataset with its owner, schema, freshness and access; provisioning and permissions as code.\n\nRun it in production: everything as Terraform and Helm with metrics, traces and alerts; be on call; handle incidents end to end, write the RCA and fix the root cause.\n\nGrow the platform: new products keep arriving. You will help decide what the platform should do next and build it, whether that is a new source or sink, or a new way for teams to use the data.\n\nWhat We're Looking For\n2-5 years of experience building, shipping and running large-scale, data-intensive systems in production, ideally at a startup where you owned things and were on call for them.\n\nDeep expertise in at least one of: an OLAP database (ClickHouse preferred; Druid, BigQuery or Redshift also fine) or Kafka / event streaming. You understand how a columnar store writes, merges and scans data, or how a partitioned log gives ordering and delivery guarantees.\n\nExperience with large-scale messaging systems like Kafka or RabbitMQ: partitions, consumer groups, delivery guarantees, backpressure.\n\nGood at Go, or good at Python.\n\nYou know the usual data-system problems: schema evolution, idempotency, backpressure, partitioning, retention and TTL, CDC.\n\nYou have built or run at least one of: an event pipeline, a transformation layer (dbt, Spark or SQL on Airflow), a provisioning or control-plane service, or a multi-tenant data service with access control.\n\nComfortable with AWS, Kubernetes and Terraform in production.\n\nYou test before shipping, debug with metrics and traces, write RCAs, and document what you build.\n\nPassion for data infrastructure and for enabling others by making their data easier to access.\n\nNice to Have\nClickHouse in production: MergeTree, materialized views, projections, quotas, settings profiles, row policies, ClickHouse Cloud.\n\nKafka in depth: MSK, Kafka Connect, schema registry (Glue or Confluent), Avro.\n\ndbt and Airflow at scale.\n\nAudit or security data systems: append-only logs, integrity checks, tenant isolation.\n\nOpenTelemetry, LLM observability (Langfuse or similar), eval pipelines.\n\nBuilt an internal platform that other teams adopted.","description_format":"text","description_chars":3679,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","Natural Language Processing","Speech & Audio AI","Foundation Models"],"lifecycle":[{"event":"open","at":"2026-11-11T12:33:38Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":2,"expected_fill_days":85,"reasons":["conf:1","velocity","win:early"],"computed_at":"2026-11-14T05:58:10Z"},"pay":null,"html_url":"https://alion.io/job/sarvam-ai-senior-software-engineer-data-infrastructure","json_url":"https://alion.io/job/sarvam-ai-senior-software-engineer-data-infrastructure.json","meta":{"generated_at":"2026-11-14T13:37:08Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13981,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":229},"rest":"https://alion.io/mcp/rest/get_company?id=229"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsarvam-ai-senior-software-engineer-data-infrastructure"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsarvam-ai-senior-software-engineer-data-infrastructure"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsarvam-ai-senior-software-engineer-data-infrastructure"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sarvam-ai-senior-software-engineer-data-infrastructure\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsarvam-ai-senior-software-engineer-data-infrastructure"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4068547}},{"tool":"search_jobs","arguments":{"company":"sarvam.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4068547},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}