{"id":3679527,"url":"https://alion.io/job/super-money-senior-data-engineer","title":"Senior Data Engineer","company":{"id":1476,"name":"super.money","domain":"super.money","url":"https://alion.io/company/super-money","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"ClickHouse","optional":false},{"name":"Dagster","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Trino","optional":false},{"name":"dbt","optional":true}],"status":"live","first_seen_at":"2026-11-03T12:35:00Z","employer_posted_date":null,"last_verified_at":"2026-11-03T12:35:00Z","board_verified":false,"closed_at":null,"days_open":2,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":2},"description":"We're looking for a Senior Data Engineer to own how data moves, lives, and is used across the entire org: from ingestion and storage to a unified data store, transformation, serving, and analytics. A core part of this role is deeply understanding how to design and build data lakes/lakehouses from the ground up: choosing storage and table formats, laying out zones, and turning scattered sources into one governed source of truth. You'll treat data as a product across the board: reliable, discoverable, and built for scale. Deep ClickHouse expertise is essential.\n\nResponsibilities: \nDesign and operate high-throughput ingestion pipelines (batch + streaming) from diverse sources across the org.\nOwn ClickHouse at scale: schema design, partitioning, sharding, materialized views, query optimization, and cluster tuning.\nBuild and evolve core data infrastructure; storage, transformation, orchestration, and serving layers are used across teams.\nDesign and build the data lake/lakehouse from the ground up: storage architecture, zoning (raw → refined → serving), open table formats (Iceberg / Delta / Hudi), and it as the org's single source of truth.\nTreat data as a product org-wide: SLAs, data contracts, lineage, observability, and self-serve access for every consumer.\nModel data end-to-end: from source capture through transformation to the layers analysts, services, and products actually query.\nOwn data quality, governance, and correctness across every stage of the flow.\nPartner with engineering, analytics, PMs, and other stakeholders to translate business needs into robust data systems.\nMentor engineers and set technical direction for the data org.\n\nRequirements: \n7+ years in data engineering, with senior ownership of production data systems.\nStrong ingestion background: Kafka / CDC / streaming and batch ETL, handling schema drift, backfills, and late or duplicate data.\nGenuine understanding of data in and out: how it's produced upstream, how it moves, and how it's consumed downstream.\nData lake and unified-store experience: designing a data lake/lakehouse as a unified store: open table formats (Iceberg / Delta / Hudi), object storage, partitioning and file layout, and query engines over it (Spark / Trino / Presto).\nExperience treating data as a product across the org, thinking about consumers, reliability, contracts, and interfaces.\nComfort with orchestration (Airflow / Dagster / etc. ) and modern data infrastructure.\n\nNice to Have: \nExperience scaling ClickHouse clusters in production.\nStreaming ingestion into the lake (Kafka → object storage, CDC, exactly-once).\nData catalog/governance tooling (e. g., Glue, Unity Catalog, DataHub).\nReal-time analytics / OLAP at high volume.\ndbt or similar transformation frameworks.\nSkills\nAirflow, CDC, ClickHouse, Dagster, Data Engineering, Delta, ETL, Hudi, Iceberg, Kafka, Presto, Spark, Streaming, Trino, dbt","description_format":"text","description_chars":2885,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Payment Processing & Gateways","Digital Banks & Neobanks"],"lifecycle":[{"event":"open","at":"2026-11-03T12:35:00Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":2,"expected_fill_days":29,"reasons":["seen:2","win:early"],"computed_at":"2026-11-06T05:58:05Z"},"pay":null,"html_url":"https://alion.io/job/super-money-senior-data-engineer","json_url":"https://alion.io/job/super-money-senior-data-engineer.json","meta":{"generated_at":"2026-11-06T06:58:09Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12350,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1476},"rest":"https://alion.io/mcp/rest/get_company?id=1476"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsuper-money-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsuper-money-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsuper-money-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/super-money-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsuper-money-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3679527}},{"tool":"search_jobs","arguments":{"company":"super.money","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3679527},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}