{"id":893365,"url":"https://alion.io/job/terrantic-lead-data-engineer","title":"Lead Data Engineer","company":{"id":10976,"name":"Terrantic","domain":"terrantic.com","url":"https://alion.io/company/terrantic","size_band":"1-10","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":31000,"max_usd":67000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":20},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Apache NiFi","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"ClickHouse","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Informatica","optional":false},{"name":"MySQL","optional":false},{"name":"Pandas","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"Self-Healing","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"SSIS","optional":false},{"name":"CloudFormation","optional":true},{"name":"Docker","optional":true},{"name":"Kubernetes","optional":true},{"name":"Spark","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-09-14T08:29:40Z","employer_posted_date":null,"last_verified_at":"2026-09-14T08:29:40Z","board_verified":false,"closed_at":null,"days_open":52,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":52},"description":"We are looking for a lead data engineer to own our data integration track. You will not only design robust integration architectures but also lead the successful implementation of these systems by guiding a team of 2-3 engineers. This is a \"Player-Coach\" role: you are expected to remain hands-on with code and architecture while ensuring the team delivers high-quality data pipelines faster than meets strict SLAs\nToday, you'll lead a team of about 2 engineers. Over the next 12-14 months, you'll grow that to a 5+ team. This is a player-coach role. You will guide the team in the design, development, and deployment of the pipelines and integrations, and it's an extremely hands-on role that requires you to also develop/validate/deploy components as we grow.\nThe candidate will have responsibilities across the following functions:\nTechnical Leadership and Implementation:\nLead the Squad: Manage, mentor, and conduct code reviews for a team of 2-3 data engineers. Drive sprint planning, estimation, and task delegation to ensure successful delivery.\nIntegration Architecture: Design scalable, fault-tolerant ETL/ELT frameworks to ingest complex data from diverse sources (REST APIs, streaming logs, CRM/ERP systems) into our central repository.\nImplementation Ownership: Take full accountability for the \"Implementation\" phase of the software lifecycle. Ensure that architectural designs are translated into functioning, production-grade code by the team.\nEngineering and Optimisation:\nAdvanced Pipeline Development: Handle the most complex transformations and architectural challenges. Move beyond simple ingestion to building self-healing and idempotent pipelines.\nPerformance Tuning: Write and optimise complex SQL queries and Python scripts. Identify bottlenecks in the data warehouse/lake and implement indexing, partitioning, or schema changes to improve performance.\nCode Quality Standards: Enforce version control best practices and CI/CD workflows, and run data validations within the team.\nAI/ML: Collaborate directly with data scientists and ML engineers to understand their feature requirements and build high-quality, production-ready pipelines. Engineer and manage the data infrastructure required for model training datasets, including versioning, lineage tracking, and compliance.\nReliability and Stakeholder Management:\nSLA Management and RCA: Lead the resolution of critical incidents (P0/P1). Move beyond \"debugging\" to performing root cause analysis (RCA) to prevent recurrence and ensure customer SLAs are met.\nData Quality Governance: Define the strategy for monitoring and alerting. Ensure the team implements automated checks for data accuracy, freshness, and completeness.\nCollaboration: Act as the technical point of contact for product managers and architects. Translate high-level business requirements into technical tickets for your team.\nRequirements:\n5+ years of professional experience in data engineering.\nMinimum 2 years of experience leading, mentoring, or managing a small team (formal or informal).\nMust be willing to work extended hours (to overlap the US time zone).\nYou will be the primary technical lead during these hours, ensuring unblocked development and rapid incident response.\nStill an active coder: You've shipped production-grade pipelines and orchestrated the flow in the last 6 months, not just managed people who did.\nStrong communication skills: You can explain complex technical decisions to non-technical stakeholders clearly.\nTechnical Competencies:\nDatabase Mastery: Expert-level proficiency in SQL (PostgreSQL, ClickHouse, and MySQL) and good experience with data warehousing modelling (star/snowflake schemas and SCDs).\nCode Proficiency: Good programming skills in Python (Pandas, PySpark, async libraries).\nOrchestration and Integration: Hands-on experience with modern data stack tools is mandatory (e. g., Airflow, NiFi, etc. )\nCloud Native: Proven experience implementing pipelines on hyperscalers (AWS, Azure, or GCP) using services like S3 Lambda/Functions, EMR, or Redshift/Synapse.\nSoft Skills:\nDelivery Focused: A mindset geared towards \"getting things done in the right and optimal manner\". Your focus would be on shipping working code and enabling the team to deliver without compromising on the quality of deliverables.\nCommunication: Ability to explain complex technical issues to non-technical stakeholders during US business hours.\nNice to Have:\nExperience with Infrastructure as Code (Terraform, CloudFormation).\nExperience implementing data quality tools.\nKnowledge of containerisation (Docker, Kubernetes) for deploying data apps.","description_format":"text","description_chars":4612,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":2,"team_size_min":2,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Food Technology","Manufacturing & Industrial Software"],"lifecycle":[{"event":"open","at":"2026-09-14T08:29:40Z"}],"visa":[],"liveness":{"score":9,"band":"cold","label":"Long shot","p_open":0.4,"p_active":0.484,"p_room":0.45,"age_days":51,"expected_fill_days":26,"reasons":["seen:51","win:tail"],"computed_at":"2026-11-05T05:54:30Z"},"pay":null,"html_url":"https://alion.io/job/terrantic-lead-data-engineer","json_url":"https://alion.io/job/terrantic-lead-data-engineer.json","meta":{"generated_at":"2026-11-05T20:09:27Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":27199,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-06T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":10976},"rest":"https://alion.io/mcp/rest/get_company?id=10976"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fterrantic-lead-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fterrantic-lead-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fterrantic-lead-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/terrantic-lead-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fterrantic-lead-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":893365}},{"tool":"search_jobs","arguments":{"company":"terrantic.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":893365},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}