{"id":4375537,"url":"https://alion.io/job/illumina-senior-data-engineer-2","title":"Senior Data Engineer","company":{"id":4262,"name":"Illumina","domain":"illumina.com","url":"https://alion.io/company/illumina","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":88,"open_postings":14,"ghost_share":0,"stale_share":0.5,"repost_share":0,"time_to_fill_p50_days":42,"computed_at":"2026-11-16T05:46:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon S3","optional":false},{"name":"ChatGPT","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude","optional":false},{"name":"Copilot","optional":false},{"name":"Cursor","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"Delta Lake","optional":false},{"name":"Fivetran","optional":false},{"name":"Git","optional":false},{"name":"Grafana","optional":false},{"name":"Incident Management","optional":false},{"name":"Jira","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"ServiceNow","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-16T14:42:06Z","employer_posted_date":"2026-11-16","last_verified_at":"2026-11-16T14:42:06Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"What if the work you did every day could impact the lives of people you know? Or all of humanity?At Illumina, we are expanding access to genomic technology to realize health equity for billions of people around the world. Our efforts enable life-changing discoveries that are transforming human health through the early detection and diagnosis of diseases and new treatment options for patients.Working at Illumina means being part of something bigger than yourself. Every person, in every role, has the opportunity to make a difference. Surrounded by extraordinary people, inspiring leaders, and world changing projects, you will do more and become more than you ever thought possible.Position Summary:\nThe Senior Data Engineer will be part of the Data Engineering and Analytics team, designing, building, validating, and supporting enterprise data pipelines that integrate SAP S/4HANA data into the Databricks Lakehouse through SAP Datasphere and Amazon S3. The engineer owns assigned SAP datasets end to end, from source analysis and ingestion through reconciliation, testing, release, and production support, within approved architecture, security, and change-control standards. The role partners with SAP, platform, architecture, governance, and business teams, leads complex troubleshooting and continuous improvement, and provides technical guidance to other engineers.\nResponsibilities:\nOwn end-to-end onboarding of assigned SAP objects following the standard onboarding runbook, including source analysis, CDS wrapper view creation, Datasphere replication flow setup, Bronze ingestion configuration, validation, and sign-off.\nDesign, build, and maintain Bronze ingestion pipelines in Databricks (Auto Loader, Lakeflow Declarative Pipelines, PySpark, Delta Lake) for full, delta, CDC, and watermark loads, handling restartability, deletes, and schema changes within approved design patterns.\nOperate and monitor Datasphere replication flows into Amazon S3, recover failed runs, and work with the platform administration team to resolve connectivity and capacity issues.\nRun source-to-Bronze reconciliation as a continuous control; review PASS/FAIL results, investigate aggregate and record-level discrepancies, and document corrective actions.\nPlan and execute SIT/UAT scenarios covering full loads, deltas, deletes, and field additions or removals; reconcile SAP validation output against Bronze data and compile acceptance evidence.\nMonitor pipeline observability dashboards and alerts; resolve ingestion failures and schema drift, lead root cause analysis (RCA) for complex issues, and implement preventive actions.\nPromote all changes through Git and CI/CD, review peer code and configurations, and apply approved Unity Catalog access controls for assigned datasets.\nDevelop automation and reusable components that improve onboarding, reconciliation, monitoring, and recovery.\nMaintain the SAP object inventory (extraction method, load pattern, Bronze location, delivery wave, status, and exceptions) along with per-object operational documentation, recovery procedures, and knowledge-transfer material.\nResolve Jira and ServiceNow tickets for SAP data pipelines, record hypercare incidents and resolutions, mentor junior engineers, and provide after-hours on-call support on a rotating basis.\nundefined\nListed responsibilities are an essential, but not exhaustive list, of the usual duties associated with the position. Changes to individual responsibilities may occur due to business needs.\nRequirements:\nRequired\n6+ years of enterprise data engineering or data integration experience, including hands-on Databricks delivery and production SAP data integration.\nHands-on Databricks experience with PySpark, Spark SQL, Delta Lake, Auto Loader, Lakeflow Declarative Pipelines (DLT), Workflows, Databricks SQL, and Unity Catalog.\nAdvanced SQL and Python, including reconciliation queries, aggregate comparisons, record-level validation, and automation scripting.\nSAP S/4HANA knowledge, including core table structures, CDS view development, ODP delta extraction, and record-level verification (SE16).\nStrong understanding of full, delta, pseudo-delta, and CDC loads, including watermarks, delete handling, restartability, error handling, and schema drift.\nPractical experience with Git, code review, testing, and CI/CD deployment across environments.\nExperience with pipeline monitoring and incident management using Databricks dashboards, Grafana, Jira, and ServiceNow.\nProven ability to troubleshoot complex production issues, lead root cause analysis, and maintain clear technical documentation.\nStrong communication and collaboration skills across SAP, platform, and business teams, with experience mentoring junior engineers.\nFlexibility to work occasional non-standard hours and participate in a rotating on-call schedule; international travel may be needed.\nPreferred\nExperience with SAP Datasphere / Business Data Cloud replication flows, or replication tools such as SLT, HVR, or Fivetran.\nSIT/UAT, cutover, and hypercare experience on an ERP program.\nExposure to dbt.\nExperience using AI-enabled engineering tools, such as Cursor, Claude, ChatGPT, or GitHub Copilot.\nundefined\nundefined\nExperience/Education:\nTypically requires a minimum of 6 years of related experience with a Bachelor’s degree; or 3 years and a Master’s degree; or a PhD without experience; or equivalent work experience.\nWe are a company deeply rooted in belonging, promoting an inclusive environment where employees feel valued and empowered to contribute to our mission. Built on a strong foundation, Illumina has always prioritized openness, collaboration, and seeking alternative perspectives to propel innovation in genomics. We are proud to confirm a zero-net gap in pay, regardless of gender, ethnicity, or race. We also have several Employee Resource Groups (ERG) that deliver career development experiences, increase cultural awareness, and offer opportunities to engage in social responsibility. We are proud to be an equal opportunity employer committed to providing employment opportunity regardless of sex, race, creed, color, gender, religion, marital status, domestic partner status, age, national origin or ancestry, physical or mental disability, medical condition, sexual orientation, pregnancy, military or veteran status, citizenship status, and genetic information. Illumina conducts background checks on applicants for whom a conditional offer of employment has been made. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable local, state, and federal laws. Background check results may potentially result in the withdrawal of a conditional offer of employment. The background check process and any decisions made as a result shall be made in accordance with all applicable local, state, and federal laws. Illumina prohibits the use of generative artificial intelligence (AI) in the application and interview process. If you require accommodation to complete the application or interview process, please contact . To learn more, visit: https://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf. The position will be posted until a final candidate is selected or the requisition has a sufficient number of qualified applicants. This role is not eligible for visa sponsorship.","description_format":"text","description_chars":7388,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Genomics & Genetic Testing","Laboratory Equipment"],"lifecycle":[{"event":"open","at":"2026-11-16T14:42:06Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":42,"reasons":["conf:0","win:early","comp:brand"],"computed_at":"2026-11-16T15:37:18Z"},"pay":null,"html_url":"https://alion.io/job/illumina-senior-data-engineer-2","json_url":"https://alion.io/job/illumina-senior-data-engineer-2.json","meta":{"generated_at":"2026-11-16T15:37:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":24754,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4262},"rest":"https://alion.io/mcp/rest/get_company?id=4262"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fillumina-senior-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fillumina-senior-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fillumina-senior-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/illumina-senior-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fillumina-senior-data-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4375537}},{"tool":"search_jobs","arguments":{"company":"illumina.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4375537},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}