{"id":1454386,"url":"https://alion.io/job/dunnhumby-senior-big-data-engineer","title":"Senior Big Data Engineer","company":{"id":51494,"name":"Dunnhumby","domain":"dunnhumby.com","url":"https://alion.io/company/dunnhumby","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"A","score":100,"open_postings":4,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":50,"computed_at":"2026-09-30T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Gurgaon, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":21000,"max_usd":43000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":51},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Airflow","optional":false},{"name":"Alation","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Azure","optional":false},{"name":"Collibra","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Flink","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Hadoop","optional":false},{"name":"HBase","optional":false},{"name":"Java","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false}],"status":"live","first_seen_at":"2026-09-29T08:27:25Z","employer_posted_date":"2026-09-29","last_verified_at":"2026-09-30T20:06:16Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"About dunnhumby\ndunnhumby is the global leader in Customer Data Science, helping the world's most ambitious retailers and brands put the customer at the heart of every decision. With nearly 3,000 experts across Europe, Asia, Africa and the Americas, we partner with iconic businesses like Tesco, Coca-Cola, Meijer, Procter & Gamble and Metro to turn data into growth, innovation and measurable value for their customers.\nTarget\nOur Target team is at the heart of one of dunnhumby’s most exciting partnerships - bringing customer data science to one of America’s most iconic retailers. Working with Target’s over 100 million Target Circle members, we turn unrivalled guest data into growth, helping shape ranges, pricing, promotions and the personalised experiences that keep Target guests coming back\nAbout the Role\nWe’re looking for a Sr Big Data Engineer who expects more from their career. It’s chance to extend and improve dunnhumby’s Data Engineering Team. It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. \nKey Responsibilities \nDesign end-to-end data solutions, including data lakes, data warehouses, ETL/ELT pipelines, APIs, and analytics platforms. \nArchitect scalable and low-latency data pipelines using tools like Apache Kafka, Flink, or Spark Streaming to handle high-velocity data streams. \nDesign /Orchestrate end-to-end automation using orchestration frameworks such as Apache Airflow to manage complex workflows and dependencies. \nDesign intelligent systems that can detect anomalies, trigger alerts, and automatically reroute or restart processes to maintain data integrity and availability. \nDefine and implement data governance, metadata management, and data quality standards. \nLead architectural reviews and technical design sessions to guide solution development. \nPartner with business and IT teams to translate business needs into data architecture requirements. \nEnsure security, compliance, and regulatory requirements are addressed in all data solutions. \nEvaluate and recommend improvements to existing data architecture and processes. \nTechnical Expertise\nBachelors or masters degree in computer science, Information Systems, Data Science, or related field. \nExtensive experience with high level programming languages - Python, Java or Scala \n5+ years of experience in data architecture, data engineering, or a related field. \nProficient in data pipeline tools such as Apache Spark, Kafka, Airflow, or similar. \nExperience with data governance frameworks and tools (e.g., Collibra, Alation, OpenMetadata). \nStrong knowledge of cloud platforms (Azure or Google Cloud), especially with cloud-native data services. \nExperience working in Agile or DevOps environments. \nExperience with modern data stack tools (e.g., dbt, Snowflake, Databricks). \nExperience with Hive, Oozie, Airflow, HBase, MapReduce, Spark along with working knowledge of Hadoop/Spark Toolsets. \nExtensive Experience working with Git and Process Automation \nIn depth understanding of relational database management systems (RDBMS) and Data Flow Development. \nWhat You Can Expect From Us\nWe won't just meet your expectations. We'll defy them. So you'll enjoy the comprehensive rewards package you'd expect from a leading technology company. But also, a degree of personal flexibility you might not expect. Plus, thoughtful perks, like flexible working hours and your birthday off.\nAnd we don't just talk about diversity and inclusion. We live it every day - with thriving networks including dh Gender Equality Network, dh Proud, dh Family, dh One, dh Enabled and dh Thrive as the living proof. We want everyone to have the opportunity to shine and perform at your best throughout our recruitment process - please let your recruiter know what adjustments would help.\nBenefits for India\nHealthcare: Comprehensive medical insurance cover of INR 500,000 for employees and eligible dependants, including dental and vision cover up to INR 5,000, with optional top-up plans available.\nProtection: Group Term Life Insurance and Group Personal Accident cover are provided, with coverage levels linked to employee grade.\n Retirement & Financial Wellbeing: Provident Fund, Gratuity, and voluntary National Pension Scheme (NPS) support long-term financial planning.\nWellbeing Support: Access to the dh Wellness Hub together with confidential employee assistance services and professional support sessions.\nLifestyle & Flexibility: Internet allowance of INR 2,000 per month for blended working, work-from-home kit support for new joiners, and monthly Early Friday finishes.\nTime Off & Family Support: 25 days holiday plus 10 public holidays, maternity, paternity and adoption leave, and a day off on your birthday.\nOur approach to Flexible Working\nAt dunnhumby, we value and respect difference and are committed to building an inclusive culture by creating an environment where you can balance a successful career with your commitments and interests outside of work.\nWe believe that you will do your best at work if you have a work / life balance. Some roles lend themselves to flexible options more than others, so if this is important to you please raise this with your recruiter, as we are open to discussing agile working opportunities during the hiring process.\nFor further information about how we collect and use your personal information please see our Privacy Notice which can be found (here).","description_format":"text","description_chars":5460,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Flexible schedule","Health insurance","Life insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Advertising","Customer & Retention Analytics","Retail & Pricing Analytics"],"lifecycle":[{"event":"open","at":"2026-09-29T09:04:54Z"}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":50,"reasons":["conf:4","velocity","win:early"],"computed_at":"2026-09-30T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/dunnhumby-senior-big-data-engineer","json_url":"https://alion.io/job/dunnhumby-senior-big-data-engineer.json","meta":{"generated_at":"2026-09-30T21:21:05Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","usage":{"tier":"assistant","counted_by":"address","units_charged":1,"used_today":1971,"day_limit":2000,"remaining_today":29,"minute_limit":60,"resets_at":"2026-10-01T00:00:00Z"}}}