{"id":2556195,"url":"https://alion.io/job/experian-lead-data-platform-engineer-aws-spark","title":"Lead Data Platform Engineer - AWS, Spark","company":{"id":3558,"name":"Experian","domain":"experian.com","url":"https://alion.io/company/experian","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":75,"open_postings":17,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":26,"computed_at":"2026-10-15T05:46:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Nottingham, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":85000,"max_usd":149000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":33},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon EC2","optional":false},{"name":"Amazon EventBridge","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"CI/CD","optional":false},{"name":"Git","optional":false},{"name":"Hadoop","optional":false},{"name":"IAM","optional":false},{"name":"Jenkins","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"Terraform","optional":false},{"name":"CloudFormation","optional":true},{"name":"Kubernetes","optional":true},{"name":"OpenShift","optional":true},{"name":"Pytest","optional":true},{"name":"ScalaTest","optional":true},{"name":"SonarQube","optional":true},{"name":"Veracode","optional":true}],"status":"live","first_seen_at":"2026-10-14T16:20:25Z","employer_posted_date":"2026-10-14","last_verified_at":"2026-10-15T02:39:42Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries.\nInternal Grade D/EB8\n Experian Credit Services & Verifications are looking for a Lead Data Platform Engineer to provide hands-on technical leadership for a new fraud data capability that will connect fraud-related data assets into Experian's Data Analytics Platform.\nReporting into our Engineering Director, you will lead a technical team that supports innovation, learning and collaboration. Ensuring that the team follows the highest technical standards.\nYou will work closely with the central Data Analytics Platform team, data owners, security, compliance, platform and delivery stakeholders to agree practical implementation approaches, align with established platform patterns, and ensure the team delivers secure, scalable and supportable solutions.\nThis is a hands-on leadership role suited to someone who can combine strong data engineering depth with cloud platform experience, engineering discipline and team leadership. You will apply effective DevSecOps practices and contribute to technical roadmap discussions where there are shared or overlapping platform requirements, while working collaboratively with central platform teams where broader architectural ownership sits outside the local team.\nThis is a Hybrid, Nottingham based role (40% in the office).\nKey responsibilities\nLead and support an agile technical team delivering data platform solutions for fraud-related data assets.\nHelp guide the delivery of AWS-based data pipelines, data lake components and producer-side data platform capability.\nSupport the handover, ownership, maintenance and enhancement of pipelines and cloud components initially developed by the central DAP team.\nLead the team in building, testing and maintaining high-quality data pipelines from source systems such as Snowflake and internal product/data platforms.\nEnsure metadata is prepared and published accurately so assets can be surfaced through the DAP catalogue.\nChampion DevSecOps practices, CI/CD, Infrastructure as Code and cloud-native tooling to improve reliability, security and delivery efficiency.\nMentor and coach senior and junior engineers, supporting innovation, learning and collaboration within the team.\nPromote modern engineering practices, including automation and AI-assisted development where appropriate, to improve delivery speed, quality and repeatability.\n Strong experience building data pipelines, data lake solutions or data platform capabilities.\nStrong experience with AWS cloud services relevant to data engineering and platform delivery, including services such as AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.\nStrong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.\nStrong experience developing on Apache Spark or Hadoop.\nSignificant programming experience using Scala or Python.\nExperience with Configuration as Code principles and API integration.\nStrong understanding of cloud security, data privacy, access control and governance principles in data platform environments\nDesired skills\nAWS Developer Certification or other relevant AWS certification.\nStrong expertise in Terraform or CloudFormation.\nExperience with OpenShift or Kubernetes.\nExperience with automated testing tools such as pytest or Scalatest.\nFamiliarity with code quality and security scanning tools such as SonarQube and Veracode.\nKnowledge of RESTful APIs and microservice architectures.\nExperience working with sensitive, governed or regulated data environments.\nFamiliarity with data catalogue, metadata management, data marketplace or federated data mesh concepts.\n Benefits package includes:\nGreat compensation package and discretionary bonus plan\nCore benefits include pension, bupa healthcare, sharesave scheme and more\n25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.Our uniqueness is that we celebrate yours. Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces™ 2025 (Fortune Global Top 25), Great Place To Work™ in 26 countries to name a few. Check out Experian Life on social or explore our Careers Site to understand why. Experian is also proud to be an Equal Opportunity and Affirmative Action employer. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.\nRecruitment Fraud Awareness - Experian's recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @experian.com email address. Experian will never ask candidates to make any payment as part of an application, interview, assessment, onboarding, or recruitment process. To apply for roles or verify opportunities, please visit experian.com/careers.\nExperian Careers - Creating a better tomorrow together\nFind out what its like to work for Experian by clicking here","description_format":"text","description_chars":5331,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Annual leave"],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Fraud Detection","Credit Bureaus & Rating Agencies"],"lifecycle":[{"event":"open","at":"2026-10-14T19:16:27Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":0,"expected_fill_days":26,"reasons":["conf:3","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-10-15T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/experian-lead-data-platform-engineer-aws-spark","json_url":"https://alion.io/job/experian-lead-data-platform-engineer-aws-spark.json","meta":{"generated_at":"2026-10-15T06:34:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9881,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3558},"rest":"https://alion.io/mcp/rest/get_company?id=3558"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fexperian-lead-data-platform-engineer-aws-spark"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fexperian-lead-data-platform-engineer-aws-spark"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fexperian-lead-data-platform-engineer-aws-spark"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/experian-lead-data-platform-engineer-aws-spark\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fexperian-lead-data-platform-engineer-aws-spark"}]}