{"id":2946631,"url":"https://alion.io/job/jpmorganchase-lead-data-engineer-36","title":"Lead Data Engineer","company":{"id":257,"name":"JPMorganChase","domain":"jpmorganchase.com","url":"https://alion.io/company/jpmorganchase","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":{"grade":"A","score":95,"open_postings":741,"ghost_share":0.009,"stale_share":0.333,"repost_share":0.09,"time_to_fill_p50_days":8,"computed_at":"2026-10-21T05:46:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":150000,"max_usd":263000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":34},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Apache Hudi","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"dbt","optional":false},{"name":"Docker","optional":false},{"name":"Flink","optional":false},{"name":"GCP","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Helm","optional":false},{"name":"Kubernetes","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Trino","optional":false},{"name":"CI/CD","optional":true}],"status":"live","first_seen_at":"2026-06-18T07:50:40Z","employer_posted_date":"2026-06-18","last_verified_at":"2026-10-21T15:10:01Z","board_verified":true,"closed_at":null,"days_open":125,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":124},"description":"Shape how hundreds of thousands of UK investors use data to make confident, informed investment decisions. Join a team building modern, cloud-native data platforms that enable analytics, regulatory reporting, and data-driven products at scale. You’ll work with contemporary lakehouse and streaming patterns, strong engineering practices, and a culture that values ownership and continuous improvement. This role offers meaningful scope to influence platform standards and mentor others while growing your technical and leadership impact.\nAs a Lead Data Engineer at JPMorgan Chase within Personal Investing, you will design, build, and operate a robust cloud-native data platform and pipelines that power analytics, regulatory reporting, and data-promoten applications. You will help us deliver reliable, scalable, observable, and secure data solutions by applying strong software engineering fundamentals and modern data engineering patterns. You’ll work closely with partners across product, analytics, and engineering to translate business needs into resilient technical designs. You’ll also contribute to engineering excellence through best practices, mentoring, and thoughtful technical direction.\nJob responsibilities\nDesign scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt\nBuild and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability\nDevelop and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformations\nModel and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads\nWrite production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design\n Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based data platform components\nContainerize and deploy services using Docker and Kubernetes (and related tooling such as Helm)\nCollaborate with analysts, data scientists, and application teams to turn requirements into technical designs and delivered solutions\nOwn critical data systems by improving reliability, scalability, security, and operational excellence\nMentor junior engineers and influence the team’s technical direction through standards, reviews, and knowledge sharing\nUses enterprise-authorized AI capabilities within the work environment to accelerate data platform and model design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements\nApplies reuse-first, AI-assisted practices within delivery and operational routines (e.g., backup/recovery validation and access control review support), ensuring traceability/auditability and alignment to resiliency and security expectations\nRequired qualifications, capabilities, and skills\nDegree in Computer Science or a STEM-related field (or equivalent)\nDemonstrated experience delivering in an agile, fast-paced engineering environment\n 8 years of recent, hands-on professional experience actively coding as a data engineer\nStrong software engineering fundamentals (system design, data structures, object-oriented programming, testing strategies, and end-to-end development lifecycle)\nStrong Python programming skills, including unit and integration testing\nHands-on experience building and operating cloud-based data platforms using major cloud services (e.g., AWS, Google Cloud, or Azure)\nExperience with large-scale distributed data processing and performance tuning\nHands-on experience with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar)\nStrong SQL skills and experience with SQL-based transformation tooling (e.g., dbt)\nExperience designing and operating orchestration pipelines using Airflow or similar tools\nExperience designing and building streaming pipelines using Kafka, Pub/Sub, or similar messaging systems\nDemonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity\nAbility to review and validate AI-assisted outputs (e.g., model/design summaries or operational checklists) before use, escalating when uncertain and following data handling requirements\nPreferred qualifications, capabilities, and skills\nData modeling experience for analytics and reporting use cases\nKnowledge of security, risk, compliance, and governance considerations for data platforms\nExperience building continuous integration and continuous delivery automation for data and platform services\nExperience with container-based deployment environments (Docker, Kubernetes, etc.)\nDemonstrated ability to coach teammates on engineering practices and contribute to a collaborative, inclusive team culture","description_format":"text","description_chars":4975,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Commercial & Retail Banks","Wealth Management & Financial Advisors","Asset Management & Funds","Investment Banking & M&A Advisory"],"lifecycle":[{"event":"open","at":"2026-10-20T18:50:54Z"}],"visa":[],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.29,"p_room":0.28,"age_days":124,"expected_fill_days":8,"reasons":["conf:0","wave","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/jpmorganchase-lead-data-engineer-36","json_url":"https://alion.io/job/jpmorganchase-lead-data-engineer-36.json","meta":{"generated_at":"2026-10-21T17:59:34Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":25316,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":257},"rest":"https://alion.io/mcp/rest/get_company?id=257"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fjpmorganchase-lead-data-engineer-36"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fjpmorganchase-lead-data-engineer-36"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fjpmorganchase-lead-data-engineer-36"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/jpmorganchase-lead-data-engineer-36\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fjpmorganchase-lead-data-engineer-36"}]}