Principal Data Engineer
The Walt Disney Company
As a Principal Data Engineer/Architect within the Identity Engineering organisation, you will be responsible for writing and reviewing code, contributing to technical decisions, and mentoring engineers in your squad. You will be empowered to contribute to technical and architectural decisions, and to influence the roadmap for your squad, working in partnership with your local leader, your squad, and your peers across Product, Project Management and Engineering.
You will contribute to and be part of an engaging, dynamic and inclusive engineering organisation, grounded in scrum and agile practices, CI/CD, great collaboration, functional programming, and motivated by a commitment to continuous learning and improvement. Identity Engineering delivers Consumer Identity and Access Management (CIAM) capabilities across The Walt Disney Company (TWDC), including but not limited to: D+, Hulu, ESPN+, and Parks. Identity Engineering squads build and run high-traffic and globally replicated systems, which form an integral and visible part of every user's journey at Disney properties. The Identity Data Engineering team is responsible for the design and development of data pipelines and data lakes to help our engineering teams operate and analyse the behaviour of our Consume Identity and Access Management (CIAM) systems.
Responsibilities:
- Contribute to the design, development, testing, deployment, and support of data pipelines and data lakes.
- Design, build and manage complex large-scale data architectures.
- Drive technical direction and set best practices for data governance, quality, security, and data modelling
- Mentor senior and junior data engineers, fostering a culture of engineering excellence, code review, and high-quality documentation.
- Collaborate with your squad, Product Managers, Designers, QA, Operations, and other stakeholders to understand requirements and articulate technical decisions and outcomes.
Requirements:
- Familiarity with at least one of the following languages: Scala, Python, and SQL.
- Familiarity with at least one of the following: Spark, Hive, or Presto.
- Familiarity with data engineering methods and their application at scale.
- Familiarity with at least one of the following cloud providers: Amazon Web Services (AWS), Google Cloud Compute (GCP), or Microsoft Azure.
- Solid experience in architecting Data systems.
- Experience working on complex projects at an organisational level, coordinating work between multiple teams.
- Familiarity with data quality and observability tools.
- Demonstrated ability to lead technical data teams, set direction, and grow engineers.
Desirable Skills:
- Familiarity with Databricks or Snowflake products.
- Familiarity with Terraform, CloudFormation, or another infrastructure as code (IaC) tool.
- Experience operating as a Principal Engineer / Data Architect.
- Bachelor's degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or a comparable field of study, and/or equivalent work experience.
- Minimum of 12+ years of related work experience.