Data Engineer

OVERVIEW OF THE COMPANY

JOB DESCRIPTION

Fox Corporation: Fox Corporation is home to industry-leading brands including FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations, and Tubi Media Group. We combine innovative technology, deep data insights, and world-class content to shape the future of digital entertainment. Our DTC platforms are built to deliver highly personalized, scalable user experiences to millions of global users.

ABOUT THE ROLE

FOX Corporation is looking for a highly skilled and experienced Data Engineer (L2) / Senior Data Engineer for its Digital Product Engineering Data Engineering team. The candidate should have a strong foundation in distributed data processing, cloud-native data platforms, and modern data engineering practices.

Our Data Engineering team is responsible for designing, building, and maintaining scalable data platforms that power business intelligence, analytics, personalization, reporting, and machine learning across FOX's digital ecosystem. We leverage modern cloud technologies and distributed data processing frameworks to ingest, transform, and deliver reliable data from millions of customer interactions. With a strong emphasis on data quality, scalability, reliability, and operational excellence, the team is committed to delivering trusted data solutions that enable data-driven decision making across the organization.

As a Data Engineer (L2) / Senior Data Engineer, you will play a pivotal role in designing, developing, and maintaining scalable data pipelines and cloud-based data platforms. You will contribute to technical initiatives, mentor junior engineers, and collaborate with cross-functional teams to deliver reliable, secure, and high-performance data solutions that support FOX's digital products.

A SNAPSHOT OF YOUR RESPONSIBILITIES

• Collaborate with and across agile teams to design and develop data engineering solutions.

• Build distributed, low latency, reliable data pipelines ensuring high availability and timely delivery of data.

• Design and develop highly optimized data engineering solutions for Big Data workloads to efficiently handle continuous increase in data volume and complexity.

• Build highly performing real-time data ingestion solutions for streaming workloads.

• Adhere to best practices and agreed upon design patterns across all Data Engineering solutions.

• Ensure the code is elegantly designed, efficiently coded, and effectively tuned for performance.

• Focus on data quality and consistency, implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

• Create design (Data Flow Diagrams, Technical Design Specs, Source to Target Mapping documents) and test (unit/integration tests) documentation

• Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.

• Focus on end-to-end automation of data engineering pipelines and data validations (audit, balance controls) without any manual intervention

• Focus on data security and privacy by implementing proper access controls, key management, and encryption techniques.

• Take a proactive approach in learning new technologies, stay on top of tech trends, experimenting with new tools & technologies and educate other team members

• Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization

• Communicate clearly and effectively to technical and non-technical leadership

WHAT YOU WILL NEED

• Education: Bachelor’s degree in Computer Science, Computer Engineering, or relevant field

• 3 to 7 years of experience in architecting, designing and building Data Engineering solutions and Data Platforms.

• Experience in building Lakehouse or Data Warehouses on Databricks or Snowflake.

• Expertise in designing and building highly optimized batch/streaming data pipelines in Data Bricks

• Experience working with data acquisition and transformation tools such as Fivetran and DBT.

• Experience building highly optimized & efficient data engineering pipelines using Python, PySpark.

• Experience working with distributed data processing frameworks such as Apache Hadoop, or Apache Spark or Flink

• Experience working with real-time data streams processing using Apache Kafka, Kinesis or Spark Structured Streaming

• Experience working with various AWS Services (S3, EC2, EMR, Lambda, RDS, DynamoDB, Redshift, Glue Catalog)

• Expertise in Advanced SQL programming and SQL Performance Tuning

• Experience with version control tools such as GitHub or Bitbucket.

• Expert level understanding of dimensional modeling techniques.

• Experience working with fully automated workflow scheduling and orchestration services such as Astronomer or Apache Airflow.

• Experience with CI/CD using GitHub Actions or Jenkins.

• Excellent communication, adaptability, and collaboration skills.

• Excellent analytical skills, strong attention to detail with emphasis on accuracy, consistency, and quality

• Strong logical and problem-solving skills with critical thinking

NICE TO HAVE

• Experience in designing and building applications using Container and serverless technologies.

• Experience working with semi-structured, unstructured data, No SQL databases.

• Experience designing and building APIs.

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, disability, protected veteran status, or any other characteristic protected by law. We will consider for employment qualified applicants with criminal histories consistent with applicable law.