Senior Data Engineer (PST Overlap)
About The Role
Our client is one of the largest game studios known for their very successful MOBA and FPS franchises. You will be a member of the Data Experiences and Automation team which collects and uses data to improve the player's experience.
Data Team is an initiative accountable for decision science, data products, data capture, and data warehousing and governance. Their mission is to harness the power of data for player-centric decisions and AI/ML products that make it better to be a player.
You'll work closely with a technical lead to expand data consumption and reporting capabilities and build solutions to improve the development lifecycle for data engineers and insight analysts throughout the organization. You'll be helping to enable advancements and fast iteration in Machine Learning and GenAI pipelines.
As a core contributor, you will play a vital role in building robust data solutions capable of processing petabytes of information. The ultimate goal is to help product teams to operate their services with enhanced efficiency. Your extensive experience working with large-scale data and globally distributed systems will be invaluable in aiding our efforts to develop effective solutions.
Responsibilities
Please note, availability to attend afternoon/evening meetings is a requirement for this role as most of the team is located on the US West Coast (LA and Seattle)
Design, build, and optimize scalable pipelines for data, supporting insight into the the Data Foundation ecosystem
Design and implement data models using industry best practices that capture a complete ecosystem view of internal customer experiences, while ensuring accuracy, scalability,and long-term usability
Architect and implement robust, maintainable, and high-performance data solutions
Automate workflows to reduce manual intervention and enhance data processing efficiency, including automation for content, growth, and pubsports areas of coverage
Optimize query performance and resolve pipeline bottlenecks to improve data accessibility
Evaluate and adopt new tools, frameworks, and methodologies to advance data engineering capabilities
Support cost optimization by ensuring scalable and efficient data solutions
Ensure data quality, governance, and compliance with regulatory standards (e.g., GDPR, CCPA)
Contribute to engineering discipline by shaping infrastructure, craft standards, tooling, and organizational best practices
Required qualifications
Minimum of 5 years commercial work experience in data engineering or a related field
Bachelor's or higher degree in Computer Science, Software Engineering, or a related field
Proficiency in Python, essential for data processing and analysis tasks
Hands-on experience with DBT (Data Build Tool) and Airflow
Commercial experience using PySpark and Databricks
Proficiency in AWS cloud infrastructure (AWS)
Effective communication and teamwork skills
Nice to have
Experience with ML Operations and GenAI pipelines and infrastructure
Experience in the gaming industry, particularly with online multiplayer games
Experience working with cross-discipline organizations that build data products
Proficient in large-scale data manipulation across various data types
Demonstrated ability to troubleshoot and optimize complex ETL pipelines
Proven experience mentoring and guiding other engineers