Senior Software Engineer - Data Acquisition
Wood Mackenzie is the global leader in analytics, insights and proprietary data across the entire energy and natural resources landscape.
For over 50 years our work has guided the decisions of the world’s most influential energy producers, utilities companies, financial institutions and governments.
Now, with the world’s energy system more complex and interconnected than ever before, sector-specific views are no longer enough. That’s why we’ve redefined what’s possible with Intelligence Connected.
By fusing our unparalleled proprietary data with the sharpest analytical minds, all supercharged by Synoptic AI, we deliver a clear, interconnected view of the entire value chain. Our trusted team of 2,700 experts across 30 countries breaks siloes and connects industries, markets and regions across the globe.
This empowers our customers to identify risk sooner, spot opportunities faster and recalibrate strategy with confidence - whether planning days, weeks, months or decades ahead.
Wood Mackenzie
Intelligence Connected
Wood Mackenzie Values
- Inclusive - we succeed together
- Trusting - we choose to trust each other
- Customer committed - we put customers at the heart of our decisions
- Future Focused - we accelerate change
- Curious - we turn knowledge into action
We are seeking a Senior Software Engineer with extensive years of experience to join our Data Acquisition team. In this role, you will design, develop, and maintain systems and data scraping pipelines. You will collaborate across teams, contributing to the technical evolution of our platform while ensuring scalable, resilient, and secure solutions.
Key Responsibilities:
Develop, maintain, and enhance systems and infrastructure for Data Scraping pipelines.
Collaborate with multiple teams to solve complex technical problems, particularly around Python, AWS, and CI/CD pipelines.
Build web-based applications, support microservices, and deploy them in cloud environments with a focus on data platform infrastructure.
Contribute to engineering initiatives and guide technical adoption across teams using the Data Platform.
Implement modern software engineering practices including test automation, architectural principles, and best practices for data platform development.
Ensure solutions are scalable, resilient, and secure.
Work closely with technical leadership to drive the technical evolution of the Data Platform.
Enable other teams to adopt new platform capabilities through collaboration and knowledge sharing.
About You:
Have strong experience in Python and AWS, including CI/CD.
Solid experience in web-based application development, microservices architecture, and cloud deployment.
Build and optimize scalable data systems onSnowflake while fostering collaboration across teams, ensuring our data platform evolves to meet growing business needs.
Excellent communication and collaboration skills, with the ability to work across teams.
Deep understanding of modern software engineering principles and practices applied to data platforms.
Experience with developing scalable, resilient, and secure systems.
Recognizes the importance of people in software development and works effectively with cross-functional teams.
Technical Skillsets:
We are looking for an experienced engineer with strong expertise in designing and operating scalable AWS-based data and backend platforms. The role requires hands-on proficiency in ECS, Terraform-driven infrastructure automation, Lambda, Glue, Docker/ECR, and Python.
Familiarity with CloudFormation, Jenkins CI/CD pipelines, TypeScript/Node.js, and Datahub or modern metadata/data catalogue platforms will be considered a strong plus.
Equal Opportunities
We are an equal opportunities employer. This means we are committed to recruiting the best people regardless of their race, colour, religion, age, sex (including pregnancy, sexual orientation, and gender identity), national origin, disability or protected veteran status. You can find out more about your rights under the law at www.eeoc.gov