Senior Data Engineer

We are seeking an experienced Senior Data Engineer to lead the design and development of robust data pipelines and Master Data Management (MDM) solutions. You will work within a hybrid model to build high-performance, scalable cloud-based applications that support critical business operations. This role is ideal for a data professional looking to solve complex engineering challenges in a fast-paced, global environment.

Our client is a prominent global leader in the computer software industry, known for delivering innovative digital solutions to Fortune 500 organizations. They foster a collaborative, high-performance culture that empowers professionals to work on large-scale, complex data initiatives. With a focus on cutting-edge technology, they provide an environment where technical expertise is highly valued and rewarded.

Responsibilities

• Design and develop scalable data applications using PySpark and Python
• Build and maintain efficient data ingestion and processing pipeline frameworks
• Implement and manage enterprise-level Master Data Management and Reference Data Management solutions
• Develop and optimize high-volume data solutions within cloud environments
• Collaborate with global cross-functional teams in an Agile development lifecycle
• Integrate and manage data flows using REST APIs, JSON, and XML formats
• Ensure high performance and reliability of data systems using Redis, Valkey, and OpenSearch

Requirements

• 8+ years of professional experience in data engineering
• Strong proficiency in Python and PySpark for large-scale data processing
• Hands-on experience with Informatica PowerCenter
• Deep expertise in AWS services including AWS Glue and AWS Lambda
• Solid understanding of Master Data Management (MDM) and Reference Data Management (RDM) principles
• Proficiency in SQL and database management
• Experience with CI/CD tools such as Jenkins, Bitbucket, and GIT
• Familiarity with Flask and Pandas for data application development