Senior Software Engineer - AWS Glue

We are looking for a Sr. Data Engineer with 4-6 years of experience building and maintaining reliable data solutions. The ideal candidate has strong skills in Python, SQL, AWS, and data analysis, communicates clearly with technical and business teams, and understands the insurance domain.

Responsibilities:

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Develop and optimize Python and SQL code for data ingestion, transformation, validation, and reporting.
• Build and support cloud-based data solutions on AWS, using services such as Amazon S3, AWS Glue, Lambda, Redshift, and Athena.
• Analyze data to identify trends, anomalies, quality issues, and opportunities for improvement.
• Work with analysts, product owners, and business stakeholders to understand requirements and deliver trusted data.
• Apply data quality checks, monitoring, and documentation to ensure data is accurate, secure, and reliable.
• Troubleshoot pipeline and data issues, identify root causes, and implement lasting fixes.
• Follow security, governance, and compliance practices when handling sensitive data.

Required Qualifications:

• 4-6 years of professional experience in data engineering or a closely related role.
• Strong proficiency in Python and SQL, including writing and optimizing queries.
• Hands-on experience designing and supporting data pipelines in AWS.
• Experience with data analysis, data profiling, and validating results.
• Knowledge of data modeling concepts and relational databases.

Skills

AWS Glue, Python, SQL