Confirmed on the employer's own hiring board on Nov 20, 2026. First seen by Alion on Nov 18, 2026. Symphoni HR scores A on the Alion truth index.
The Big Data AWS Engineer will design, build, and maintain scalable data engineering pipelines and platforms on AWS to support analytics and business decision-making. The role involves developing metadata-driven ingestion frameworks, ETL workflows, and real-time streaming solutions while ensuring strong data security and governance. This is a hybrid position based in Bengaluru / Gurugram, requiring close collaboration with analytics, architecture, and business teams.
Our client is a leading global professional services firm in the accounting and finance sector, serving enterprises across multiple industries worldwide. They operate at very large scale, combining deep domain expertise with advanced technology to deliver data-driven solutions to their clients. The culture emphasizes collaboration, continuous learning, and a strong commitment to quality and integrity.
Responsibilities
- Design, develop, and optimize end-to-end data pipelines and ETL frameworks on AWS
- Build and maintain metadata-driven data ingestion frameworks for batch and streaming workloads
- Develop data processing jobs using PySpark, Spark, Scala, and Python on EMR and Databricks
- Implement real-time data ingestion and processing solutions using Kinesis and Kafka
- Manage data storage and warehousing solutions using S3, Redshift, and Athena
- Automate infrastructure and deployments using Terraform and CloudFormation
- Orchestrate serverless workflows using Lambda, Glue, and Step Functions
- Ensure data security, governance, and compliance across all data platforms
- Collaborate with architects, analysts, and stakeholders to translate requirements into technical solutions
- Monitor, troubleshoot, and tune pipeline performance and data quality
Requirements
- 5-7 years of hands-on experience in data engineering
- Strong proficiency in AWS data services including S3, Glue, Redshift, Lambda, Kinesis, EMR, and Athena
- Solid programming skills in Python, Scala, and SQL
- Hands-on experience with Spark, PySpark, Kafka, and Databricks
- Experience building ETL frameworks and metadata-driven ingestion frameworks
- Working knowledge of Terraform or CloudFormation for infrastructure as code
- Understanding of data security and governance best practices
- AWS Data Analytics or AWS Solutions Architect certification preferred
- Strong problem-solving skills and ability to work in a hybrid setup
Qualifications
5-7 years of hands-on experience in data engineering Strong proficiency in AWS data services including S3, Glue, Redshift, Lambda, Kinesis, EMR, and Athena Solid programming skills in Python, Scala, and SQL Hands-on experience with Spark, PySpark, Kafka, and Databricks Experience building ETL frameworks and metadata-driven ingestion frameworks Working knowledge of Terraform or CloudFormation for infrastructure as code Understanding of data security and governance best practices AWS Data Analytics or AWS Solutions Architect certification preferred Strong problem-solving skills and ability to work in a hybrid setup
Skills
Data Engineering, AWS, SQL, Python, Scala, PySpark, ETL frameworks, S3, Glue, Redshift, Lambda, Kinesis, EMR, Spark, Kafka, Databricks, Metadata driven ingestion frameworks, Terraform, CloudFormation, Data security and governance, AWS Data Analytics certification, AWS Solutions Architect certification, Athena, Step Functions

