Lead Data Engineer
First seen by Alion on Sep 21, 2026.
Key Responsibilities :
- Design, develop, maintain, and troubleshoot scalable data engineering solutions.
- Develop and troubleshoot Python-based operators, scripts, and data processing workflows.
- Build and optimize SQL queries for data validation, investigation, troubleshooting, and analysis.
- Develop and manage Apache Airflow DAGs for workflow orchestration.
- Design and support batch and streaming data pipelines.
- Implement data ingestion, movement, and integration patterns across multiple systems.
- Work with JSON-based configurations and data processing workflows.
- Apply AI concepts and technologies to data engineering use cases where applicable.
- Collaborate with cross-functional teams to troubleshoot data and pipeline issues.
- Ensure data quality, reliability, and accuracy across ingestion and integration processes.
Must-Have Skills :
- 8+ years of experience in Data Engineering.
- Intermediate-level proficiency in Python with hands-on experience developing operators and scripts.
- Strong SQL skills with experience in data validation, investigation, troubleshooting, and analysis.
- Hands-on understanding of Apache Airflow, including DAGs and workflow orchestration.
- Practical understanding and exposure to AI concepts and applications.
- Experience working with JSON configurations.
- Strong understanding of data ingestion and integration.
- Experience with both batch and streaming data pipelines.
- Understanding of data movement and integration patterns.
SAP Good to Have:
- SAP experience is not mandatory. Candidates with exposure to the following will have an advantage: SAP SLT, SAP S/4HANA data extraction, SAP CDS Views, SAP Extractors, SAP data extraction flows, SAP extraction T-codes.
- SAP knowledge can be supported through client-provided Knowledge Transfer (KT), if required.
Preferred Skills:
- SAP Data Intelligence Graphs, Snowflake, Airflow DAGs, REST/API integration, SQL-based data validation and refresh-metric analysis, experience working with enterprise-scale data integration environments.
Ideal Candidate Profile:
- A strong Data Engineering professional with solid hands-on experience in Python, SQL, Apache Airflow, AI concepts, data ingestion, and integration. SAP experience is an added advantage but is not mandatory.
Skills
Python, SQL, Apache Airflow, Data Engineering, Snowflake DB, Data Validation, Data Management, Data Ingestion, Data Integration