Chapter Lead Data Engineer
First seen by Alion on Sep 22, 2026.
Title : Lead Data Engineer
Location : Hyderabad - 4 days Office
Experience : 8 to 12 Years
Your Role :
As the Data Engineering Lead, you will be a leader of the data engineering team working on in-house products for Data Foundation. Collaborating closely with Product Owner(s), Product Architect(s) and other DataOps teams you will need to understand the business needs, helping Product Architect(s) to convert those needs into solution architecture specifications and services in line with overall engineering standards and roadmaps. You will be driving excellence in engineering practices to deliver high-quality solutions throughout the software development lifecycle in our IT landscape. This role involves hands-on development work. This role will directly report to Engineering Manager.
Must have (all levels) :
- Strong experience in Azure cloud data services & technologies
- Azure Databricks, Unity Catalog, Delta live tables
- Data Modelling & Architecture, ETL pipeline design, Expert in Python, Pyspark and SQL
- Azure Data Factory, Azure DevOps
- Logging and Monitoring using Azure / Databricks services
- Apache Kafka
Technology Nice to have :
- Synapse, Fabric, PowerBI, Azure Functions, Azure Logic apps
- Azure API services, Microsoft Entra ID, GCP & AWS cloud services knowledge, Azure Networking, Databricks online table, Jira
- Shell scripting / Azure CLI knowledge
Key Responsibilities :
- Lead a team of experienced team members of Data Engineers in designing, developing, and delivering scalable, reliable, and high performing software solutions.
- Lead the design, development, and maintenance of scalable data pipelines and ETL processes. Monitor and optimize data infrastructure performance, identifying and resolving bottlenecks and issues.
- Lead the team from a technical standpoint, and drive operational excellence, including code reviews, design reviews, testing, and deployment processes.
- Be an individual contributor (~60%) engineering the software products/solutions, jointly with the team.
- Ensure that the team adheres to coding standards, best practices, and architectural guidelines, oversee team spirit and team performance, guide and mentor team members.
- Oversee the implementation of the technical architecture, solve immediate technical challenges.
- Implement good practices, coding standards and modern architecture for DataOps; be a go-to-person for technical decisions and problem-solving within the team.
- Ensure that the execution of DataOps is in place in the team's daily work.
- Inspire, advise, and drive the selection of development approach.
- Coordinate software development and address technical debt in the team.
- Hire, onboard, mentor, and develop top engineering talents, fostering a culture of learning, collaboration, and continuous improvement.
- Lead technical discussions with other teams/departments and oversees state-of-art quality of the stack.
- May be involved in cross-functional discussions, representing the domain in broader technical discussions across domains.
- Responsible for designing and improving processes that enhance efficiency and quality.
- Communication with Engineering Manager, Product Owner, Business Analyst and Scrum Master to align on project/sprint goals, timeline and resource allocation.
Qualifications :
- 8+ years of working experience in field of Data Engineering, Software Engineering.
- 5+ years of experience in managerial position.
- Hands-on experience and in-depth knowledge of the technologies listed as mandatory in the Technology Stack section.
- Strong understanding and implementation of software development principles, coding standards, and modern architecture.
- Hands-on experience in implementing and managing End-to-End DataOps / Data Engineering projects in a team.
- Proven ability to lead software development teams of engineers with varying experience and adapt to team sizes from small to large.
- Experience in working in diverse projects with varying technologies, products, and systems.
- Strong problem-solving skills and ability to make critical technical decisions.
- Ability to guide / mentor other team members.
- Stakeholder engagement/influence skills.
- Pragmatic, and collaborative team player.
- Experience with Databricks, Data pipelines, CI/CD.
- Proficiency in Python, SQL and big data technologies in Cloud environment.
Language(s) :
- Excellent written and verbal English.
- Other language required to perform job for the given OpCo(s).
Functional Competencies :
- Leadership competencies : Being able to set clear goals and objectives for the team, prioritizing tasks and allocating resources effectively. Inspiring team members, create a safe environment for developers.
Skills
Data Engineering, Azure Databricks, Data Catalogue, Azure Data Factory, Synapse Analytics, Data Pipeline, ETL, Data Infrastructure, DataOps