Senior/Lead Data Engineer
First seen by Alion on Aug 25, 2026.
Overview :
We are looking for an experienced Data Engineer to manage, enhance and scale our internal analytics platform that supports both real-time and historical data processing. The role involves working across streaming systems, data infrastructure, APIs, and reporting layers to ensure high performance, reliability, and scalability.
Job Profile & Qualification:
- B.Tech / MCA / M.Sc (IT, Computer)
- 8 - 12 years relevant experience in data management and interpretation for B2C websites and mobile apps.
- Experience in Digital space (website and mobile applications) is mandatory.
- Experience in working with various web analytics tools like Google Analytics (GA4), Chartbeat, Comscore etc.
- Good analytical, mathematical and problem solving skills.
- Exposure to JavaScript, Java, Web API development.
- Hands-on exposure to NoSQL (DynamoDB, Accumulo etc) and large data stores on Snowflake, Pinot etc.
- Experience with workflow orchestration tools (Airflow).
- Strong experience in real-time streaming systems (Kinesis).
- Working with structured/un-structured data, file parsing etc.
- Experience in data models and reporting packages.
- Ability to analyse large datasets.
- Ability to write comprehensive reports.
- Excellent verbal and written communication skills.
Key Responsibilities :
- Own and manage the existing real-time and batch data platform, ensuring high availability and reliability.
- Monitor, troubleshoot, and optimize data pipelines and streaming systems.
- Enhance performance and scalability of analytics data stores (Pinot, Snowflake, Accumulo, DynamoDB etc).
- Maintain and improve data ingestion, processing, and transformation workflows.
- Manage and optimize Airflow jobs, scheduled workflows, and reporting pipelines.
- Support and enhance data APIs for internal analytics consumption.
- Ensure data quality, consistency, and low-latency data availability across systems.
- Work on new initiatives within the data platform, including building and integrating new data pipelines, features, and use cases.
- Design and develop dashboards and reporting solutions to support business and product teams.
- Translate business requirements into scalable data models, metrics, and visualizations.
- Identify and implement improvements in system performance, cost optimization, and scalability.
- Collaborate with product, analytics, and business teams to support evolving data and reporting needs.
- Implement monitoring, alerting, and observability for proactive issue detection.
- Drive continuous improvements and architectural enhancements as the platform evolves.
Skills
Data Engineering, Python, Java, AWS, Snowflake DB, DynamoDB, Apache Airflow