Senior Data Engineer
First seen by Alion on Sep 3, 2026.
Requirements :
- Ensuring and validating data quality developing and maintaining end to end data pipelines and insight products.
- We are looking for someone with strong data lake fundamentals, AWS, spark, python, airflow etc. hands-on experience in all layers of data Integration and analytics.
RESPONSIBILITIES :
- Sr Data Engineer will understand the business need and design the data pipelines, translate
data into business insights, data cleansing and ETL.
- Experience in Databricks, GitHub Actions.
- Understand CI/CD, Aerospike
- Gather requirements from vested teams to build features.
- Self-motivated individual will use their love of user interfaces to balance design and function, and thrive in a fast-paced environment, knowledge in Angular / Play Framework is a plus.
- Understand the priorities and ensures the deliverables stick to the timeline and complete projects on time
- Be a team player who works effortlessly with people
Requirements :
- 3 to 7 years of development experience at an Enterprise level in the following tools and languages :
o Spark Scala
o python
o Mysql
o Apache Parquet / any columnar formats
- Desired Pluses
o Java
o Play framework / Angular
o Tableau
o Advertising Tech Industry experience
o AWS Services, Hadoop architecture and EMR management
o Linux
- Strong experience with digital media.
- Strong experience with relational databases like MySQL. NoSQL databases experience is a plus.
- Strong background with data modeling, data access, and data storage techniques
- Experience with design, development, and implementation of highly scalable, high-volume software systems and components, source of truth systems for different business areas.
- Bachelor's degree in Computer Science or related field or equivalent combination of industry related professional experience and education
Skills
Big Data, SQL, Machine Learning, Python, Hadoop, RDBMS, Cloud Computing, Data Engineering, Azure Databricks, Spark, PySpark