Data Engineer
First seen by Alion on Sep 8, 2026.
Job Description :
We are seeking a Data Engineer with strong expertise in Python, SQL, AWS Redshift, and Databricks to ensure the accuracy, completeness, and reliability of enterprise data assets. The ideal candidate will design and implement data quality frameworks, develop automated validation processes, and collaborate with data engineering and business teams to maintain high data standards across the organization.
Key Responsibilities :
- Develop and maintain automated data quality checks and validation frameworks using Python and SQL.
- Design, execute, and monitor data quality rules for data pipelines and warehouses.
- Work with AWS Redshift and Databricks to analyze, profile, and remediate data issues.
- Investigate root causes of data anomalies and partner with engineering teams to implement corrective actions.
- Create dashboards and reports to track data quality metrics and SLAs.
- Contribute to best practices for data governance, metadata management, and testing.
Required Qualifications:
- Bachelor's degree in Computer Science, Information Systems, or a related field.
- 4+ years of experience in data quality, data engineering, or a related role.
- Strong proficiency in Python and advanced SQL.
- Hands-on experience with AWS Redshift and Databricks.
- Familiarity with ETL/ELT processes, data warehousing concepts, and cloud-based data platforms.
- Excellent analytical, problem-solving, and communication skills.
Preferred Qualifications :
- Experience with data quality tools and frameworks.
- Knowledge of CI/CD practices and version control systems such as Git.
- AWS or Databricks certifications are a plus.
This role offers the opportunity to build robust data quality solutions that directly support data-driven decision-making across the enterprise.
Skills
Data Engineering, Python, SQL, AWS, Databricks, Data Quality, ETL, Redshift