Senior/Lead Data Engineer - Databricks
First seen by Alion on Sep 3, 2026.
Role Overview:
As a Senior / Lead Data Engineer, you will serve as a technical anchor for our data platform initiatives, architecting scalable solutions that handle high-volume data ingestion and transformation. You will work closely with cross-functional teams, including data scientists, product managers, and infrastructure engineers, to build robust pipelines that power business-critical analytics. Your contribution will directly influence the reliability and performance of our data products, ensuring that stakeholders have seamless access to high-quality, governed data to support their strategic objectives in a fully remote environment.
Required Qualifications:
- Strong hands-on Data Engineering experience.
- Expert-level experience with Databricks.
- Strong hands-on experience with Databricks Unity Catalog.
- Strong experience designing Medallion Architecture (Bronze/Silver/Gold) data pipelines.
- Advanced Python/PySpark and SQL skills.
- Strong experience with AWS, particularly S3 and AWS Glue.
- Hands-on experience with Databricks Asset Bundles (DABs).
- Strong Git experience with GitHub Enterprise and GitHub Actions.
- Experience implementing CI/CD for data engineering and Databricks workloads.
- Strong understanding of data engineering best practices, data modeling, and pipeline optimization.
- Experience working in Agile/Scrum development environments.
Ideal Candidate:
The ideal candidate is a senior-level, hands-on Databricks Data Engineer. They should be comfortable writing code, building pipelines, troubleshooting production issues, implementing CI/CD, and working directly in Databricks and AWS on a daily basis.
Skills
Data Engineering, Databricks, AWS, Python, SQL, Azure Databricks, ETL, AWS Glue, Data Catalogue