Confirmed on the employer's own hiring board on Sep 25, 2026. First seen by Alion on Sep 7, 2026.
We are seeking a Databricks Platform Engineer to manage and optimize enterprise-grade Databricks environments on AWS. This role is pivotal in ensuring the stability, security, and performance of our data platforms, enabling engineering teams to deliver high-impact AI and data solutions efficiently.
Our client is a leading global provider of data-driven digital solutions and analytics, serving a diverse portfolio of international clients. With a strong focus on cutting-edge engineering and artificial intelligence, they empower organizations to drive digital transformation at scale through innovative technology strategies.
Responsibilities
- Administer and manage Databricks workspaces across development, testing, and production environments.
- Configure and maintain cluster policies, instance pools, and Databricks Runtime upgrades to ensure optimal performance.
- Implement robust security frameworks using AWS IAM, Unity Catalog, RBAC, and service principals.
- Develop and maintain CI/CD pipelines and Infrastructure as Code using Terraform to automate platform deployments.
- Monitor platform health and troubleshoot production issues to ensure high availability.
- Drive cloud cost optimization initiatives through effective cluster sizing and workload management.
- Collaborate with cross-functional teams including Data Engineering, DevOps, and Security to maintain a scalable platform architecture.
Requirements
- 6-8 years of professional experience in platform engineering or related fields.
- 3-5+ years of hands-on experience with Databricks platform administration on AWS.
- Deep expertise in Unity Catalog implementation, governance, and AWS IAM security integration.
- Proficiency in Terraform, CI/CD methodologies, and Git version control.
- Strong understanding of Lakehouse architecture, Delta Lake, and Apache Spark.
- Experience with platform monitoring tools such as Datadog or Splunk.
- Bachelor's degree in Computer Science, Engineering, or a related technical field.
- Strong knowledge of FinOps principles and cloud cost management.

