Databricks Platform Administrator

Job Family:

Database Administration

Travel Required:

None

Clearance Required:

None

What You Will Do:

We're seeking an experienced Databricks Platform Administrator to manage and improve our enterprise data platform. You'll help keep the environment secure, reliable, scalable, and cost-effective, working closely with data engineering, data science, development, security, and cloud infrastructure teams.

The ideal candidate has at least four years of experience in cloud platforms, data engineering infrastructure, platform administration, or a related field, including hands-on experience administering Databricks in an enterprise environment. This is a non-people manager role. All hands-on.

What You Will Need:

• Administer Databricks workspaces, clusters, jobs, notebooks, instance pools, SQL warehouses, and related services.
• Manage users, groups, roles, service principals, permissions, credentials, and access controls.
• Apply security and governance standards using Unity Catalog, role-based access controls, and data-governance policies.
• Monitor platform availability, system health, job execution, cluster performance, and resource usage.
• Troubleshoot failed jobs, cluster and connectivity issues, performance bottlenecks, and access incidents.
• Configure clusters, pools, autoscaling, and compute policies to improve performance and manage costs.
• Support Databricks integrations with cloud storage, databases, business intelligence tools, APIs, and enterprise applications.
• Maintain configurations across development, testing, staging, and production environments.
• Support automated deployment and infrastructure management through CI/CD and Infrastructure as Code.
• Build and maintain monitoring dashboards, alerts, audit reports, and operational documentation.
• Coordinate platform upgrades, configuration changes, testing, and releases.
• Partner with cybersecurity and governance teams on audits, compliance, logging, and data protection.
• Assist with establishing platform standards, administrative procedures, naming conventions, and operational practices.
• Provide technical guidance to data engineers, analysts, data scientists, and application teams.
• Assess platform usage and recommend improvements to scalability, reliability, performance, and cost.

Required Qualifications:

• At least four years of experience in cloud infrastructure, data platform administration, database administration, DevOps, data engineering, or a related technical field.
• Hands-on experience administering Databricks in an enterprise environment.
• Experience with Azure Databricks is a must and Databricks on AWS is a nice to have.
• Strong knowledge of Databricks workspaces, clusters, jobs, notebooks, SQL warehouses, instance pools, and compute policies.
• Experience with Unity Catalog, identity management, service principals, secrets, access controls, and data governance.
• Experience monitoring and troubleshooting Databricks jobs, clusters, integrations, and platform performance.
• Experience with cloud storage, networking, security, and identity-management services.
• Proficiency in SQL and at least one scripting language, such as Python or PowerShell.
• Experience with Git, CI/CD pipelines, and automated deployment.
• Experience with Infrastructure as Code tools such as Terraform.
• Experience integrating Databricks with Power BI, Tableau, Snowflake, SQL Server, or other enterprise data platforms.
• Strong troubleshooting, documentation, communication, and stakeholder-management skills.
• Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.

What Would Be Nice To Have:

• Databricks certification, such as Databricks Certified Data Engineer or Databricks Certified Associate Developer for Apache Spark.
• Certification in Microsoft Azure.
• Experience with Delta Lake, Delta Live Tables, MLflow, Lakehouse architecture, or Databricks SQL.
• Experience with Azure DevOps, GitHub Actions, or similar CI/CD platforms.
• Experience supporting regulated, federal, healthcare, financial services, or other highly controlled environments.
• Familiarity with data cataloging, lineage, audit logging, disaster recovery, and business-continuity planning.

Skills

Azure, Databricks, Terraform