Lead Developer - Databricks

About the Role

We are seeking an experienced Team Lead - Databricks Applications to lead a team of developers building production-grade applications on the Databricks platform. You will drive technical decisions, mentor engineers, and ensure delivery of enterprise-ready solutions.

What you will do

• Architect and design production applications on the Databricks platform
• Drive technical decisions on application patterns, security, and performance
• Build and optimise data pipelines using Databricks Workflows and Delta Lake
• Establish coding standards, best practices, and code review processes
• Configure Unity Catalogue for data governance and access management
• Oversee cloud security, service principals, and permissions strategy
• Own application monitoring, performance tuning, and cost optimisation
• Lead and mentor a team of 1-2 Databricks developers
• Collaborate with stakeholders to translate requirements into technical solutions
• Participate in Agile ceremonies and contribute to sprint planning and delivery

You'll need to have:

• 8+ years of hands-on experience building production applications on Databricks or comparable cloud data platforms
• 2+ years of experience in a technical leadership role
• Expert-level Python and SQL development skills
• Strong experience with REST API and web application development
• Deep expertise in Databricks Apps, Workflows, Unity Catalog, and Delta Lake
• Experience with compute management and performance optimization at scale
• Strong understanding of cloud security, identity management, and service principals
• Track record of turning prototypes into production-ready enterprise applications
• Excellent communication and stakeholder management skills
• Bachelor's or master's degree in computer science or related field

Preferred Qualifications

• Experience with CI/CD pipelines and Git workflows
• Familiarity with infrastructure as code (Terraform, ARM templates)
• Automated testing strategies (unit, integration, end-to-end)
• Frontend development experience with React
• Databricks certifications (Data Engineer Associate, Platform Administrator)