Databricks MLOps Engineer

The Databricks MLOps Engineer will take machine learning models from notebooks to tested, monitored production systems. You will build feature pipelines, automate training and retraining, manage model deployment and serving, and implement CI/CD for ML. The role also supports LLM and GenAI workloads with clear cost controls, working closely with data scientists and product teams.

Our client is a leading global technology and analytics firm operating in the computer software industry. They serve enterprises worldwide with data-driven products and services built on modern cloud and AI platforms. The organization is known for its scale, its focus on innovation, and a collaborative culture that values engineering excellence.

Responsibilities

• Build feature pipelines on Delta tables and manage features in Unity Catalog feature tables.
• Automate training and retraining with parameterized, scheduled Databricks Workflows.
• Track experiments and register, version and promote models using MLflow and the Unity Catalog model registry, including champion and challenger aliases.
• Deploy models to Databricks Model Serving for real-time inference and batch jobs, running A/B and shadow deployments.
• Monitor models with Lakehouse Monitoring and inference tables, covering drift, latency, error rates and alert thresholds.
• Implement CI/CD for ML with Databricks Asset Bundles and GitHub Actions or Azure DevOps, including tests, staged promotion and rollback.
• Support LLM and GenAI serving endpoints, AI Gateway rate limits, model-tier selection and token usage tracking.
• Partner with data scientists to convert notebooks into tested, packaged production code.

Requirements

• 6+ years of experience in ML engineering, MLOps or data engineering with ML delivery.
• 3+ years of hands-on experience building ML pipelines on Databricks, including Workflows, MLflow, Model Serving or batch inference.
• Strong production Python skills with PySpark and Delta Lake.
• Experience with multiple models deployed to production with monitoring, retraining and rollback in place.
• Bachelor's or Master's degree in Computer Science, Data Science, Engineering or a related field.
• Ability to explain model behaviour, drift and risk to business stakeholders in plain language.
• Experience in Agile/Scrum environments with clear documentation of pipelines and runbooks.

Skills

Databricks Lakehouse Platform, MLflow, Python, PySpark, Delta Lake, Databricks Workflows, Model Serving, Lakehouse Monitoring, Databricks Asset Bundles, CI/CD with GitHub Actions or Azure DevOps, Feature Store, Unity Catalog feature tables, Docker, REST APIs, Kubernetes, Azure Machine Learning, Amazon SageMaker, Vector Search, Databricks Certified Machine Learning Associate or Professional