Senior Databricks AI Engineer

About the role
Our client based in Waterfall City is looking to recruit A senior AI engineer required to build a GenAI reporting solution for a leading private hospital group, using LLMs to convert patient and clinical data in Databricks into clinician-ready reports.

• Translate clinical reporting needs into the datapoints each report requires, and build them as governed tables in Databricks
• Design the prompts, templates and orchestration that generate structured, narrative reports from those datapoints
• Build retrieval over clinical guidelines and policy documents where reports depend on them
• Put guardrails in place so every statement is grounded in source data and patient data stays protected
• Build evaluation with clinicians: test sets, automated scoring and regression checks
• Take the solution into production with monitoring, an audit trail and cost control
• Demo progress to clinical stakeholders every sprint and turn their feedback into improvements

What they're looking for

• Experience in ML or AI engineering, including at least one LLM solution delivered into production use
• Strong Databricks: Unity Catalog, Delta, Workflows, MLflow, Mosaic AI Model Serving and Vector Search
• Python, PySpark and SQL to production standard
• Prompt engineering and orchestration (LangChain, LangGraph, DSPy or equivalent), including structured output generation
• Retrieval-augmented generation design, tuning and evaluation
• LLM evaluation methods: golden datasets, groundedness scoring, LLM-as-judge, regression testing
• Guardrails, hallucination controls and handling of sensitive personal data