Senior MLOps Engineer

Design, build, and productionize AI solutions, especially LLM and generative AI workloads, on top of our Enterprise data Platform (Databricks, Azure, OpenAI, and AWS). This role has an emphasis on the operationalization of AI solutions, ensuring AI products are reliable, scalable, secure, and cost-effective in production. You will partner with data engineering, data science, and product teams to turn ideas into robust, continuously running services.

Responsibilities:

• Design and develop end-to-end AI solutions (from data preparation and feature/embedding engineering through to serving) on the EDP.
• Productionize AI and LLM applications: harden prototypes into resilient, observable services with clear SLAs, SLOs, and runbooks.
• Implement, optimize, and operate data / feature / embedding pipelines that support AI products, working closely with data engineers and data scientists.
• Build and maintain APIs, batch jobs, and workflows that expose AI capabilities safely to internal users and customer-facing applications.
• Establish and own observability for AI systems (logging, metrics, tracing, data/quality monitoring, safety, and cost monitoring).
• Contribute to and improve MLOps/LLMOps practices: deployment pipelines, versioning, canary/blue-green rollouts, and rollback strategies.
• Ensure security, governance, and responsible AI practices are built into production solutions (access control, PII handling, evaluation, policy enforcement).
• Collaborate with product owners to refine requirements, shape delivery plans, and communicate risks and tradeoffs.
• Mentor and support less experienced engineers, contributing to standards, patterns, and best practices for AI engineering on the EDP.

Requirements:

• 4-7+ years in software, data, or ML engineering, with at least 2+ years focused on ML or LLM based solutions.
• 2+ years experience with Databricks.
• Strong SQL skills.
• Strong Python skills for data and AI (e. g., pandas, PySpark, LLM/AI frameworks, API development).
• Hands-on experience with modern data/AI platforms similar to our EDP (e. g., lakehouse, cloud-native data, and ML stacks).
• Proven experience building LLM applications (chat/completions, embeddings, RAG, function/tool calling) and integrating them into production systems.
• Solid understanding of data modeling, data quality, and performance considerations for AI workloads (latency, throughput, cost).
• Experience with MLOps / LLMOps tooling and practices (e. g., model registries, experiment tracking, evaluation frameworks, CI/CD).
• Strong grasp of software engineering fundamentals: Git, code review, testing strategies (unit/integration), and documentation.
• Experience working closely with data engineers, data scientists, and product teams to deliver production solutions.

Behavioral Competencies:

• Ability to produce high-quality results, work in a collaborative environment by embracing diverse perspectives and use a solution-based approach.
• Adapts communication clearly and concisely based on team dynamics and expresses thoughts and ideas effectively.
• Ability to engage effectively with peers and stakeholders to build trust and reliable working relationships.
• Ability to understand business processes, implement innovative solutions, and guide juniors on continuous improvement by constantly updating oneself on current technology and trends.
• Inquisitive to understand customer and business expectations while creating value added on technical solutions.

Preferred Qualification:

• Experience with OpenAI, Azure, and/or AWS within an enterprise data platform context.
• Knowledge of prompt engineering techniques and evaluation methods to improve reliability and reduce hallucinations.
• Background in statistics, NLP, information retrieval, or related fields.

Skills

databricks, llmops, mlops, python, sql