IBM - Databricks Generative AI Engineer (Mosaic AI)

We are looking for an experienced Databricks Generative AI Engineer with expertise in building enterprise-grade AI applications using Databricks Mosaic AI. The ideal candidate should have hands-on experience in developing Retrieval-Augmented Generation (RAG) solutions, AI agents, LLM-based applications, and prompt engineering using Python. Experience with LangChain, Hugging Face, and modern AI development frameworks is essential.

Responsibilities:

• Design, develop, and deploy generative AI applications using Databricks Mosaic AI.
• Build retrieval agents and single-agent applications on Databricks.
• Develop Retrieval-Augmented Generation (RAG) solutions using Large Language Models (LLMs).
• Implement prompt engineering, prompt evaluation, and LLM orchestration techniques.
• Integrate AI applications with APIs for data preparation and model chaining.
• Monitor, evaluate, and optimise generative AI applications for performance and governance.
• Collaborate with cross-functional teams to build scalable, production-ready AI solutions.
• Follow best practices for AI governance, monitoring, and enterprise deployment.

Requirements:

• 8-12 years of experience with 4+ years of relevant experience.
• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Information Technology, or a related field.
• Strong understanding of generative AI concepts and enterprise AI application development.
• Excellent analytical, problem-solving, and communication skills.
• Experience working in Agile development environments is preferred.
• Key Skills: Databricks Mosaic AI, Retrieval-Augmented Generation (RAG), AI Agent Development, Python, Large Language Models (LLMs), Prompt Engineering, LangChain / Hugging Face Transformers, REST APIs, AI Governance, Generative AI Deployment Tools and Technologies, and LLM Frameworks.

Mandatory Skills:

• Minimum 4+ years of relevant experience in generative AI, Databricks, or AI/ML application development.
• Hands-on experience with Databricks Mosaic AI.
• Strong experience in Retrieval-Augmented Generation (RAG) and AI agent development.
• Strong programming expertise in Python.
• Experience working with large language models (LLMs) and prompt engineering.
• Hands-on experience with LangChain and/or Hugging Face Transformers.
• Experience integrating AI applications using APIs and model orchestration frameworks.

Preferred Skills:

• Experience building enterprise-scale Generative AI applications.
• Knowledge of AI governance, monitoring, and evaluation.
• Experience with model chaining and LLM orchestration.
• Strong analytical, problem-solving, and communication skills.

Skills

databricks, mosaic, python, rag, retrieval-augmented generation