{"id":3946828,"url":"https://alion.io/job/celebal-tech-databricks-genai-solutions-architect","title":"Databricks GenAI Solutions Architect","company":{"id":2810284,"name":"Celebal Tech","domain":"celebaltech.com","url":"https://alion.io/company/celebaltech","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Solutions","role_family":"Solutions","seniority":"staff","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"A/B Testing","optional":false},{"name":"AI Agents","optional":false},{"name":"Anthropic","optional":false},{"name":"Azure","optional":false},{"name":"Chain-of-Thought","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Docker","optional":false},{"name":"FAISS","optional":false},{"name":"Few-Shot Learning","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Hybrid Search","optional":false},{"name":"Kubernetes","optional":false},{"name":"LangChain","optional":false},{"name":"LangGraph","optional":false},{"name":"Llama","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"LLMOps","optional":false},{"name":"LoRA","optional":false},{"name":"Mistral","optional":false},{"name":"MLFlow","optional":false},{"name":"Multi-Agent Systems","optional":false},{"name":"OpenAI","optional":false},{"name":"PEFT","optional":false},{"name":"Pinecone","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"QLoRA","optional":false},{"name":"RAG","optional":false},{"name":"Semantic Kernel","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Vertex AI","optional":false},{"name":"Weaviate","optional":false},{"name":"Transformers","optional":true}],"status":"live","first_seen_at":"2026-11-08T21:35:00Z","employer_posted_date":null,"last_verified_at":"2026-11-08T21:35:00Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":1},"description":"Job description:\n\nWe are seeking a highly skilled Databricks GenAI Solutions Architect to lead the design, development, and deployment of enterprise-grade Generative AI solutions on the Databricks Lakehouse Platform. This role combines deep expertise in Large Language Models (LLMs) with comprehensive knowledge of the Databricks ecosystem, including Mosaic AI, MLflow, Unity Catalog, and Delta Lake. You will be responsible for architecting scalable LLM-based applications, implementing RAG pipelines, establishing MLOps/LLMOps best practices, and mentoring the team on cutting-edge GenAI technologies within the Databricks environment.\n\nResponsibilities:\nArchitect end-to-end GenAI solutions including RAG (Retrieval-Augmented Generation), AI agents, and fine-tuned models on Databricks.\nEvaluate and select appropriate LLMs (OpenAI, Anthropic Claude, Azure OpenAI, DBRX, Llama, Mistral) based on use case requirements and cost optimization.\nDesign and implement scalable vector search solutions using Databricks Vector Search and Mosaic AI.\nEstablish prompt engineering best practices, optimization techniques, and prompt management strategies.\nImplement compound AI systems and multi-agent architectures using Databricks Agent Framework.\nDesign and implement GenAI solutions leveraging Databricks Mosaic AI capabilities including Model Serving, Foundation Model APIs, Vector Search, AI Gateway, and Feature & Function Serving.\nArchitect data pipelines using Delta Lake and Spark for preprocessing, chunking, and embedding generation at scale.\nImplement robust data governance using Unity Catalog for model assets, features, and vector indices.\nDesign and manage MLflow experiments for LLM evaluation, tracking, and model registry.\nDesign LLMOps pipelines for evaluation, monitoring, A/B testing, and continuous improvement.\nImplement guardrails, safety measures, content filtering, and responsible AI practices.\nBuild observability solutions for LLM applications including latency monitoring, cost tracking, and quality metrics.\nEstablish CI/CD pipelines for GenAI model deployment using Databricks Workflows and Asset Bundles.\nLead technical decisions and conduct architecture reviews for GenAI initiatives.\nCollaborate with business stakeholders to translate requirements into scalable technical solutions.\nMentor engineers and data scientists on GenAI development standards and Databricks best practices.\nCreate technical documentation, reference architectures, and reusable solution accelerators.\n\nQualifications:\n5+ years of relevant experience in ML/AI with 3+ years focused on GenAI/LLM applications.\nDeep hands-on experience with LLM APIs (OpenAI, Anthropic Claude, Azure OpenAI, Google Vertex AI).\nStrong RAG implementation experience including document processing, chunking strategies, embedding models, and retrieval strategies (hybrid search, re-ranking, query transformation).\nExperience with vector databases (Pinecone, Weaviate, ChromaDB, FAISS, Azure AI Search, Databricks Vector Search).\nAdvanced prompt engineering skills including chain-of-thought, few-shot learning, and prompt optimization.\nProficiency with LLM orchestration frameworks (LangChain, LangGraph, Semantic Kernel).\nUnderstanding of fine-tuning techniques (LoRA, QLoRA, PEFT, full fine-tuning).\n3+ years hands-on experience with Databricks platform.\nStrong proficiency in PySpark and Spark SQL for large-scale data processing.\nExperience with Databricks Mosaic AI suite: Model Serving, Vector Search, Foundation Model APIs, AI Gateway.\nExpertise in MLflow for experiment tracking, model registry, and deployment.\nWorking knowledge of Unity Catalog for data and AI governance.\nExperience with Delta Lake architecture and optimization.\nFamiliarity with Databricks Workflows for orchestration.\nStrong programming skills in Python; familiarity with SQL.\nProduction deployment experience for LLM applications at scale.\nExcellent system design and distributed architecture skills.\nUnderstanding of API design, microservices, and cloud-native patterns.\nExperience with containerization (Docker, Kubernetes) for model serving.\nSkills\nDatabricks, Delta Lake, LLM, LangChain, MLflow, Mosaic AI, OpenAI, PySpark, RAG, Unity Catalog","description_format":"text","description_chars":4207,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","AI Consulting & Integration","Data Engineering & Migration Services"],"lifecycle":[{"event":"open","at":"2026-11-08T21:35:00Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":32,"reasons":["seen:1","velocity","win:early"],"computed_at":"2026-11-10T06:52:35Z"},"pay":null,"html_url":"https://alion.io/job/celebal-tech-databricks-genai-solutions-architect","json_url":"https://alion.io/job/celebal-tech-databricks-genai-solutions-architect.json","meta":{"generated_at":"2026-11-10T14:46:08Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"assistant_verified","counted_by":"address","units_charged":1,"used_today":4505,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-11T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2810284},"rest":"https://alion.io/mcp/rest/get_company?id=2810284"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcelebal-tech-databricks-genai-solutions-architect"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcelebal-tech-databricks-genai-solutions-architect"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcelebal-tech-databricks-genai-solutions-architect"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/celebal-tech-databricks-genai-solutions-architect\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcelebal-tech-databricks-genai-solutions-architect"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3946828}},{"tool":"search_jobs","arguments":{"company":"celebaltech.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3946828},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}