AI Engineer/Architect - LLM/RAG
First seen by Alion on Jul 29, 2026.
AI Engineer / AI Architect (Senior) Hyderabad
Shift : 5 : 30 PM - 2 : 30 AM IST
Experience : 8 to 20 Years
Location : Hyderabad (Work from Office-Hybrid)
Job Summary :
We are seeking an experienced AI Engineer / AI Architect to lead the design, development, and deployment of enterprise-grade AI solutions. The ideal candidate will have hands-on experience delivering AI applications into production environments and possess deep expertise in modern LLM ecosystems, agentic AI frameworks, and enterprise AI platforms. This role requires strong technical leadership, architecture design skills, and the ability to build scalable, secure, and production-ready AI solutions.
Key Responsibilities :
- Design, architect, and implement enterprise AI solutions using Large Language Models (LLMs) and Agentic AI frameworks.
- Build, deploy, and optimize AI applications for production environments with a focus on scalability, reliability, and security.
- Design and configure enterprise AI tools, including AI agents, copilots, chatbots, and intelligent workflow automation solutions.
- Develop Retrieval-Augmented Generation (RAG) pipelines using vector databases, embeddings, and enterprise knowledge sources.
- Implement multi-agent architectures, memory management, and orchestration using modern agent frameworks.
- Integrate AI applications with enterprise systems through APIs, Model Context Protocol (MCP), function calling, and Agent-to-Agent (A2A) communication.
- Develop and optimize prompt engineering strategies, structured outputs, and function-calling workflows across multiple LLM providers.
- Fine-tune and evaluate Large Language Models (LLMs) and Small Language Models (SLMs) for domain-specific use cases.
- Design AI governance, monitoring, security, and responsible AI practices for enterprise deployments.
- Collaborate with business stakeholders, solution architects, and engineering teams to translate business requirements into AI solutions.
- Mentor development teams and establish AI engineering best practices.
Required Skills & Experience :
- 8+ years of overall software engineering experience with strong expertise in AI/ML.
- Proven experience delivering AI/Generative AI solutions into production environments.
- Strong proficiency in Python and C#.
- Hands-on experience with Azure AI Foundry and/or Databricks.
- Experience with one or more agentic AI frameworks :
1. LangChain
2. LangGraph
3. AutoGen
4. CrewAI
5. LlamaIndex
6. PydanticAI
- Strong understanding of :
1. Retrieval-Augmented Generation (RAG)
2. Knowledge Graphs
3. Memory Architectures
4. Vector Databases
5. Embedding Models
- Experience implementing :
1. Function Calling
2. Tool Calling
3. Multi-LLM orchestration
4. Multi-agent systems
- Experience working with multiple LLM providers (OpenAI, Azure OpenAI, Anthropic, Google Gemini, etc.).
- Knowledge of fine-tuning, evaluation, and optimization of LLMs/SLMs.
- Strong understanding of MCP (Model Context Protocol) and A2A (Agent-to-Agent) communication patterns.
- Experience with REST APIs, microservices, cloud-native architecture, and CI/CD pipelines.
- Excellent problem-solving, communication, and stakeholder management skills.
Preferred Qualifications :
- Experience with Azure cloud services and enterprise AI architecture.
- Familiarity with MLOps/LLMOps practices.
- Experience with vector databases such as Pinecone, Milvus, Weaviate, or Azure AI Search.
- Knowledge of AI observability, monitoring, governance, and security.
- Experience leading AI transformation initiatives and mentoring technical teams.
- Exposure to domain-driven AI solutions across enterprise environments.
Nice to Have :
- Azure AI Engineer or Azure Solutions Architect certifications.
- Experience with Kubernetes, Docker, and cloud-native deployments.
- Experience in Responsible AI, model evaluation frameworks, and AI governance.
Skills
Artificial Intelligence, AI Architecture, LLM, Agentic AI, RAG, Python, Machine Learning, LangChain, LangGraph, MLOps