Generative AI Architect
First seen by Alion on Sep 30, 2026.
AI & GenAI Architect
Experience: 7+ Years
Location: Hyderabad
Employment Type: Full-time
Role Overview:
We are looking for an experienced AI & GenAI Architect to design and deliver intelligent, scalable and enterprise-ready AI solutions. The ideal candidate will have strong expertise in Azure OpenAI, Microsoft Copilot Studio, Generative AI, Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG). The role involves translating business requirements into AI-driven architectures, designing GenAI solutions and working closely with engineering, data and business teams to build secure and scalable AI applications.
Key Responsibilities:
- Design and architect enterprise-grade AI and Generative AI solutions aligned with business and technology requirements.
- Develop solution architectures using Azure OpenAI and other Azure AI services.
- Design and implement LLM-powered applications for enterprise use cases.
- Architect RAG-based solutions, including document ingestion, embeddings, retrieval, context management and response generation.
- Design and develop intelligent conversational solutions using Microsoft Copilot Studio.
- Evaluate and recommend appropriate LLMs, AI services, frameworks and architectures based on business requirements.
- Define technical architecture, integration patterns, APIs and data flows for AI solutions.
- Work with development and data teams to productionise GenAI applications.
- Establish best practices around prompt engineering, LLM evaluation, model selection and AI application performance.
- Design solutions with appropriate security, governance, privacy and responsible AI controls.
- Optimise AI solutions for scalability, performance, reliability and cost.
- Collaborate with stakeholders to identify high-value AI/GenAI use cases and translate them into implementable solutions.
- Provide technical leadership and guidance to engineering teams throughout the solution lifecycle.
- Stay current with emerging developments in Generative AI, LLMs, RAG, AI agents and Microsoft AI technologies.
Required Skills:
- 7+ years of experience in software architecture, AI/ML engineering or related technology roles.
- Strong hands-on experience with Generative AI and LLM-based solutions.
- Expertise in Azure OpenAI and Azure AI services.
- Hands-on experience with Microsoft Copilot Studio.
- Strong understanding of RAG architecture and implementation.
- Experience with LLMs, prompt engineering and LLM application development.
- Strong understanding of AI solution architecture, APIs and enterprise integration.
- Experience designing scalable and production-ready AI solutions.
- Good understanding of AI security, governance and responsible AI principles.
Good to Have:
- Experience with AI Agents / Agentic AI.
- Knowledge of vector databases and semantic search.
- Experience with Azure AI Search.
- Experience with LangChain, LlamaIndex or similar GenAI frameworks.
- Knowledge of Python and cloud-native application development.
- Experience with AI/LLM evaluation and observability.
- Exposure to enterprise chatbot and conversational AI implementations.
Key Competencies:
- AI & Generative AI Architecture
- LLM & RAG Solution Design
- Azure OpenAI
- Microsoft Copilot Studio
- Enterprise AI Integration
- AI Governance & Security
- Technical Leadership
- Stakeholder Management
Skills
Generative AI, RAG, LLM, Solution Architect, Azure, OpenAI, Artificial Intelligence