Agentic AI Architect

Job Description

• Skill Set :

  Agentic AI Development

• Total Experience :

  12.00 to 15.00 Years

• No of Openings :

  1

• Job Post Date :

  13/10/2026

• Job Expiry Date :

  30/12/2026

• Domain :

  IT

• Location :

  ATLANTA [United States]

• Job Reference No :

  4112639

Job Summary

Agentic AI Architect

Location Onsite - Atlanta, Georgia

Job Summary

We are seeking an experienced Agentic AI Architect to design, architect, and lead the implementation of enterprise-scale AI solutions powered by Large Language Models (LLMs), Agentic AI frameworks, Retrieval-Augmented Generation (RAG), knowledge graphs, and AI orchestration platforms. The ideal candidate will define end-to-end architectures for autonomous and semi-autonomous AI systems, establish security and governance guardrails, and drive adoption of next-generation AI capabilities across business functions. This role requires strong expertise in multi-agent orchestration, AI platform engineering, cloud-native architecture, enterprise integration, and hands-on technical leadership.

Key Responsibilities

• AI and Agentic Architecture
• Define enterprise Agentic AI strategy, target-state architecture, reusable patterns, and reference architectures.
• Design multi-agent ecosystems using frameworks such as LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, and
• Microsoft Copilot Studio.
• Architect supervisor, planner, executor, evaluator, and human-in-the-loop agent patterns.
• Define approaches for reasoning, planning, task decomposition, memory management, tool use, context handling,
• and agent collaboration.
• Balance autonomy with deterministic controls, approval checkpoints, fallback mechanisms, and operational safety.
• GenAI and RAG Solutions
• Design scalable RAG architectures using enterprise knowledge repositories, semantic search, embeddings, vector
• databases, and knowledge graphs.
• Create enterprise copilots, AI assistants, and digital workforce solutions grounded in approved organizational data.
• Define document ingestion, chunking, metadata, retrieval, reranking, citation, and response-generation patterns.
• Establish evaluation methods for groundedness, hallucination, relevance, safety, quality, latency, and cost.
• Enterprise Integration
• Integrate AI agents with enterprise platforms such as SAP, ServiceNow, Salesforce, Microsoft 365, databases,
• APIs, messaging platforms, and workflow engines.
• Design secure API, event-driven, microservices, and tool-calling patterns for agent interactions.
• Define identity, authorization, secrets management, data-access controls, and audit requirements for agent actions.
• Create reusable integration contracts and Model Context Protocol (MCP) patterns where appropriate.
• Governance and Responsible AI
• Implement AI governance, safety guardrails, risk controls, and compliance checkpoints across the solution lifecycle.

JOB DESCRIPTION | AGENTIC AI ARCHITECT

Define human-in-the-loop and human-on-the-loop workflows for sensitive, high-impact, or irreversible actions.Establish model and agent monitoring, traceability, explainability, auditability, data privacy, bias assessment, and content-safety controls. Partner with security, legal, compliance, data governance, and risk teams to operationalize responsible AI standards.

Cloud and Platform Engineering

• Architect solutions using Azure AI Foundry, Azure OpenAI, Microsoft Fabric, AWS Bedrock, Google Vertex AI, IBM
• watsonx, or equivalent enterprise AI platforms.
• Lead MLOps, LLMOps, and AgentOps architecture, including CI/CD, testing, release controls, observability,
• rollback, and incident response.
• Define scalable deployment patterns using containers, Kubernetes, serverless services, API gateways, and platform
• engineering practices.
• Optimize model selection, token consumption, caching, routing, latency, reliability, and infrastructure cost.
• Technical Leadership and Stakeholder Engagement
• Lead architecture reviews, design assurance, technology selection, prototyping, and production-readiness
• assessments.
• Translate business challenges into secure, scalable, and measurable Agentic AI solution designs.
• Mentor AI engineers, data scientists, platform engineers, and solution architects.
• Develop reusable frameworks, accelerators, templates, architecture decision records, and implementation
• standards.
• Communicate architecture, risks, trade-offs, roadmap, and business value to engineering teams and senior
• stakeholders.

Required Core Technical Skills

• Strong hands-on experience with Python, FastAPI, REST APIs, asynchronous processing, and distributed systems.
• Deep understanding of LLMs, prompt engineering, structured outputs, function/tool calling, embeddings, and model
• routing.
• Experience with Agentic AI frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or equivalent
• technologies.
• Expertise in RAG, vector databases, enterprise search, semantic retrieval, reranking, and knowledge graph
• integration.
• Experience with Azure, AWS, or GCP AI services and production-grade cloud architecture.
• Working knowledge of Docker, Kubernetes, CI/CD, DevSecOps, observability, and secrets management.
• Understanding of MCP, agent interoperability, context management, and secure tool integration.
• AI Architecture Competencies
• Multi-agent orchestration and agent design patterns
• Reasoning, planning, memory, reflection, and evaluation strategies
• LLM and agent evaluation frameworks
• Responsible AI, security, privacy, and governance
• Fine-tuning and model adaptation approaches
• MLOps, LLMOps, and AgentOps operating models
• Enterprise integration and API architecture

Qualifications

• Bachelor's or master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related
• technical discipline.
• 12+ years of overall IT experience, including substantial experience in enterprise architecture or solution
• architecture.
• 5+ years of experience in AI/ML, Generative AI, or advanced analytics architecture roles.
• Demonstrated experience delivering enterprise-scale, production-grade AI platforms or applications.
• Proven ability to lead cross-functional technical teams and engage business, security, risk, and executive
• stakeholders.

Preferred Certifications

• Microsoft Certified: Azure AI Engineer Associate
• Microsoft Applied Skills credentials for Azure OpenAI or Azure AI solutions
• AWS Certified Machine Learning - Specialty or relevant AWS AI certification
• Google Cloud Professional Machine Learning Engineer
• Databricks Generative AI Engineer or equivalent
• TOGAF or another recognized enterprise architecture certification
• Success Measures
• Business value delivered through AI-enabled automation and decision support.
• Agent task-completion quality, groundedness, safety, reliability, and user adoption.
• Reusable architecture patterns and reduced time to production for AI use cases.
• Effective control of LLM consumption, platform cost, latency, and operational risk.
• Compliance with security, privacy, governance, audit, and responsible AI requirements.
• Quality of technical leadership, architecture governance, and engineering enablement.

The pay range for this role is $130k - $150k per annum including any bonuses or variable pay. Tech Mahindra also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). Ask our recruiters for more details on our Benefits package. The exact offer terms will depend on the skill level, educational qualifications, experience, and location of the candidate.

Thanks & Regards

Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at [email protected].”