AI Systems Architect
Who We Are
At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people-Kyndryls-that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.
The Role
The AI Systems Architect is responsible for designing and evolving an enterprise-scale Agentic AI platform that enables engineering teams to build, deploy, and operate production-ready AI agents in a secure, governed, and reusable manner.
Key Responsibilities
Architect a reusable enterprise Agentic AI platform, including agent runtime, orchestration, context management, memory, evaluation, guardrails, and observability.
Develop and maintain an Agent Harness that provides standardized runtime capabilities and Model Context Protocol (MCP) integration.
Define "Golden Paths" that standardize AI agent development and deployment across engineering teams.
Build a model-agnostic AI runtime supporting multiple LLM providers, AI gateways, and enterprise integrations.
Collaborate with infrastructure teams on Kubernetes, GPU platforms, networking, and cloud-native AI infrastructure.
Establish enterprise AI governance covering policy enforcement, security, prompt/model lifecycle management, human-in-the-loop workflows, evaluation, and cost optimization.
Integrate AI agents with enterprise platforms such as CI/CD, ITSM, observability, cloud services, and business applications.
Define engineering standards and mentor teams to drive enterprise adoption of Agentic AI best practices.
Overall Focus
This is a senior platform architecture role rather than an application development role. The emphasis is on building the foundational enterprise AI platform-including agent runtime, governance, orchestration, and developer experience-that enables multiple engineering teams to deliver scalable, secure, model-agnostic AI agents across the organization.
Your Future at Kyndryl
As an IT/Cloud Consultant at Kyndryl you will join the Kyndryl Consultant Profession, working with other Kyndryl Consultants, Architects, Project Managers, and cross-functional Technical Subject Matter Experts - presenting unlimited opportunities with unmatched support through our investment in your learning, training, and career growth.
Who You Are
Required Experience
5+ years designing cloud-native platforms or enterprise software architectures.
Strong hands-on experience with Agentic AI architectures, orchestration, tool integration, memory, evaluation, and guardrails.
Experience with agent frameworks such as LangGraph, CrewAI, Semantic Kernel, or AutoGen.
Strong Python software engineering skills.
Expertise in Kubernetes, containers, Infrastructure as Code, and cloud-native architectures.
Understanding of AI infrastructure, including GPUs, model serving, AI gateways, and observability.
Experience designing developer platforms and reusable services rather than standalone applications.
Professional proficiency in both English and Spanish.
Preferred Skills
Experience with LiteLLM, OpenRouter, NVIDIA NIM, vLLM, or Triton Inference Server.
Knowledge of LLMOps, AI governance, and model lifecycle management.
Experience with RAG, vector databases, and semantic search.
Familiarity with observability tools such as Prometheus, Grafana, OpenTelemetry, or Langfuse.
Experience with AI coding assistants (Claude Code, GitHub Copilot, Codex).
Experience in regulated industries such as Financial Services, Telecommunications, or Public Sector.
Being You
The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging - being a valued, respected, trusted member of the team - is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.
What You Can Expect
Your career with us isn’t just a job-it’s an adventure with purpose. We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health-because we know that when you feel your best, you do your best.
From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute-you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities-from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here-and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.
Get Referred!
If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.