Site Reliability Engineer - AI Platform

Who We Are

At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people-Kyndryls-that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.

The Role

We are looking for a Site Reliability Engineer to ensure the reliability, performance, and observability of our enterprise AI platform. This role monitors and supports production systems running on Kubernetes and cloud services (currently Azure), and extends traditional observability to cover how AI solutions behave and how models are used. Working closely with DevOps engineers, the SRE will help automate and harden the CI/CD pipelines that developers rely on to deliver applications. The ideal candidate is an organized, experienced cloud operations professional with strong reliability engineering fundamentals who is committed to defining service level objectives, reducing operational toil, and driving continuous improvement through data and automation. Prior experience with AI is not required; we value core SRE skills and the ability to learn new technologies quickly.

Key Responsibilities

• Monitor platform health: Monitor and support running platform systems, defining and tracking SLIs, SLOs, and error budgets for availability, latency, and throughput across the platform.

• Build observability for AI workloads: Design and maintain dashboards, alerts, and telemetry that cover AI solution behavior and model usage, such as token consumption, request latency, throttling and quota limits, error rates, cost attribution by application and team, and output quality or drift signals.

• Operate Kubernetes and cloud services: Run and support Kubernetes clusters and the supporting cloud services in our Azure environment, including API management, managed model services, and container orchestration, covering capacity planning, autoscaling, upgrades, workload health, and resource optimization.

• Automate CI/CD with DevOps: Partner with DevOps engineers to automate, standardize, and improve CI/CD pipelines in GitHub Actions, embedding reliability checks, automated testing, progressive delivery, and rollback practices that enable developers to ship safely and quickly.

• Automate infrastructure: Use Terraform and other infrastructure-as-code tools to provision and manage cloud environments in a repeatable, secure, and compliant manner.

• Respond to and prevent incidents: Participate in on-call and incident response, lead blameless post-incident reviews, maintain runbooks, and drive corrective actions that reduce recurrence and manual toil.

• Plan capacity and resilience: Conduct capacity planning, load and failure testing, and disaster recovery readiness for platform components.

• Collaborate and document: Work with developers, data scientists, security, and enterprise architecture teams to align reliability practices with platform standards, and document operational guidance for platform consumers.

Who You Are

Required Qualifications:

• Bachelor's degree in Computer Science, Engineering, Info Systems, or related field.

• 5+ years of practical experience in site reliability engineering, DevOps, or cloud operations.

• Strong hands-on experience running production workloads on Kubernetes, including deployment and configuration management, networking, autoscaling, cluster upgrades, and troubleshooting.

• Experience operating production workloads in a major public cloud (Azure, AWS, or GCP). Azure experience is helpful but not required; strong cloud operations skills are expected to transfer.

• Proficiency with observability tooling such as Azure Monitor, Prometheus, Grafana, or Dynatrace, including OpenTelemetry-based tracing, metrics, and logging.

• Experience defining SLIs, SLOs, and error budgets, and building actionable alerting that reduces noise.

• Experience with automation across the delivery lifecycle, including CI/CD pipelines (preferably GitHub Actions), infrastructure as code (preferably Terraform), and scripting or programming (e.g., Python, Bash, PowerShell, or Go), and the ability to collaborate with DevOps engineers on pipeline design and reliability.

• Strong incident management, troubleshooting, and communication skills, with experience in on-call rotations and blameless post-incident reviews.

• Curiosity and willingness to learn how AI solutions and models behave in production. No prior AI or machine learning experience is required.

Preferred Qualifications:

• Experience with Azure services such as Azure Kubernetes Service, Azure API Management, or Azure AI Foundry.

• Experience monitoring AI/ML or generative AI workloads, including model quality, drift, safety, and cost metrics.

• Experience with Kubernetes ecosystem tooling such as Helm, KEDA, and service meshes, and with GPU-enabled workloads.

• Experience with DevSecOps practices, including secrets management, policy as code, and supply chain security.

• Relevant certifications such as Certified Kubernetes Administrator (CKA), Azure Administrator, or Azure DevOps Engineer Expert.

Being You

The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging - being a valued, respected, trusted member of the team - is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.

What You Can Expect

Your career with us isn’t just a job-it’s an adventure with purpose. We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health-because we know that when you feel your best, you do your best.

From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute-you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.

We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities-from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.

We want you to thrive here-and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.

Get Referred!

If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.