2,332,825open jobs
146,580companies
280,146added this week
Browse all
Location
In office (Kochi)
Seniority
Senior · 5+ years exp

Confirmed on the employer's own hiring board on Nov 17, 2026. First seen by Alion on Nov 17, 2026.

Overview
Company
Impact
Profile match

EY

Headquartered in London, United Kingdom, EY (Ernst & Young) is a multinational professional services network and one of the "Big Four" accounting firms. The organization provides financial assurance and auditing, tax advisory, management and technology consulting, and strategy and transactions advisory through its EY-Parthenon arm. Operating across more than 150 countries, it delivers risk management, digital transformation, data analytics, and regulatory compliance solutions to multinational corporations, financial institutions, and government entities worldwide.
Backed by ROPEA

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.

TechOps - CloudOps - AI/ML Platform Operations Engineer: Senior

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.

Join EY and help to build a better working world.

About Global Delivery Services

Global Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.

Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.

Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.

Enablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.

Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.

The opportunity

We are looking for a seasoned and proactive Senior AI/ML Platform Operations Engineer to operate, support, and continuously improve enterprise machine learning and generative AI platforms. The role will focus on MLOps and LLMOps across model deployment, monitoring, API and endpoint operations, model pipelines, prompt and model configuration, observability, and incident resolution. The engineer will act as a technical escalation point for production AI services and work closely with data scientists, ML engineers, application teams, cloud platform teams, security, DevOps, and business stakeholders to deliver reliable, secure, scalable, and cost-effective AI capabilities.

Your key responsibilities

  • Provide day-to-day production and operational support for machine learning, generative AI, and large language model platforms across development, test, staging, and production environments.
  • Deploy, configure, validate, and support machine learning models, foundation models, embedding models, rerankers, and associated inference services using controlled MLOps and LLMOps practices.
  • Monitor real-time and batch inference workloads, APIs, endpoints, model pipelines, queues, scheduled jobs, and dependent services, and restore failed or degraded services within agreed SLAs.
  • Troubleshoot endpoint errors, latency, throttling, token limits, authentication failures, networking issues, dependency conflicts, model-loading errors, memory constraints, and scaling problems.
  • Operate model training, evaluation, registration, approval, deployment, rollback, and retirement pipelines with traceability across model and environment versions.
  • Support prompt templates, system instructions, model parameters, routing rules, guardrails, content filters, retrieval configuration, tool connections, and environment-specific configuration.
  • Implement and maintain observability for model quality, response latency, throughput, error rate, availability, token consumption, cost, drift, data quality, hallucination risk, safety events, and user feedback.
  • Investigate production incidents using application, model, prompt, API gateway, orchestration, cloud service, infrastructure, and security logs, and coordinate service recovery.
  • Perform root cause analysis for recurring incidents and implement corrective actions, preventive alerts, automated recovery, runbook improvements, and platform engineering enhancements.
  • Develop and maintain Python utilities, automation scripts, health checks, deployment tooling, test harnesses, evaluation workflows, and operational dashboards.
  • Support enterprise integrations with OpenAI services, Azure OpenAI where applicable, AWS Bedrock, model gateways, vector stores, API gateways, identity providers, secrets management, and monitoring platforms.
  • Ensure secure handling of model endpoints, API keys, service identities, secrets, private networking, customer data, prompts, responses, and model artifacts.
  • Support capacity planning, autoscaling, quota management, rate-limit management, GPU or accelerator utilization, token forecasting, and cost optimization for AI workloads.
  • Coordinate controlled releases using Git and CI/CD, including testing evidence, model and prompt versioning, approvals, deployment validation, rollback planning, and post-release monitoring.
  • Manage complex incidents, service requests, problems, and changes, and mentor junior engineers in troubleshooting, platform operations, and operational best practices.
  • Create and maintain runbooks, SOPs, architecture and dependency records, known-error articles, monitoring standards, escalation paths, and support knowledge bases.
  • Responsible for decision-making, optimizing processes, resource management, and overseeing team management as needed for task execution.
  • Accountable for allocating personnel, supervising team members, assigning tasks, ensuring that the team has the necessary tools and support to succeed in their roles and optimizing and evaluating their performance to meet organizational goals.

Skills and attributes for success

  • Strong hands-on knowledge of MLOps practices covering experiment tracking, model packaging, model registry, validation, promotion, deployment, monitoring, rollback, and lifecycle governance.
  • Strong understanding of LLMOps, including foundation model access, prompt and configuration management, evaluation, observability, retrieval-augmented generation, guardrails, endpoint operations, and cost controls.
  • Experience operating model APIs and endpoints, including authentication, authorization, throttling, load management, autoscaling, latency troubleshooting, retries, timeouts, and high availability.
  • Strong Python skills for platform automation, API integration, log analysis, operational tooling, testing, and incident diagnosis.
  • Working knowledge of OpenAI APIs and AWS Bedrock services, including model invocation, embeddings, streaming responses, configuration, quotas, monitoring, and security.
  • Understanding of machine learning and generative AI evaluation methods, including accuracy and task metrics, groundedness, relevance, toxicity and safety checks, drift, regression testing, and human evaluation.
  • Ability to interpret distributed application, model, API, cloud, container, orchestration, network, and security telemetry to isolate failures across multiple technology layers.
  • Strong incident management, root cause analysis, problem-solving, and production change-management skills.
  • Clear communication and stakeholder-management skills, including the ability to explain operational risk, business impact, recovery status, and remediation plans.
  • Ability to mentor engineers, coordinate technical recovery, review operational designs, and promote reliability and engineering standards.

To qualify for the role, you must have

  • Bachelor’s degree in computer science, artificial intelligence, machine learning, data science, engineering, or a related discipline, or equivalent professional experience.
  • 5-8 years of experience in platform engineering, DevOps, data engineering, machine learning engineering, cloud operations, or production support, including at least 2 years supporting ML or generative AI workloads.
  • Hands-on experience implementing or operating MLOps pipelines and production model deployments.
  • Practical experience with LLMOps, including model endpoints, prompt or model configuration, evaluation, monitoring, observability, and incident troubleshooting.
  • Experience supporting OpenAI-based services, AWS Bedrock, or comparable enterprise foundation-model platforms.
  • Strong Python experience for automation, API consumption, operational tooling, testing, and troubleshooting.
  • Experience with CI/CD, infrastructure automation, containerized workloads, cloud monitoring, secrets management, and identity and access controls.
  • Experience managing complex production incidents, root cause analysis, problem records, changes, releases, and operational documentation.
  • Experience working with distributed teams and supporting business-critical services under agreed SLAs.
  • Willingness to participate in 24/7 support rotations or cover critical business hours when required.

Technologies and Tools

Must have

  • MLOps: experiment tracking, model packaging, model registry, evaluation gates, approval workflows, deployment strategies, feature and data dependencies, monitoring, rollback, and lifecycle management.
  • LLMOps: foundation model endpoints, prompt and model configuration, evaluation, retrieval-augmented generation, embeddings, vector retrieval, guardrails, observability, token and cost management, and production support.
  • Model serving and API operations: REST APIs, streaming, endpoint security, authentication, rate limits, quotas, retries, timeouts, autoscaling, load balancing, latency, and availability.
  • Observability: logs, metrics, traces, dashboards, alerting, service-level indicators, model-quality measures, drift detection, safety monitoring, token usage, and cost reporting.
  • Python for automation, API integrations, troubleshooting, evaluation tooling, health checks, and operational utilities.
  • Git and CI/CD for model, prompt, configuration, pipeline, and infrastructure deployment across controlled environments.
  • Production operations covering incident, problem, change, release, availability, capacity, continuity, security, and service-level management.

Good to have

  • Hands-on exposure to OpenAI APIs, Azure OpenAI, AWS Bedrock, Amazon SageMaker, Microsoft Foundry, Databricks Mosaic AI, MLflow, or equivalent enterprise AI platforms.
  • Experience with orchestration and agent frameworks such as LangChain, LangGraph, Semantic Kernel, or equivalent technologies, including tool calling and multi-step workflows.
  • Knowledge of Kubernetes, Docker, serverless platforms, API gateways, service mesh, event-driven architectures, and infrastructure as code such as Terraform or AWS CloudFormation.
  • Experience with monitoring and observability platforms such as Amazon CloudWatch, Azure Monitor, Application Insights, Prometheus, Grafana, OpenTelemetry, or comparable tools.
  • Understanding of responsible AI and AI security, including privacy, human oversight, prompt injection resistance, data leakage prevention, content safety, red teaming, evaluation, traceability, and auditability.
  • Knowledge of vector databases, retrieval systems, model gateways, caching, feature stores, data quality, and model risk management.
  • Relevant certifications in AWS Machine Learning, AWS AI Practitioner, Azure AI Engineer, Azure AI Fundamentals, MLOps, Kubernetes, DevOps, or cloud architecture.

What we look for

  • Senior operations engineers who combine strong MLOps and LLMOps knowledge with disciplined production support and end-to-end ownership.
  • Problem solvers who can analyze models, prompts, APIs, pipelines, cloud services, security controls, and infrastructure methodically and drive sustainable resolution.
  • Reliability-focused professionals who use observability, automation, evaluation, and operational data to prevent incidents and improve AI service quality.
  • Collaborative team members who communicate clearly with data scientists, ML engineers, developers, platform teams, security specialists, and business stakeholders.
  • Continuous learners who can safely operationalize emerging AI capabilities while maintaining security, governance, human oversight, and service accountability.

What we offer

At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.

Are you ready to shape your future with confidence? Apply today.

To help create an equitable and inclusive experience during the recruitment process, please inform us as soon as possible about any disability-related adjustments or accommodation you may need.

Our Commitment: As a commitment, we persistently endeavour to embody our values, fulfil our purpose, and champion inclusiveness. Our dedication is to cultivate EY into an environment where diverse perspectives are celebrated, creating a supportive atmosphere for individuals to authentically be themselves and contribute their utmost.

Professional Development: From entry-level employees to senior leaders, we believe in continuous learning. We offer opportunities to build new skills, take on leadership roles, and connect and grow through mentorship.

People and Culture: In our dynamic workplace, diversity, equity, and inclusiveness are ingrained in our culture. We're united by a commitment to create an environment where every individual's differences are valued, practices are equitable, fostering a sense of belonging. Our shared values include integrity, respect, teaming, inclusiveness, energy, enthusiasm, courage to lead, and building relationships based on doing the right thing.

Benefits: Embark on a transformative career journey with us and indulge in a suite of premium benefits, encompassing exclusive health and wellness packages, enticing rewards, and cutting-edge learning opportunities that empower you to continually grow and excel in your professional and personal development.

How to Apply: If you are passionate to join us and are aligned with our commitment to building a better working world, we invite you to apply by completing our user-friendly form with personal and professional information and by providing your consent to data privacy.

EY | Building a better working world

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.

Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.

Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,332,825 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

DevOps
Similar stack
Same company
Kochi
Devops Engineer 2 hours ago
In office · Full-Time · 4+ years exp · Hyderabad
Python
Java
Groovy
Java
Gradle
DevOps
Splunk
Terraform
Ansible
GCP
CloudFormation
Prometheus
GitLab CI
CI/CD
Jenkins
Git
AWS
Docker
Kubernetes
Grafana
Configuration Management
Bitbucket
Amazon CloudWatch
Cybersecurity
Snyk
SonarQube
HashiCorp Vault
Apply
In office · 8+ years exp · Chennai
Python
PowerShell
Bash
Groovy
DevOps
Splunk
Terraform
Ansible
GCP
Helm
Azure DevOps
GitHub Actions
Istio
Kibana
Datadog
FluxCD
Prometheus
GitLab CI
Azure
CI/CD
GitOps
ArgoCD
Jenkins
AWS
Docker
Kubernetes
Grafana
Platform Engineering
Service Mesh
Bicep
Backstage
Bitbucket
JFrog Artifactory
Amazon EKS
Google GKE
Azure AKS
GitHub
GitLab
IAM
Cybersecurity
SonarQube
Checkmarx
Wiz
Veracode
Fortify
OWASP
Management
Agile
Apply
Hybrid · 3+ years exp · Bachelor's Degree · Bengaluru
SQL
PowerShell
C#
C#
.NET
Databases
Redis
Azure SQL Database
AI/ML
Anomaly Detection
DevOps
Terraform
Ansible
Azure DevOps
Kibana
Logstash
Azure
CI/CD
Windows Server
Git
AWS
Docker
Kubernetes
Configuration Management
TeamCity
Octopus Deploy
SLI/SLO/SLA
GitHub
Windows
DNS
VPN
Cybersecurity
Microsoft Entra ID
Apply
In office · Full-Time · 10+ years exp · Bengaluru
C#
C#
.NET
DevOps
Rest API
Azure DevOps
Azure
CI/CD
Management
ServiceNow
Apply
In office · Full-Time · 5+ years exp · PhD · Bengaluru
Python
JavaScript
TypeScript
SQL
PowerShell
C#
Bash
Cython
C#
ASP.NET Core
Entity Framework Core
Cython
Bottleneck
AI/ML
AI Agents
Frontend
Angular
React.js
DevOps
Rest API
Terraform
GCP
Helm
GitHub Actions
CloudFormation
Datadog
Azure
CI/CD
Jenkins
AWS
Docker
Kubernetes
Platform Engineering
Service Mesh
Configuration Management
Pipeline as Code
JFrog Artifactory
Amazon EKS
AWS Lambda
Amazon EC2
Incident Management
SLI/SLO/SLA
Amazon S3
IAM
Amazon ECS
Amazon CloudWatch
QA
JMeter
Swagger
Apply
In office · Full-Time · 9+ years exp · Kochi
Python
JavaScript
TypeScript
Python
FastAPI
Celery
Databases
PostgreSQL
Redis
Apache Iceberg
Delta Lake
Apache Kafka
AI/ML
Airflow
Dagster
MLFlow
AWS Bedrock
LLM
Feature Store
Frontend
Tailwind CSS
React.js
DevOps
ZooKeeper
Terraform
Helm
GitHub Actions
OpenTelemetry
Datadog
etcd
Prometheus
CI/CD
AWS
Docker
Kubernetes
Grafana
CDKTF
SLI/SLO/SLA
Apply
In office · 5+ years exp · PhD · Kochi
Python
JavaScript
Rust
TypeScript
Ruby
C#
Databases
DynamoDB
Amazon Aurora
AI/ML
Copilot
Claude Code
AI Agents
AWS Bedrock
DevOps
Terraform
AWS CDK
Datadog
CI/CD
AWS
Docker
AWS Lambda
GitLab
Amazon S3
Amazon ECS
Amazon EventBridge
AWS Step Functions
API Gateway
Apply
In office · 1+ year exp · Bengaluru · Kochi
C#
C#
.NET
DevOps
GCP
Life Sciences
Medidata Rave
Apply
In office · 4+ years exp · Bachelor's Degree · Kochi
Java
Kotlin
SQL
Java
Spring Boot
Hibernate
Spring Cloud
Kotlin
Mockito
Databases
RabbitMQ
Apache Kafka
Mobile
JUnit
DevOps
Rest API
Splunk
GCP
Azure DevOps
GitHub Actions
Prometheus
Azure
CI/CD
Jenkins
Git
AWS
Docker
Kubernetes
Grafana
QA
Swagger
Apply
In office · 4+ years exp · Bachelor's Degree · Kochi
JavaScript
TypeScript
SQL
Node JS
Node JS
Nest.JS
Express
Databases
MySQL
PostgreSQL
Frontend
Zustand
Redux
GraphQL
Next.js
React.js
Mobile
State Management
DevOps
Rest API
GCP
Azure DevOps
Azure
CI/CD
Git
AWS
Docker
Kubernetes
Management
Jira
Agile
QA
Playwright
Jest
Mocha
Apply
See all jobs
This is one of many
2,332,825 more open roles from verified company boards, updated every day.