Confirmed on the employer's own hiring board on Nov 17, 2026. First seen by Alion on Nov 17, 2026.
At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.
TechOps - CloudOps - AI/ML Platform Operations Engineer: Senior
At EY, we’re all in to shape your future with confidence.
We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.
Join EY and help to build a better working world.
About Global Delivery Services
Global Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.
Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.
Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.
Enablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.
Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.
The opportunity
We are looking for a seasoned and proactive Senior AI/ML Platform Operations Engineer to operate, support, and continuously improve enterprise machine learning and generative AI platforms. The role will focus on MLOps and LLMOps across model deployment, monitoring, API and endpoint operations, model pipelines, prompt and model configuration, observability, and incident resolution. The engineer will act as a technical escalation point for production AI services and work closely with data scientists, ML engineers, application teams, cloud platform teams, security, DevOps, and business stakeholders to deliver reliable, secure, scalable, and cost-effective AI capabilities.
Your key responsibilities
- Provide day-to-day production and operational support for machine learning, generative AI, and large language model platforms across development, test, staging, and production environments.
- Deploy, configure, validate, and support machine learning models, foundation models, embedding models, rerankers, and associated inference services using controlled MLOps and LLMOps practices.
- Monitor real-time and batch inference workloads, APIs, endpoints, model pipelines, queues, scheduled jobs, and dependent services, and restore failed or degraded services within agreed SLAs.
- Troubleshoot endpoint errors, latency, throttling, token limits, authentication failures, networking issues, dependency conflicts, model-loading errors, memory constraints, and scaling problems.
- Operate model training, evaluation, registration, approval, deployment, rollback, and retirement pipelines with traceability across model and environment versions.
- Support prompt templates, system instructions, model parameters, routing rules, guardrails, content filters, retrieval configuration, tool connections, and environment-specific configuration.
- Implement and maintain observability for model quality, response latency, throughput, error rate, availability, token consumption, cost, drift, data quality, hallucination risk, safety events, and user feedback.
- Investigate production incidents using application, model, prompt, API gateway, orchestration, cloud service, infrastructure, and security logs, and coordinate service recovery.
- Perform root cause analysis for recurring incidents and implement corrective actions, preventive alerts, automated recovery, runbook improvements, and platform engineering enhancements.
- Develop and maintain Python utilities, automation scripts, health checks, deployment tooling, test harnesses, evaluation workflows, and operational dashboards.
- Support enterprise integrations with OpenAI services, Azure OpenAI where applicable, AWS Bedrock, model gateways, vector stores, API gateways, identity providers, secrets management, and monitoring platforms.
- Ensure secure handling of model endpoints, API keys, service identities, secrets, private networking, customer data, prompts, responses, and model artifacts.
- Support capacity planning, autoscaling, quota management, rate-limit management, GPU or accelerator utilization, token forecasting, and cost optimization for AI workloads.
- Coordinate controlled releases using Git and CI/CD, including testing evidence, model and prompt versioning, approvals, deployment validation, rollback planning, and post-release monitoring.
- Manage complex incidents, service requests, problems, and changes, and mentor junior engineers in troubleshooting, platform operations, and operational best practices.
- Create and maintain runbooks, SOPs, architecture and dependency records, known-error articles, monitoring standards, escalation paths, and support knowledge bases.
- Responsible for decision-making, optimizing processes, resource management, and overseeing team management as needed for task execution.
- Accountable for allocating personnel, supervising team members, assigning tasks, ensuring that the team has the necessary tools and support to succeed in their roles and optimizing and evaluating their performance to meet organizational goals.
Skills and attributes for success
- Strong hands-on knowledge of MLOps practices covering experiment tracking, model packaging, model registry, validation, promotion, deployment, monitoring, rollback, and lifecycle governance.
- Strong understanding of LLMOps, including foundation model access, prompt and configuration management, evaluation, observability, retrieval-augmented generation, guardrails, endpoint operations, and cost controls.
- Experience operating model APIs and endpoints, including authentication, authorization, throttling, load management, autoscaling, latency troubleshooting, retries, timeouts, and high availability.
- Strong Python skills for platform automation, API integration, log analysis, operational tooling, testing, and incident diagnosis.
- Working knowledge of OpenAI APIs and AWS Bedrock services, including model invocation, embeddings, streaming responses, configuration, quotas, monitoring, and security.
- Understanding of machine learning and generative AI evaluation methods, including accuracy and task metrics, groundedness, relevance, toxicity and safety checks, drift, regression testing, and human evaluation.
- Ability to interpret distributed application, model, API, cloud, container, orchestration, network, and security telemetry to isolate failures across multiple technology layers.
- Strong incident management, root cause analysis, problem-solving, and production change-management skills.
- Clear communication and stakeholder-management skills, including the ability to explain operational risk, business impact, recovery status, and remediation plans.
- Ability to mentor engineers, coordinate technical recovery, review operational designs, and promote reliability and engineering standards.
To qualify for the role, you must have
- Bachelor’s degree in computer science, artificial intelligence, machine learning, data science, engineering, or a related discipline, or equivalent professional experience.
- 5-8 years of experience in platform engineering, DevOps, data engineering, machine learning engineering, cloud operations, or production support, including at least 2 years supporting ML or generative AI workloads.
- Hands-on experience implementing or operating MLOps pipelines and production model deployments.
- Practical experience with LLMOps, including model endpoints, prompt or model configuration, evaluation, monitoring, observability, and incident troubleshooting.
- Experience supporting OpenAI-based services, AWS Bedrock, or comparable enterprise foundation-model platforms.
- Strong Python experience for automation, API consumption, operational tooling, testing, and troubleshooting.
- Experience with CI/CD, infrastructure automation, containerized workloads, cloud monitoring, secrets management, and identity and access controls.
- Experience managing complex production incidents, root cause analysis, problem records, changes, releases, and operational documentation.
- Experience working with distributed teams and supporting business-critical services under agreed SLAs.
- Willingness to participate in 24/7 support rotations or cover critical business hours when required.
Technologies and Tools
Must have
- MLOps: experiment tracking, model packaging, model registry, evaluation gates, approval workflows, deployment strategies, feature and data dependencies, monitoring, rollback, and lifecycle management.
- LLMOps: foundation model endpoints, prompt and model configuration, evaluation, retrieval-augmented generation, embeddings, vector retrieval, guardrails, observability, token and cost management, and production support.
- Model serving and API operations: REST APIs, streaming, endpoint security, authentication, rate limits, quotas, retries, timeouts, autoscaling, load balancing, latency, and availability.
- Observability: logs, metrics, traces, dashboards, alerting, service-level indicators, model-quality measures, drift detection, safety monitoring, token usage, and cost reporting.
- Python for automation, API integrations, troubleshooting, evaluation tooling, health checks, and operational utilities.
- Git and CI/CD for model, prompt, configuration, pipeline, and infrastructure deployment across controlled environments.
- Production operations covering incident, problem, change, release, availability, capacity, continuity, security, and service-level management.
Good to have
- Hands-on exposure to OpenAI APIs, Azure OpenAI, AWS Bedrock, Amazon SageMaker, Microsoft Foundry, Databricks Mosaic AI, MLflow, or equivalent enterprise AI platforms.
- Experience with orchestration and agent frameworks such as LangChain, LangGraph, Semantic Kernel, or equivalent technologies, including tool calling and multi-step workflows.
- Knowledge of Kubernetes, Docker, serverless platforms, API gateways, service mesh, event-driven architectures, and infrastructure as code such as Terraform or AWS CloudFormation.
- Experience with monitoring and observability platforms such as Amazon CloudWatch, Azure Monitor, Application Insights, Prometheus, Grafana, OpenTelemetry, or comparable tools.
- Understanding of responsible AI and AI security, including privacy, human oversight, prompt injection resistance, data leakage prevention, content safety, red teaming, evaluation, traceability, and auditability.
- Knowledge of vector databases, retrieval systems, model gateways, caching, feature stores, data quality, and model risk management.
- Relevant certifications in AWS Machine Learning, AWS AI Practitioner, Azure AI Engineer, Azure AI Fundamentals, MLOps, Kubernetes, DevOps, or cloud architecture.
What we look for
- Senior operations engineers who combine strong MLOps and LLMOps knowledge with disciplined production support and end-to-end ownership.
- Problem solvers who can analyze models, prompts, APIs, pipelines, cloud services, security controls, and infrastructure methodically and drive sustainable resolution.
- Reliability-focused professionals who use observability, automation, evaluation, and operational data to prevent incidents and improve AI service quality.
- Collaborative team members who communicate clearly with data scientists, ML engineers, developers, platform teams, security specialists, and business stakeholders.
- Continuous learners who can safely operationalize emerging AI capabilities while maintaining security, governance, human oversight, and service accountability.
What we offer
At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.
Are you ready to shape your future with confidence? Apply today.
To help create an equitable and inclusive experience during the recruitment process, please inform us as soon as possible about any disability-related adjustments or accommodation you may need.
Our Commitment: As a commitment, we persistently endeavour to embody our values, fulfil our purpose, and champion inclusiveness. Our dedication is to cultivate EY into an environment where diverse perspectives are celebrated, creating a supportive atmosphere for individuals to authentically be themselves and contribute their utmost.
Professional Development: From entry-level employees to senior leaders, we believe in continuous learning. We offer opportunities to build new skills, take on leadership roles, and connect and grow through mentorship.
People and Culture: In our dynamic workplace, diversity, equity, and inclusiveness are ingrained in our culture. We're united by a commitment to create an environment where every individual's differences are valued, practices are equitable, fostering a sense of belonging. Our shared values include integrity, respect, teaming, inclusiveness, energy, enthusiasm, courage to lead, and building relationships based on doing the right thing.
Benefits: Embark on a transformative career journey with us and indulge in a suite of premium benefits, encompassing exclusive health and wellness packages, enticing rewards, and cutting-edge learning opportunities that empower you to continually grow and excel in your professional and personal development.
How to Apply: If you are passionate to join us and are aligned with our commitment to building a better working world, we invite you to apply by completing our user-friendly form with personal and professional information and by providing your consent to data privacy.
EY | Building a better working world
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.
Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.
Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.

