{"id":4451133,"url":"https://alion.io/job/ey-techops-cloudops-ai-ml-platform-operations-senior-engineer","title":"TechOps-CloudOps-AI-ML Platform Operations Senior Engineer","company":{"id":2859,"name":"EY","domain":"ey.com","url":"https://alion.io/company/ey-com","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SuccessFactors","truth_index":null},"role":"DevOps","role_family":"DevOps","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Kochi, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"API Gateway","optional":false},{"name":"AWS","optional":false},{"name":"AWS Bedrock","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Configuration Management","optional":false},{"name":"Embeddings","optional":false},{"name":"Git","optional":false},{"name":"Hallucination","optional":false},{"name":"Incident Management","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"LLMOps","optional":false},{"name":"Machine Learning","optional":false},{"name":"OpenAI","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Rest API","optional":false},{"name":"Amazon CloudWatch","optional":true},{"name":"Amazon SageMaker","optional":true},{"name":"CloudFormation","optional":true},{"name":"Databricks","optional":true},{"name":"Docker","optional":true},{"name":"Feature Store","optional":true},{"name":"Function Calling","optional":true},{"name":"Grafana","optional":true},{"name":"Kubernetes","optional":true},{"name":"LangChain","optional":true},{"name":"LangGraph","optional":true},{"name":"MLFlow","optional":true},{"name":"OpenTelemetry","optional":true},{"name":"Prometheus","optional":true},{"name":"Red Teaming","optional":true},{"name":"Semantic Kernel","optional":true},{"name":"Service Mesh","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-11-17T10:49:59Z","employer_posted_date":"2026-11-16","last_verified_at":"2026-11-17T10:49:59Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.\nTechOps - CloudOps - AI/ML Platform Operations Engineer: Senior\nAt EY, we’re all in to shape your future with confidence.\nWe’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.\nJoin EY and help to build a better working world.\nAbout Global Delivery Services\nGlobal Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.\nOur journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.\nClient service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.\nEnablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.\nOur innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.\nThe opportunity\nWe are looking for a seasoned and proactive Senior AI/ML Platform Operations Engineer to operate, support, and continuously improve enterprise machine learning and generative AI platforms. The role will focus on MLOps and LLMOps across model deployment, monitoring, API and endpoint operations, model pipelines, prompt and model configuration, observability, and incident resolution. The engineer will act as a technical escalation point for production AI services and work closely with data scientists, ML engineers, application teams, cloud platform teams, security, DevOps, and business stakeholders to deliver reliable, secure, scalable, and cost-effective AI capabilities.\nYour key responsibilities\nProvide day-to-day production and operational support for machine learning, generative AI, and large language model platforms across development, test, staging, and production environments.\nDeploy, configure, validate, and support machine learning models, foundation models, embedding models, rerankers, and associated inference services using controlled MLOps and LLMOps practices.\nMonitor real-time and batch inference workloads, APIs, endpoints, model pipelines, queues, scheduled jobs, and dependent services, and restore failed or degraded services within agreed SLAs.\nTroubleshoot endpoint errors, latency, throttling, token limits, authentication failures, networking issues, dependency conflicts, model-loading errors, memory constraints, and scaling problems.\nOperate model training, evaluation, registration, approval, deployment, rollback, and retirement pipelines with traceability across model and environment versions.\nSupport prompt templates, system instructions, model parameters, routing rules, guardrails, content filters, retrieval configuration, tool connections, and environment-specific configuration.\nImplement and maintain observability for model quality, response latency, throughput, error rate, availability, token consumption, cost, drift, data quality, hallucination risk, safety events, and user feedback.\nInvestigate production incidents using application, model, prompt, API gateway, orchestration, cloud service, infrastructure, and security logs, and coordinate service recovery.\nPerform root cause analysis for recurring incidents and implement corrective actions, preventive alerts, automated recovery, runbook improvements, and platform engineering enhancements.\nDevelop and maintain Python utilities, automation scripts, health checks, deployment tooling, test harnesses, evaluation workflows, and operational dashboards.\nSupport enterprise integrations with OpenAI services, Azure OpenAI where applicable, AWS Bedrock, model gateways, vector stores, API gateways, identity providers, secrets management, and monitoring platforms.\nEnsure secure handling of model endpoints, API keys, service identities, secrets, private networking, customer data, prompts, responses, and model artifacts.\nSupport capacity planning, autoscaling, quota management, rate-limit management, GPU or accelerator utilization, token forecasting, and cost optimization for AI workloads.\nCoordinate controlled releases using Git and CI/CD, including testing evidence, model and prompt versioning, approvals, deployment validation, rollback planning, and post-release monitoring.\nManage complex incidents, service requests, problems, and changes, and mentor junior engineers in troubleshooting, platform operations, and operational best practices.\nCreate and maintain runbooks, SOPs, architecture and dependency records, known-error articles, monitoring standards, escalation paths, and support knowledge bases.\nResponsible for decision-making, optimizing processes, resource management, and overseeing team management as needed for task execution.\nAccountable for allocating personnel, supervising team members, assigning tasks, ensuring that the team has the necessary tools and support to succeed in their roles and optimizing and evaluating their performance to meet organizational goals.\nSkills and attributes for success\nStrong hands-on knowledge of MLOps practices covering experiment tracking, model packaging, model registry, validation, promotion, deployment, monitoring, rollback, and lifecycle governance.\nStrong understanding of LLMOps, including foundation model access, prompt and configuration management, evaluation, observability, retrieval-augmented generation, guardrails, endpoint operations, and cost controls.\nExperience operating model APIs and endpoints, including authentication, authorization, throttling, load management, autoscaling, latency troubleshooting, retries, timeouts, and high availability.\nStrong Python skills for platform automation, API integration, log analysis, operational tooling, testing, and incident diagnosis.\nWorking knowledge of OpenAI APIs and AWS Bedrock services, including model invocation, embeddings, streaming responses, configuration, quotas, monitoring, and security.\nUnderstanding of machine learning and generative AI evaluation methods, including accuracy and task metrics, groundedness, relevance, toxicity and safety checks, drift, regression testing, and human evaluation.\nAbility to interpret distributed application, model, API, cloud, container, orchestration, network, and security telemetry to isolate failures across multiple technology layers.\nStrong incident management, root cause analysis, problem-solving, and production change-management skills.\nClear communication and stakeholder-management skills, including the ability to explain operational risk, business impact, recovery status, and remediation plans.\nAbility to mentor engineers, coordinate technical recovery, review operational designs, and promote reliability and engineering standards.\nTo qualify for the role, you must have\nBachelor’s degree in computer science, artificial intelligence, machine learning, data science, engineering, or a related discipline, or equivalent professional experience.\n5-8 years of experience in platform engineering, DevOps, data engineering, machine learning engineering, cloud operations, or production support, including at least 2 years supporting ML or generative AI workloads.\nHands-on experience implementing or operating MLOps pipelines and production model deployments.\nPractical experience with LLMOps, including model endpoints, prompt or model configuration, evaluation, monitoring, observability, and incident troubleshooting.\nExperience supporting OpenAI-based services, AWS Bedrock, or comparable enterprise foundation-model platforms.\nStrong Python experience for automation, API consumption, operational tooling, testing, and troubleshooting.\nExperience with CI/CD, infrastructure automation, containerized workloads, cloud monitoring, secrets management, and identity and access controls.\nExperience managing complex production incidents, root cause analysis, problem records, changes, releases, and operational documentation.\nExperience working with distributed teams and supporting business-critical services under agreed SLAs.\nWillingness to participate in 24/7 support rotations or cover critical business hours when required.\nTechnologies and Tools\nMust have\nMLOps: experiment tracking, model packaging, model registry, evaluation gates, approval workflows, deployment strategies, feature and data dependencies, monitoring, rollback, and lifecycle management.\nLLMOps: foundation model endpoints, prompt and model configuration, evaluation, retrieval-augmented generation, embeddings, vector retrieval, guardrails, observability, token and cost management, and production support.\nModel serving and API operations: REST APIs, streaming, endpoint security, authentication, rate limits, quotas, retries, timeouts, autoscaling, load balancing, latency, and availability.\nObservability: logs, metrics, traces, dashboards, alerting, service-level indicators, model-quality measures, drift detection, safety monitoring, token usage, and cost reporting.\nPython for automation, API integrations, troubleshooting, evaluation tooling, health checks, and operational utilities.\nGit and CI/CD for model, prompt, configuration, pipeline, and infrastructure deployment across controlled environments.\nProduction operations covering incident, problem, change, release, availability, capacity, continuity, security, and service-level management.\nGood to have\nHands-on exposure to OpenAI APIs, Azure OpenAI, AWS Bedrock, Amazon SageMaker, Microsoft Foundry, Databricks Mosaic AI, MLflow, or equivalent enterprise AI platforms.\nExperience with orchestration and agent frameworks such as LangChain, LangGraph, Semantic Kernel, or equivalent technologies, including tool calling and multi-step workflows.\nKnowledge of Kubernetes, Docker, serverless platforms, API gateways, service mesh, event-driven architectures, and infrastructure as code such as Terraform or AWS CloudFormation.\nExperience with monitoring and observability platforms such as Amazon CloudWatch, Azure Monitor, Application Insights, Prometheus, Grafana, OpenTelemetry, or comparable tools.\nUnderstanding of responsible AI and AI security, including privacy, human oversight, prompt injection resistance, data leakage prevention, content safety, red teaming, evaluation, traceability, and auditability.\nKnowledge of vector databases, retrieval systems, model gateways, caching, feature stores, data quality, and model risk management.\nRelevant certifications in AWS Machine Learning, AWS AI Practitioner, Azure AI Engineer, Azure AI Fundamentals, MLOps, Kubernetes, DevOps, or cloud architecture.\nWhat we look for\nSenior operations engineers who combine strong MLOps and LLMOps knowledge with disciplined production support and end-to-end ownership.\nProblem solvers who can analyze models, prompts, APIs, pipelines, cloud se...","description_format":"text","description_chars":15182,"description_truncated":true,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Equity","Professional development"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Audit & Assurance Firms","Financial Advisory, Valuation & Restructuring","Management Consulting","Tax Advisory & Preparation"],"lifecycle":[{"event":"open","at":"2026-11-17T10:49:59Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":45,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-17T12:24:10Z"},"pay":null,"html_url":"https://alion.io/job/ey-techops-cloudops-ai-ml-platform-operations-senior-engineer","json_url":"https://alion.io/job/ey-techops-cloudops-ai-ml-platform-operations-senior-engineer.json","meta":{"generated_at":"2026-11-17T12:24:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":21698,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2859},"rest":"https://alion.io/mcp/rest/get_company?id=2859"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fey-techops-cloudops-ai-ml-platform-operations-senior-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fey-techops-cloudops-ai-ml-platform-operations-senior-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fey-techops-cloudops-ai-ml-platform-operations-senior-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ey-techops-cloudops-ai-ml-platform-operations-senior-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fey-techops-cloudops-ai-ml-platform-operations-senior-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4451133}},{"tool":"search_jobs","arguments":{"company":"ey.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4451133},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}