{"id":1994435,"url":"https://alion.io/job/mastercard-senior-ai-product-ops","title":"Senior AI Product Ops","company":{"id":252,"name":"Mastercard","domain":"mastercard.com","url":"https://alion.io/company/mastercard","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":87,"open_postings":162,"ghost_share":0.019,"stale_share":0.438,"repost_share":0.068,"time_to_fill_p50_days":26,"computed_at":"2026-10-22T06:10:10Z"}},"role":"Product","role_family":"Product","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":29000,"max_usd":58000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":42},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AIOps","optional":false},{"name":"Hallucination","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false}],"status":"live","first_seen_at":"2026-10-07T08:26:37Z","employer_posted_date":"2026-10-07","last_verified_at":"2026-10-22T11:09:10Z","board_verified":true,"closed_at":null,"days_open":15,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":15},"description":"Our Purpose\nMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.\nTitle and Summary\nSenior AI Product OpsAI OpsOverview:\nMastercard's Operational Intelligence team is building the next generation of data products and AI solutions that help customers access and use operational insights in new ways. As AI agents move from POC to production, their behavior keeps changing in real time: the context they retrieve, the skills they select, how they resolve exceptions. These agents are never really “finished.” They keep learning from production outcomes, so their reliability, safety, and trustworthiness need to be actively operated, not just monitored. That is the job of AI Ops: making sure each agent’s reasoning stays correct, its context stays current, and its behavior stays governed as it learns.\nRole:\nOwn end to end production monitoring for one or more AI agents, tracking key metrics, KPIs, accuracy, latency, SLA breaches, guardrail triggers, and out of scope rates through dedicated observability dashboards\nServe as L1/L2 production support, providing first response monitoring, triage, and escalation to tech teams as new agentic services go live\nIdentify and diagnose issues by monitoring eval scores and drift alerts, inspecting failing traces and patterns, and classifying root causes such as intent, tool, parameter, or hallucination errors\nEvaluate whether the agent’s reasoning remains correct in production, checking whether context retrieval stays current, whether resolutions match ground truth, and whether the learning loop is drifting\nMonitor and manage post production reliability, including API and authentication failures and issues originating from external AI endpoints, to protect revenue generating, client facing agents\nPartner with AI Engineering to prioritize fixes, run experiments on prompts, context, and routing in Dev, and validate improvements via evals before handing off proven changes for deployment\nEmbed governance within the agent’s learning loop so that approval workflows and audit logging travel with every production change, rather than being added after the fact\nAll About You:\nExperience monitoring or operating production AI/ML or agentic systems, including observability, evaluation, and drift detection practices\nStrong analytical skills to diagnose root causes across intent classification, tool selection, parameter errors, and hallucination patterns\nUnderstanding of AI/LLM observability concepts such as tracing, telemetry, guardrails, and evaluation engineering including benchmarks, automated evals, human review, and regression testing\nFamiliarity with governance, compliance, and responsible AI practices such as PII detection, access control, audit logging, and policy enforcement is a plus\nAbility to work independently alongside existing Tech teams while owning a dedicated agent’s post launch health\nExcellent communication skills to translate production signals into clear, prioritized asks for AI Product and AI Engineering teams\n• Comfort working in a fast evolving environment where the process itself, not just the throughput, is what is being continuously operated on and improved\nCorporate Security Responsibility\nAll activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:\nAbide by Mastercard’s security policies and practices;\n\nEnsure the confidentiality and integrity of the information being accessed;\n\nReport any suspected information security violation or breach, and\n\nComplete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.","description_format":"text","description_chars":4194,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Cards & Card Issuing","Payment Processing & Gateways"],"lifecycle":[{"event":"open","at":"2026-10-07T08:26:37Z"}],"visa":[],"liveness":{"score":78,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.868,"p_room":0.9,"age_days":14,"expected_fill_days":26,"reasons":["conf:3","velocity","win:mid","comp:brand"],"computed_at":"2026-10-22T06:10:10Z"},"pay":null,"html_url":"https://alion.io/job/mastercard-senior-ai-product-ops","json_url":"https://alion.io/job/mastercard-senior-ai-product-ops.json","meta":{"generated_at":"2026-10-22T13:16:41Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12334,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-23T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":252},"rest":"https://alion.io/mcp/rest/get_company?id=252"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmastercard-senior-ai-product-ops"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmastercard-senior-ai-product-ops"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmastercard-senior-ai-product-ops"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/mastercard-senior-ai-product-ops\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmastercard-senior-ai-product-ops"}]}