{"id":4473326,"url":"https://alion.io/job/westjet-senior-analyst-ai-performance-reliability","title":"Senior Analyst, AI Performance & Reliability","company":{"id":1761923,"name":"WestJet","domain":"westjet.com","url":"https://alion.io/company/westjet-com","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Dayforce","truth_index":{"grade":"B","score":80,"open_postings":3,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":15,"computed_at":"2026-11-17T05:47:56Z"}},"role":"Analytics","role_family":"Analytics","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Calgary, Canada"],"countries":["CA"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CAPA","optional":false},{"name":"Incident Management","optional":false},{"name":"Machine Learning","optional":false}],"status":"live","first_seen_at":"2026-11-17T05:00:00Z","employer_posted_date":"2026-11-17","last_verified_at":"2026-11-17T16:56:16Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Position Overview:\nThe Senior Analyst, AI Performance & Reliability is accountable for the health, performance and reliability of AI and machine learning solutions in production. The role monitors AI services and model behaviour, identifies emerging issues, coordinates incident response, and drives improvements that keep solutions stable, available, cost-effective and performing as expected.\nThe role provides ongoing visibility into service availability, latency, errors, usage, cost, data quality and output quality, including model drift and unexpected or inappropriate results. Working closely with AI / ML Developers, Data Scientists, platform teams, business owners, security and governance teams, the role helps ensure production AI and ML solutions can be trusted to operate consistently and recover effectively when issues occur.\nKey Deliverables:\nAccountable for keeping AI and ML solutions reliable, available and performing as expected through effective monitoring, incident management, troubleshooting, service recovery and continuous improvement.\nMonitor AI and ML solutions in production, including availability, latency, errors, throughput, usage, cost, data quality and output quality.\nBuild and maintain dashboards, alerts, health checks and reusable monitoring patterns that provide timely visibility into solution health.\nDetect model drift, data changes, degraded performance, unexpected outputs, harmful or inappropriate responses and other signs of service deterioration.\nWork with business and technical owners to define reliability targets, service expectations, operational thresholds and escalation triggers.\nProduce regular operational reporting and communicate material trends, risks and service issues to appropriate stakeholders.\nLead the investigation, triage and coordination of production incidents affecting AI and ML solutions.\nAssess business and operational impact, establish incident priority, and coordinate response activities across technical and business teams.\nTroubleshoot issues across applications, APIs, models, data pipelines, platforms and infrastructure to identify likely causes and required actions.\nCoordinate with AI / ML Solutions Developers and platform teams when rollbacks, configuration changes, model replacements, fixes or redeployments are required.\nValidate service recovery and confirm that the solution, monitoring controls and outputs are operating as expected.\nConduct post-incident reviews, document root causes and lessons learned, and track corrective and preventive actions to completion.\nMaintain support procedures, runbooks, escalation paths, contact lists and recovery plans.\nIdentify and address risks that could affect solution reliability, availability, performance, resilience or recovery.\nImprove monitoring coverage, alert quality, recovery practices, automation and operational support processes.\nAssess production readiness and confirm that appropriate monitoring, support documentation, escalation processes and recovery procedures are in place before release.\nSupport capacity, performance and cost optimization by identifying constraints, inefficient usage patterns and emerging demand.\nPartner with AI / ML Solutions Developers, Data Scientists and platform teams to prevent repeat incidents and improve solution supportability.\nContribute operational requirements and lessons learned to solution design, testing and lifecycle decisions.\nMonitor model and AI output performance against defined technical, quality and business acceptance measures.\nIdentify changes in source data, knowledge sources, user behaviour or business conditions that may affect solution performance.\nAnalyze feedback, exceptions and performance trends to determine when investigation, correction, tuning or retraining may be required.\nEscalate identified model or output concerns to the accountable solution, model, business and governance owners.\nMaintain traceable records of identified issues, thresholds, findings and follow-up actions.\nMonitor production safeguards and escalate material reliability, privacy, security, responsible AI, model risk or compliance concerns.\nSupport operational evidence, reporting and documentation required for governance reviews, audits and oversight.\nConfirm that access, logging, monitoring and incident-management practices follow approved enterprise requirements.\nHelp define and improve reliability standards, service-health measures, operational controls and reusable monitoring practices.\nPromote consistent incident, problem-management and continuous-improvement practices across AI teams.\nUse monitoring, incident, usage, cost and feedback data to identify opportunities to improve reliability, performance and supportability.\nIdentify recurring issues and coordinate longer-term corrective actions with solution and platform owners.\nShare operational insights, lessons learned and emerging risks with technical teams, business owners and leadership.\nContribute to operational reviews, reliability planning, knowledge sharing and the ongoing maturity of AI / ML operations.\nCommunicate technical issues and service impacts clearly to both technical and non-technical stakeholders.\nExperience and Qualifications:\nBachelor's degree in Computer Science, Engineering, Data Science, Information Systems or a related field, or equivalent practical experience.\nRelevant certifications in cloud platforms, observability, site reliability, IT service management, AI or machine learning are considered an asset.\n4+ years experience supporting production systems, AI solutions, ML platforms, data products or cloud-based services.\nExperience with monitoring, observability, logging, alerting and incident-management tools and practices.\nExperience troubleshooting applications, APIs, data pipelines, infrastructure or distributed cloud services.\nExperience investigating production incidents, coordinating recovery and contributing to root-cause analysis and preventive actions.\nExperience using operational data and service metrics to identify trends, risks and improvement opportunities.\nExperience working with multidisciplinary technology and business teams in a production support environment.\nUnderstanding of model monitoring, drift detection, data quality, AI output evaluation and changing production conditions.\nUnderstanding of reliability, availability, performance, resilience, capacity, recovery and service-management practices.\nKnowledge of service-level indicators, service expectations, operational thresholds and effective alert design.\nAbility to analyze logs, metrics, traces, model results and other technical evidence to diagnose complex issues.\nFamiliarity with cloud platforms, APIs, containers, data pipelines and AI / ML solution architectures.\nFamiliarity with security, privacy, responsible AI, model risk, governance and audit requirements.\nStrong analytical, problem-solving, prioritization and decision-making skills.\nStrong communication, coordination and documentation skills, particularly during high-priority incidents.\nAbility to work calmly and effectively across a matrixed environment when service issues require rapid coordination.\nWhat Success Looks Like\nProduction issues are detected early, assessed accurately and resolved quickly.\nAI and ML solutions consistently meet defined reliability, availability, performance and output-quality expectations.\nModel drift, data-quality issues, unexpected outputs and service degradation are identified before they create significant business impact.\nMonitoring provides clear, actionable visibility into solution health, usage, cost and emerging risk.\nIncident response, escalation and recovery processes are understood, documented and effective.\nRoot causes are addressed and repeat incidents decrease over time.\nOperational risks and material privacy, security, responsible AI or compliance concerns are escalated promptly.\nBusiness users and solution owners can rely on AI and ML services to operate consistently and effectively.\nOperational insights lead to measurable improvements in reliability, resilience, performance and supportability.","description_format":"text","description_chars":8131,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Air Transport"],"lifecycle":[{"event":"open","at":"2026-11-17T16:56:16Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":15,"reasons":["conf:1","win:early"],"computed_at":"2026-11-17T18:11:58Z"},"pay":null,"html_url":"https://alion.io/job/westjet-senior-analyst-ai-performance-reliability","json_url":"https://alion.io/job/westjet-senior-analyst-ai-performance-reliability.json","meta":{"generated_at":"2026-11-17T18:11:58Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":31908,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1761923},"rest":"https://alion.io/mcp/rest/get_company?id=1761923"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fwestjet-senior-analyst-ai-performance-reliability"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fwestjet-senior-analyst-ai-performance-reliability"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fwestjet-senior-analyst-ai-performance-reliability"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/westjet-senior-analyst-ai-performance-reliability\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fwestjet-senior-analyst-ai-performance-reliability"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4473326}},{"tool":"search_jobs","arguments":{"company":"westjet.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4473326},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}