{"id":3370469,"url":"https://alion.io/job/microsoft-principal-technical-program-manager-16","title":"Principal Technical Program Manager","company":{"id":18,"name":"Microsoft","domain":"microsoft.com","url":"https://alion.io/company/microsoft","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Eightfold","truth_index":{"grade":"B","score":82,"open_postings":352,"ghost_share":0,"stale_share":0.716,"repost_share":0.003,"time_to_fill_p50_days":29,"computed_at":"2026-10-28T05:59:10Z"}},"role":"Product","role_family":"Product","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Mountain View, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":142800,"max":274800,"currency":"USD","period":"year","gross":null,"usd_annual":274800},"salary_estimate":null,"experience_years_min":12,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Copilot","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"LLM","optional":false},{"name":"Microsoft Office","optional":false},{"name":"Multimodal AI","optional":false},{"name":"Recommender Systems","optional":true}],"status":"live","first_seen_at":"2026-10-16T17:13:55Z","employer_posted_date":"2026-10-27","last_verified_at":"2026-10-28T23:24:59Z","board_verified":true,"closed_at":null,"days_open":12,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":12},"description":"OverviewMicrosoft Search is at the center of AI-powered experiences that help hundreds of millions of users find information, accomplish tasks, and make decisions every day. As search evolves more and more into AI-native experiences, measuring quality becomes one of the most important challenges in the organization.\nWe are looking for an experienced Principal Product Manager to lead the strategy and execution of Bing's offline quality measurement ecosystem. This role sits at the intersection of product management, evaluation science, data science, user research, and engineering.\nYou will define how we measure search quality, relevance, presentation, and competitive performance across Bing and Copilot Search experiences. The metrics and evaluation systems you build will directly influence product investment decisions, experimentation, model launches, and executive scorecards across Microsoft AI Experiences (aix).\nThis is a highly strategic role with broad organizational impact and significant executive visibility.\nMicrosoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.\nStarting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.\nResponsibilities\nDefine the future of quality measurementOwn the long-term vision and roadmap for Bing's offline quality metrics ecosystem.\nDefine measurement strategies for AI-powered search, answer experiences, ranking systems, retrieval, multimodal content, and agentic experiences.\nIdentify gaps in existing quality measurements and drive invention of next-generation metrics.\n\nLead metric design and validationPartner with Data Scientists, Applied Scientists, and Research teams to create robust, trustworthy, and actionable quality metrics.\nDrive metric validation, calibration, and governance frameworks.\nEnsure offline metrics accurately predict user value and align with online outcomes.\n\nBuild organizational alignmentDrive alignment across Search, Copilot, Answer Experiences, Ranking, Ads, Multimedia, and other partner teams.\nInfluence product roadmaps through measurement-based insights.\nServe as the primary point of contact for quality measurement across multiple organizations.\n\nTurn measurement into product insightMove the organization from reporting scores to explaining movement. Build diagnostic frameworks that surface which scenarios, segments, and page configurations drive competitive gaps, and translate those into concrete investment opportunities.\n\nEnable product decision-makingEnsure teams can confidently use measurement systems for product development, experiment evaluation, launch readiness, executive scorecards, competitive tracking, and quality monitoring.\nTranslate complex evaluation concepts into actionable recommendations for engineering and leadership teams.\n\nShape the industryStay at the forefront of advances in search evaluation, LLM evaluation, AI quality measurement, human-in-the-loop evaluation, and synthetic evaluation approaches.\nOpportunity to influence Microsoft's overall approach to AI quality measurement.\n\nQualifications\nRequired Qualifications:\nBachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product developmentOR equivalent experience.\n\n3+ years of experience managing cross-functional and/or cross-team projects.\nPreferred Qualifications:\nBachelor's Degree AND 12+ years experience engineering, product/technical program management, data analysis, or product developmentOR equivalent experience.\n\nExperience defining or operating metrics used for large-scale product decisions.\nDemonstrated ability to lead cross-functional initiatives across multiple teams.\nSolid analytical and quantitative problem-solving skills.\nExcellent communication and stakeholder management abilities.\nExperience in search, recommendation systems, ranking, AI products, or large-scale consumer experiences.\nExperience building evaluation frameworks for LLMs, retrieval systems, or generative AI applications.\nFamiliarity with offline evaluation methodologies and human rating systems\nExperience partnering with Data Science, Applied Science, and Research organizations.\nProven success driving strategy in ambiguous and rapidly evolving technical domains.\n#metrics\n#bing\n#search\n#quality\nTechnical Program Management IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.\nCertain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:\nhttps://careers.microsoft.com/us/en/us-corporate-pay\nThis position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.\nMicrosoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.","description_format":"text","description_chars":6253,"description_truncated":false,"requirements":{"experience_years_min":12,"management_years_min":3,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Console Games","Cloud Platforms (IaaS & PaaS)","Gaming Consoles","Developer Tools"],"lifecycle":[{"event":"open","at":"2026-10-28T00:41:33Z"}],"visa":[],"liveness":{"score":60,"band":"ok","label":"Likely open","p_open":1,"p_active":0.668,"p_room":0.9,"age_days":11,"expected_fill_days":29,"reasons":["conf:0","stale_co","wave","velocity","win:mid","comp:brand"],"computed_at":"2026-10-28T05:59:10Z"},"pay":{"stated_usd_annual":274800,"is_top_pay":true},"html_url":"https://alion.io/job/microsoft-principal-technical-program-manager-16","json_url":"https://alion.io/job/microsoft-principal-technical-program-manager-16.json","meta":{"generated_at":"2026-10-28T23:31:57Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":32199,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-29T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":18},"rest":"https://alion.io/mcp/rest/get_company?id=18"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmicrosoft-principal-technical-program-manager-16"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmicrosoft-principal-technical-program-manager-16"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmicrosoft-principal-technical-program-manager-16"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/microsoft-principal-technical-program-manager-16\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmicrosoft-principal-technical-program-manager-16"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3370469}},{"tool":"search_jobs","arguments":{"company":"microsoft.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3370469},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}