Program Manager, In-Market Testing & Insights

You will manage vendor partnerships, design testing methodologies, and work with product, engineering, and i18n teams to turn test results into actionable recommendations. The role requires someone comfortable working collaboratively across a shared portfolio, applying automation to improve how testing gets delivered, and operating across multiple product lines and geographies, prioritizing based on impact and deadlines.

The portfolio covers the full range of Meta's products with a growing emphasis on the AI-powered experiences Meta is building. You'll also partner with marketing and GTM teams to connect in-market signals to campaign, launch, and market-entry decisions.

This role suits someone comfortable operating across a shared portfolio, who treats AI as both a subject of testing and a tool for delivering insights faster, and who can manage several product lines and geographies by prioritizing based on impact, deadlines, and stakeholder needs.

Responsibilities

Own in-market testing across the product portfolio - define test design, locale coverage, evaluation criteria, and delivery timelines supporting launch gates and post-launch quality monitoring across Meta's apps, growth, monetization, payments, and commerce surfaces Lead in-market testing for Meta's AI-powered products as a priority growth area of the portfolio, covering Meta AI and AI experiences embedded across FB/IG/Messenger/WhatsApp Develop testing methodology for generative and non-deterministic products - build the rubrics, human-evaluation frameworks, and quality dimensions (cultural relevance, factual grounding, tone, language quality, in-locale safety) that traditional pass/fail testing cannot capture Run the Scaled Insights program - manage vendor partnerships to recruit multilingual users and gather rapid qualitative feedback across international markets Lead the in-person insights portfolio - design and deliver market-immersion programs giving product, marketing, and leadership teams direct, structured exposure to international user feedback; own agenda, market selection, participant recruiting, synthesis, and follow-through Build the bridge to marketing and GTM - partner with marketing, brand, and growth teams to identify in-market testing and insights opportunities that inform campaign localization, launch readiness, and market entry, and to surface local user signal into marketing decisions Turn results into product decisions - partner with product, analytics, and engineering to translate findings into prioritized recommendations aligned to established product and quality frameworks Apply AI to insights delivery - AI-generated summary reports, automated analysis and clustering of test results, cross-market synthesis of qualitative feedback, and agentic workflows that shorten time-to-insight Manage vendors, budgets, and compliance - scoping, performance management, and procurement coordination across testing partners, including contingent workforce policy compliance Contribute to shared program infrastructure - intake, methodology standards, metrics definitions, and deliverable templates used across in-market testing programs Define and report program metrics that demonstrate the value and operational health of the portfolio to leadership

Qualifications

8+ years of experience in program management, product operations, quality/testing operations, or a related field Experience designing and managing in-market or functional testing programs for consumer products at scale Experience managing testing or insights programs delivered through external vendor partners Experience working with product teams to translate user feedback or testing data into product decisions Experience with international markets, localization, or global product operations Experience synthesizing qualitative and quantitative feedback into clear, data-informed recommendations for leadership Experience partnering with marketing, brand, or GTM teams on market insights, launch readiness, or campaign localization Background in presenting insights and recommendations to senior product, marketing, and engineering leadership Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements) Experience designing and delivering in-person immersion or insights programs across multiple markets Experience managing vendor budgets and contracts, including compliance with contingent workforce policies Experience with unmoderated or moderated feedback collection methodologies at scale Experience applying AI/LLM tooling to testing and insights workflows (automated synthesis, summarization, agentic analysis) Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews) Experience testing AI-powered products, or building human-evaluation frameworks, rubrics, or red-teaming programs for generative AI experiences Familiarity with product quality, QA, or in-market testing programs in a large technology company Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies