Senior Program Manager, In-Market Testing & Insights

MetaBellevue, WashingtonOn-siteFull-timeStaff, 8–12 yearsListed 3 hours ago

Apply now

About this role

As an International Testing Programs program manager, you will lead in-market testing and insights across Meta's international markets—coordinating in-country validation of product experiences, running scaled multilingual user feedback programs, designing market immersion programs, and applying automation to scale how testing gets delivered.

Meta's products behave differently in the markets we serve than where they were designed. You will shape how experiences are tested across Facebook, Instagram, WhatsApp, Threads, and generative AI products, turning results into recommendations that product and engineering teams act on. The portfolio spans core app experiences, growth, monetization, payments, and commerce—with growing emphasis on AI-powered experiences that require testing approaches beyond conventional QA.

You will partner across product, engineering, QA, marketing, analytics, localization, and external testing partners. If you're excited by building product quality and insights programs at industry-leading international scale, you'll thrive here.

Responsibilities

Coordinate in-country validation of product experiences across Meta's international markets, defining test design, locale coverage, evaluation criteria, and delivery timelines
Run scaled multilingual user feedback programs, managing vendor partnerships to recruit users and gather rapid qualitative feedback across international markets
Design and deliver in-person market immersion programs that give product, marketing, and leadership teams direct, structured exposure to international user feedback
Define coverage and quality metrics for in-market testing programs and report program health to leadership
Apply automation and AI tooling to scale how testing and insights get delivered, including automated synthesis, summarization, and agentic analysis
Shape how product experiences are tested and understood across Meta products
Turn testing results into recommendations that product and engineering teams act on
Lead in-market testing for Meta's AI-powered products, developing methodology for generative and non-deterministic products including rubrics, human-evaluation frameworks, and quality dimensions such as cultural relevance, factual grounding, tone, language quality, and in-locale safety
Partner with marketing, brand, and growth teams to identify in-market testing and insights opportunities that inform campaign localization, launch readiness, and market entry
Contribute to the broader International Testing Programs mission of ensuring Meta's products work as intended in every market we serve
Manage vendor relationships, budgets, and compliance across external testing partners

Qualifications

8+ years of experience in program management, product operations, quality or testing operations, or a related field
Experience designing and managing in-market or functional testing programs for consumer products at scale
Experience managing testing or insights programs delivered through external vendor partners
Experience working with product teams to translate user feedback or testing data into product decisions
Experience with international markets, localization, or global product operations
Demonstrated ability to define program metrics and report program health to leadership
Demonstrated data analysis skills, with the ability to synthesize qualitative and quantitative feedback into clear recommendations Experience building a program from an early or partially-defined state into a repeatable operating model
Experience with unmoderated or moderated feedback collection methodologies at scale
Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
Familiarity with product quality, QA, or in-market testing programs in a large technology company
Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
Background in presenting insights and recommendations to senior product, marketing, and engineering leadership
Experience testing AI-powered products, or building human-evaluation frameworks, rubrics, or red-teaming programs for generative AI experiences
Experience applying AI or large language model tooling to testing and insights workflows, including automated synthesis, summarization, and agentic analysis
Experience managing vendor budgets and contracts, including compliance with contingent workforce policies
Experience partnering with marketing, brand, or go-to-market teams on market insights, launch readiness, or campaign localization
Experience designing and delivering in-person immersion or insights programs across multiple markets
Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies