{"id":4704151,"url":"https://alion.io/job/uber-senior-program-manager-tech","title":"Senior Program Manager, Tech","company":{"id":230,"name":"Uber","domain":"uber.com","url":"https://alion.io/company/uber","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":{"grade":"A","score":87,"open_postings":161,"ghost_share":0.031,"stale_share":0.615,"repost_share":0.075,"time_to_fill_p50_days":15,"computed_at":"2026-11-20T05:46:30Z"}},"role":"Management","role_family":"Management","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":167000,"max":185000,"currency":"USD","period":"year","gross":null,"usd_annual":185000},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"LLM","optional":false},{"name":"LLMOps","optional":false},{"name":"NLP","optional":false},{"name":"RAG","optional":false},{"name":"Function Calling","optional":true},{"name":"Multimodal AI","optional":true},{"name":"Prompt Engineering","optional":true},{"name":"Python","optional":true},{"name":"SQL","optional":true}],"status":"live","first_seen_at":"2026-11-20T10:47:00Z","employer_posted_date":"2026-11-20","last_verified_at":"2026-11-20T16:45:03Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About the Role\nUber is looking for a Senior Program Manager, Tech (L5) to lead LLM quality and evaluation programs across multilingual products and AI-powered experiences. You will define how we measure model quality, identify failures, and determine whether AI solutions are ready for production.\nWorking across Engineering, LLMOps within the Localization Technology team, Multilingual Program manager, Product, and vendors, you will build, assess or improve the existing evaluation frameworks that validate model performance by language, market, content type, cultural nuance, and audiences. This role requires strong technical fluency in LLM behavior, understanding NLP, and the program leadership to turn evaluation findings into measurable improvements.\nWhat You’ll Do\nOwn the LLM quality and evaluation roadmap. Define program goals, milestones, dependencies, success metrics, and release criteria across models and use cases.\nBuild scalable evaluation frameworks. Establish statistically defensible methods to assess accuracy such as recall and precision, relevance, completeness, instruction following, linguistic quality, and cultural appropriateness.\nDevelop high-quality evaluation datasets. Lead the creation, annotation, adjudication, versioning, and maintenance of golden datasets that represent real user needs, challenging scenarios, and multilingual requirements.\n Evaluate model and system failures. Partner with technical teams to assess hallucinations, prompt-injection susceptibility, unsupported claims, context loss, and inconsistent outputs. Evaluate retrieval-augmented generation (RAG) for retrieval relevance, groundedness, and citation accuracy.\nLead human and automated evaluation. Establish reviewer guidelines, calibrate LLM-as-a-judge systems against expert assessments, and measure agreement, false positives, false negatives, and severity classification.\nDrive model fitness decisions. Collaborating with LLMOpn in the Localization Technology team to compare models and configurations by locale, task, quality, cost, and latency to inform model selection, routing, and deployment.\nClose the quality improvement loop. Translate findings into prioritized improvements to prompts, retrieval, terminology, workflows, and model configurations. Partner with owners to verify fixes and prevent regressions.\nOperationalize continuous quality monitoring. Establish regression testing, production sampling, quality dashboards, escalation processes, and ongoing evaluation as models and user needs evolve.\nLead cross-functional execution. Clarify ownership, resolve dependencies, communicate risks, and align stakeholders on quality tradeoffs and launch readiness.\nBasic Qualifications\nMinimum 5 years of professional experience in program management within a high-growth technology or large-scale enterprise environment.\nBachelor’s degree in Business Operations, Engineering, or a related field; or equivalent professional experience.\nPreferred Qualifications\n8+ years of professional experience in program management within a high-growth technology or large-scale enterprise environment.\nExperience leading complex technical programs involving AI/ML, software platforms, quality engineering, or data-driven products.\nDemonstrated ability to deliver cross-functional programs with Engineering, Localization team, Data Scientist, Product, and Operations.\nWorking understanding of LLM capabilities and limitations, including hallucinations, prompt engineering, prompt injection, RAG, context management, and tool use.\nExperience designing quality metrics, evaluation methodologies, human-review workflows, or experimental programs.\nAbility to interpret statistical results, assess dataset quality, and communicate the limitations of evaluation findings to leaderships and LLMOps.\nStrong analytical, stakeholder management, and written communication skills, with the ability to turn ambiguous requirements into executable plans.\nExperience evaluating multilingual LLMs, machine translation, conversational AI, or localization quality.\nFamiliarity with MQM-based evaluation, terminology governance, and market-specific linguistic requirements.\nExperience with LLM evaluation platforms, automated regression pipelines, and production observability.\nFamiliarity with SQL, Python, APIs, and data pipelines sufficient to investigate results and collaborate effectively with technical teams.\nExperience evaluating multimodal systems, including text, image, audio, or video.\nExperience establishing quality standards and launch criteria for AI systems operating at scale.\n For Sunnyvale/San Francisco, CA-based roles: The base salary range for this role is USD $167,000 per year - USD $185,000 per year.\nYou will be eligible to participate in Uber's bonus program, and may be offered an equity award & other types of comp. All full-time employees are eligible to participate in a 401(k) plan. You will also be eligible for various benefits.","description_format":"text","description_chars":4954,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":8,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Delivery","Freight Forwarding","Online Groceries","Ride Hailing"],"lifecycle":[{"event":"open","at":"2026-11-20T16:45:03Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 834 · green card filings: 308","filings_12m":834,"filings_prev_12m":867,"green_card_filings_12m":308,"median_offered_wage_usd":186712,"route":null,"cap_exempt":false,"checked_at":"2026-11-20T07:30:35+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":0}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":15,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-20T17:57:39Z"},"pay":{"stated_usd_annual":185000,"is_top_pay":true},"html_url":"https://alion.io/job/uber-senior-program-manager-tech","json_url":"https://alion.io/job/uber-senior-program-manager-tech.json","meta":{"generated_at":"2026-11-20T17:57:39Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":22478,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":230},"rest":"https://alion.io/mcp/rest/get_company?id=230"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fuber-senior-program-manager-tech"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fuber-senior-program-manager-tech"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fuber-senior-program-manager-tech"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/uber-senior-program-manager-tech\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fuber-senior-program-manager-tech"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4704151}},{"tool":"search_jobs","arguments":{"company":"uber.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4704151},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}