2,439,294open jobs
150,169companies
296,285added this week
Browse all
Salary
$167k – $185k per year
Location
In office (San Francisco)
Seniority
Senior · 8+ years exp
Visa
H-1B filings in 12 months: 834 · green card filings: 308

Confirmed on the employer's own hiring board on Nov 20, 2026. First seen by Alion on Nov 20, 2026. Uber scores A on the Alion truth index.

Overview
Company
Impact
Profile match
Uber is an American mobility and delivery company founded in San Francisco in 2009 that connects independent drivers and couriers with riders and customers through its apps. It operates ride hailing in thousands of cities, a food and grocery delivery business built on the same courier network, a freight brokerage matching shippers with carriers, and an advertising business that sells placement inside those apps. Listed on the New York Stock Exchange since 2019, the company reached sustained profitability in the mid 2020s and now partners with autonomous vehicle developers rather than building self-driving technology itself.

About the Role

Uber is looking for a Senior Program Manager, Tech (L5) to lead LLM quality and evaluation programs across multilingual products and AI-powered experiences. You will define how we measure model quality, identify failures, and determine whether AI solutions are ready for production.

Working across Engineering, LLMOps within the Localization Technology team, Multilingual Program manager, Product, and vendors, you will build, assess or improve the existing evaluation frameworks that validate model performance by language, market, content type, cultural nuance, and audiences. This role requires strong technical fluency in LLM behavior, understanding NLP, and the program leadership to turn evaluation findings into measurable improvements.

What You’ll Do

  • Own the LLM quality and evaluation roadmap. Define program goals, milestones, dependencies, success metrics, and release criteria across models and use cases.
  • Build scalable evaluation frameworks. Establish statistically defensible methods to assess accuracy such as recall and precision, relevance, completeness, instruction following, linguistic quality, and cultural appropriateness.
  • Develop high-quality evaluation datasets. Lead the creation, annotation, adjudication, versioning, and maintenance of golden datasets that represent real user needs, challenging scenarios, and multilingual requirements.
  • Evaluate model and system failures. Partner with technical teams to assess hallucinations, prompt-injection susceptibility, unsupported claims, context loss, and inconsistent outputs. Evaluate retrieval-augmented generation (RAG) for retrieval relevance, groundedness, and citation accuracy.
  • Lead human and automated evaluation. Establish reviewer guidelines, calibrate LLM-as-a-judge systems against expert assessments, and measure agreement, false positives, false negatives, and severity classification.
  • Drive model fitness decisions. Collaborating with LLMOpn in the Localization Technology team to compare models and configurations by locale, task, quality, cost, and latency to inform model selection, routing, and deployment.
  • Close the quality improvement loop. Translate findings into prioritized improvements to prompts, retrieval, terminology, workflows, and model configurations. Partner with owners to verify fixes and prevent regressions.
  • Operationalize continuous quality monitoring. Establish regression testing, production sampling, quality dashboards, escalation processes, and ongoing evaluation as models and user needs evolve.
  • Lead cross-functional execution. Clarify ownership, resolve dependencies, communicate risks, and align stakeholders on quality tradeoffs and launch readiness.

Basic Qualifications

  • Minimum 5 years of professional experience in program management within a high-growth technology or large-scale enterprise environment.
  • Bachelor’s degree in Business Operations, Engineering, or a related field; or equivalent professional experience.

Preferred Qualifications

  • 8+ years of professional experience in program management within a high-growth technology or large-scale enterprise environment.
  • Experience leading complex technical programs involving AI/ML, software platforms, quality engineering, or data-driven products.
  • Demonstrated ability to deliver cross-functional programs with Engineering, Localization team, Data Scientist, Product, and Operations.
  • Working understanding of LLM capabilities and limitations, including hallucinations, prompt engineering, prompt injection, RAG, context management, and tool use.
  • Experience designing quality metrics, evaluation methodologies, human-review workflows, or experimental programs.
  • Ability to interpret statistical results, assess dataset quality, and communicate the limitations of evaluation findings to leaderships and LLMOps.
  • Strong analytical, stakeholder management, and written communication skills, with the ability to turn ambiguous requirements into executable plans.
  • Experience evaluating multilingual LLMs, machine translation, conversational AI, or localization quality.
  • Familiarity with MQM-based evaluation, terminology governance, and market-specific linguistic requirements.
  • Experience with LLM evaluation platforms, automated regression pipelines, and production observability.
  • Familiarity with SQL, Python, APIs, and data pipelines sufficient to investigate results and collaborate effectively with technical teams.
  • Experience evaluating multimodal systems, including text, image, audio, or video.
  • Experience establishing quality standards and launch criteria for AI systems operating at scale.

For Sunnyvale/San Francisco, CA-based roles: The base salary range for this role is USD $167,000 per year - USD $185,000 per year.

You will be eligible to participate in Uber's bonus program, and may be offered an equity award & other types of comp. All full-time employees are eligible to participate in a 401(k) plan. You will also be eligible for various benefits.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,439,294 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Management
Remote, many countries
Similar stack
Same company
San Francisco
Project Manager 1 hour ago
$79k – $113k per year · In office · Full-Time · 5+ years exp · Bachelor's Degree · Greenville
Apply
$135k – $142k per year · In office · 5+ years exp · Bachelor's Degree · San Mateo
DevOps
Incident Management
Apply
$116k – $160k per year · Equity · In office · Full-Time · 5+ years exp · Master's Degree · Seattle
AI/ML
Machine Learning
Apply
$127k – $172k per year · Equity · In office · TS/SCI · Full-Time · 3+ years exp · Bachelor's Degree · Arlington · Seattle · Herndon
Python
SQL
DevOps
AWS
Management
SharePoint
Kanban
Apply
$163k – $185k per year · Equity · In office · Full-Time · 5+ years exp · Bachelor's Degree · San Francisco
SQL
Apply
Remote (Argentina, Brazil, Colombia, Mexico, Chile) · Full-Time · Bachelor's Degree · Buenos Aires · Santiago · Bogotá · Mexico City
Apply
Remote (AMER, Europe) · Cofounder · United Kingdom
Apply
Remote (AMER, Europe) · Cofounder · Leipzig
Apply
Remote (AMER, Europe) · Cofounder · Athens
Apply
Remote (AMER, Europe) · Cofounder · Stockholm
Apply
Founding Sales 6 hours ago
$150k – $300k per year · Equity 0.1–0.5% · In office · Full-Time · 3+ years exp · San Francisco
Apply
Executive Director 8 hours ago
In office · 8+ years exp · San Francisco
Apply
Customer Engineer 2 hours ago
$115k – $130k per year · Equity 0.1–0.2% · In office · Full-Time · San Francisco
Apply
In office · 2+ years exp · Master's Degree · San Francisco
Apply
In office · 1+ year exp · High School Diploma · San Francisco
Apply
See all jobs
This is one of many
2,439,294 more open roles from verified company boards, updated every day.