Senior Product Manager - AI Quality

About the Role

As a Product Manager on the Customer Obsession (CO) team, you will help define the future of agentic Conversational AI at Uber. This role sits at the heart of how we build, test, and scale intelligent agents, working across AI reasoning, evaluation infrastructure, and platform tools that empower our next-generation AI assistants to interact, adapt, and learn in complex support environments.

We’re looking for someone with strong product management fundamentals and practical experience building AI /LLM products - whether that’s in agents, platforms, model evaluation, or intelligent tools. You should be excited by the challenge of making AI work in real-world, high-scale customer settings and building the infrastructure that enables others to move fast with confidence.

What the Candidate Will Need / Bonus Points

---- What the Candidate Will Do ----

• Product Thinking: Own roadmaps and prioritize work that balances long-term platform investments with short-term needs from various product teams - ensuring alignment with company objectives.
• Customer Focus: Advocate for the end-user by integrating design thinking and user research, ensuring AI products deliver delightful experiences.
• Execution & Ownership: Deeply engage with AI engineering teams to align and execute the product strategy for platform capabilities that improve how AI agents are evaluated, understood, and launched-including testing frameworks, benchmarking infrastructure, and observability tools.
• Data-Driven Decisions: Utilize data to prioritize features, make informed trade-offs, and continually enhance product performance.
• Cross-functional leadership: Work closely with engineering, AI/ML, and data science teams to design scalable systems that improve iteration speed and reliability across conversational AI products.
• Executive Communication: Present clear and compelling progress updates to senior leadership, aligning stakeholders and securing support.

---- Basic Qualifications ----

• Experience: 5+ years of product management experience, including 2+ years working on AI/ML or LLM-driven tech - either in platforms, tools, conversational AI, or intelligent applications.
• Bachelor's degree or equivalent.
• AI & Technical Fluency: Strong understanding of large language models, AI agent patterns, and ML workflows. You don’t need to train models, but you know how they work, how to test them, and how to build great products on top of them.
• Track Record: Demonstrated ability to ship technical products with cross-functional teams. You’ve taken complex systems from concept to launch, especially in ambiguous or fast-moving environments.
• Communication: Exceptional ability to articulate complex AI concepts and product strategies to various audiences, from engineers to senior executives. Experience in crafting executive-level presentations that convey product vision, progress, and business impact.

---- Preferred Qualifications ----

• Experience working on LLM evaluations, simulations, building AI agents and/or ML workflows. Strong understanding of large language models, how they work and how to best measure quality of AI agents
• Fluency with Claude Code/Cursor