1,161,622open jobs
13,727companies
227,717added this week
Browse all
Location
In office (San Francisco)
Seniority
Staff · 7+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match
Physical Intelligence is a San Francisco research company founded in 2024 that is building general-purpose foundation models for robots. Its flagship models are trained on data from many robot embodiments and tasks, aiming for a single policy that can be adapted to new hardware and chores. The company raised very large early rounds from investors including OpenAI, Jeff Bezos and Thrive Capital.

Physical Intelligence is bringing general-purpose AI into the physical world. We are a group of engineers, scientists, roboticists, and company builders developing foundation models and learning algorithms to power the robots of today and the physically-actuated devices of the future.

The role

We're looking for a Data Annotation Lead to own annotation operations and scale the team behind it. Annotation is core to how our models improve, and demand is growing fast. You will scale the annotation workforce from 100s to 1,000s while raising the quality bar - designing the org, the training pipeline, the quality system, and the metrics that let it scale efficiently.

You will own the people and the operation: throughput, quality, cost, and delivery across every annotation type.

In this role you will

  • Own annotation operations end-to-end: throughput, quality, cost, and on-time delivery across all annotation types.

  • Scale the annotation workforce from 100s to 1,000s: workforce planning, org design, and the hiring and onboarding funnel.

  • Build and lead a multi-layer management structure; hire, develop, and manage managers and team leads.

  • Scale throughput with autolabeling and model-based annotation: design human-in-the-loop workflows where models pre-label and annotators review, correct, and escalate, so output grows faster than headcount.

  • Stand up the training and certification pipeline that brings new annotators and teams to the quality bar quickly and consistently.

  • Define and continuously raise the quality bar: rubrics, calibration, audit/QA loops, and quality-adjusted productivity.

  • Establish operational metrics and reporting (presence, throughput, acceptance/rejection, rework) and drive week-over-week improvement.

  • Run capacity planning and prioritization against competing demand; allocate teams to the highest-impact work.

  • Manage performance at scale with clear standards, feedback, and a fair improvement/exit process.

  • Partner with product and engineering to define annotation tooling that unlocks throughput and quality.

  • Partner with research and project leads to translate annotation needs into clear instructions, rubrics, and SLAs.

  • Own the in-house vs. vendor mix and manage external partners where used.

  • Own the annotation operating budget and unit economics; improve cost-per-annotation while protecting quality.

What you'll bring

  • 7+ years leading scaled data or annotation operations, including teams in the 100s+.

  • 3+ years as a manager of managers.

  • Track record standing up 0→1 annotation programs.

  • Deep command of annotation best practices, operations, and strategy.

  • Experience integrating autolabeling and model-based annotation into human workflows; building human-in-the-loop pipelines that raise throughput without sacrificing quality.

  • Fluency with operational and quality metrics; data-driven management of large workforces.

  • Strong cross-functional partnership with product, engineering, and research/ML.

  • Clear written and verbal communication; able to set and hold standards across a large, distributed team.

  • Working understanding of ML and why annotation quality drives model performance.

Nice to have

  • Experience in robotics, autonomous vehicles, or frontier-AI data pipelines.

  • Experience managing distributed/global and/or vendor workforces.

  • Built annotation tooling or partnered tightly with a tooling team.

  • Experience training or fine-tuning autolabeling models, or partnering closely with the ML teams that do.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,161,622 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
San Francisco
$98k – $163k per year • Remote/Hybrid • 15+ years exp • High School Diploma • Ashburn
SQL
Python
Python
FastAPI
Databases
ElasticSearch
Milvus
OpenSearch
pgvector
Pinecone
Qdrant
Weaviate
PostgreSQL
AI/ML
Agentic Workflows
AI Agents
Embeddings
Feature Store
Fine-tuning
Function Calling
Gemini
Hallucination
Human-in-the-Loop
Hybrid Search
LangChain
Llama
LlamaIndex
LLM
LoRA
Mistral
Multi-Agent Systems
Multimodal AI
Ollama
Prompt Engineering
PyTorch
RAG
Reranking
Structured Outputs
TensorRT
TensorRT-LLM
Tokenization
Tool Use
PEFT
DevOps
AWS
Azure
CI/CD
Docker
GCP
Kubernetes
Apply
$116k – $195k per year • Remote/Hybrid • 15+ years exp • High School Diploma • Ashburn
SQL
Python
Python
FastAPI
Databases
ElasticSearch
Milvus
OpenSearch
pgvector
Pinecone
Qdrant
Weaviate
PostgreSQL
AI/ML
Agentic Workflows
AI Agents
Embeddings
Feature Store
Fine-tuning
Function Calling
Gemini
Hallucination
Human-in-the-Loop
Hybrid Search
LangChain
Llama
LlamaIndex
LLM
LoRA
Mistral
Multi-Agent Systems
Multimodal AI
Ollama
Prompt Engineering
PyTorch
RAG
Reranking
Structured Outputs
TensorRT
TensorRT-LLM
Tokenization
Tool Use
PEFT
DevOps
AWS
Azure
CI/CD
Docker
GCP
Kubernetes
Apply
Sr. Legal Engineer 2 hours ago
In office
AI/ML
Agentic Workflows
AI Agents
Claude
Function Calling
Human-in-the-Loop
Model Context Protocol
RAG
Structured Outputs
Tool Use
Apply
$129k – $250k per year (Estimated) • In office • 5+ years exp • PhD • Houston
Python
SQL
Databases
OpenSearch
pgvector
Pinecone
PostgreSQL
AI/ML
AI Agents
Fine-tuning
Function Calling
Human-in-the-Loop
Knowledge Graph
LangChain
LangGraph
LlamaIndex
LLM
LLM Guardrails
LLMOps
Multi-Agent Systems
Prompt Engineering
RAG
Semantic Search
Semantic Search
Tool Use
DevOps
Amazon ECS
AWS
Azure
Docker
GCP
Kubernetes
Vector
Apply
$130k – $160k per year • In office • Full-Time • 10+ years exp • Bachelor's Degree • San Francisco
Node JS
Python
TypeScript
JavaScript
AI/ML
Human-in-the-Loop
LLM
Frontend
React.js
Mobile
React Native
Cybersecurity
GDPR
Marketing
Shopify
Apply
$167k – $364k per year (Estimated) • In office • Full-Time • San Francisco
Databases
ClickHouse
AI/ML
Flink
Multimodal AI
Ray
Apply
$158k – $345k per year (Estimated) • In office • Full-Time • San Francisco
AI/ML
JAX
Multimodal AI
PyTorch
TPU
DevOps
AWS
GCP
Google GKE
Kubernetes
SLURM
Apply
$174k – $314k per year (Estimated) • In office • Full-Time • 5+ years exp • San Francisco
AI/ML
Multimodal AI
Apply
Shift Lead 15 days ago
In office • Full-Time • 3+ years exp • Bachelor's Degree • San Francisco
Apply
$148k – $303k per year (Estimated) • In office • Full-Time • San Francisco
Python
TypeScript
JavaScript
Databases
ClickHouse
PostgreSQL
AI/ML
Human-in-the-Loop
Frontend
React.js
DevOps
GCP
Kubernetes
Apply
Founding AE 1 day ago
$130k – $180k per year • Equity 0.2–1% • Remote • Full-Time • 3+ years exp • San Francisco
DevOps
GitHub
Apply
$72k – $120k per year • In office • Internship • San Francisco
Apply
AI/SWE Intern 1 day ago
$36k – $120k per year • In office • Internship • San Francisco
JavaScript
Python
TypeScript
AI/ML
Computer Vision
Frontend
React.js
Apply
$120k – $180k per year • Equity 0.1–0.4% • In office • Full-Time • San Francisco
Python
JavaScript
Frontend
React.js
Apply
$120k – $180k per year • Equity 0.1–0.4% • In office • Full-Time • San Francisco
AI/ML
Computer Vision
LLM
Multimodal AI
Apply
See all jobs
This is one of many
1,161,622 more open roles from verified company boards, updated every day.