368,634open jobs
9,437companies
50,578added this week
Browse all
Salary
$187k – $379k per year (Estimated)
Location
In office (San Francisco)
Seniority
Staff
Employment
Full-Time
Overview
Company
Impact
Profile match
The world’s most realistic model evaluations. Trusted by the leading frontier labs.

Why join Intelligence

Mission: Give every human superintelligence, and make superintelligence more human.

Intelligence is the product lab company behind DesignArena - 5.2M+ users in 8 months, leaderboard referenced by Andrew Ng, Elon Musk, Demis Hassabis, and more. The team is incredibly talent-dense (11 from Harvard + Berkeley), backed by Tier 1 VC Index Ventures, YC, SV Angel, Lenny Rachitsky, Paul Graham, Figma Ventures, and one of the fastest-growing seed-stage startups in SF.

Behind closed doors, we see what the models can do six months before the world does. We are trusted by the best frontier model providers like OpenAI to rigorously evaluate the capabilities of state-of-the-art multimodal models across design, web dev, game dev, image, video, audio, slide generation, and more, through the large-scale platforms that we’ve built.

Design Arena, our flagship product, is the most referenced benchmark for AI-generated visuals, and is powered by over 5.3M+ authentic users across 192 countries. Prediction Arena was the first time models traded autonomously with real cash on real-time, real-world events. Social Arena tested whether AI models can effectively grow and engage audiences on X by having them operate as independent social media agents.

Role

You'll invent new ways to detect and scale the data that makes frontier AI models smarter. As frontier models continue to improve, model capability is increasingly driven by the quality of training data. You'll develop scalable systems that generate, curate, and improve high-quality supervision across coding, multimodal, and agentic tasks.

In this role, you also have an opportunity to be forward-deployed should it interest you, and work directly with the researchers at frontier labs to creatively scale new model capability strategies for improvement.

What You’ll Own

  • Train and improve preference, reward, and ranking models from millions of human interactions

  • Develop infrastructure for large-scale experimentation, model training, and specialize in online evaluation techniques

  • Design systems that transform human preference data into reliable signals for downstream model evaluation and training

What We’re Looking For

  • Data-pilled. Understand that data quality is the real bottleneck to superintelligence.

  • Strong STEM background. You studied Computer Science, Machine Learning, Data Science, Statistics, Math, Engineering, Physics, or a related field.

  • Experience building ML systems. You've trained preference models, built data pipelines, or worked on ML infrastructure that runs in production.

  • Interested in how AI learns from human feedback. You're excited by solving problems at the intersection of human-model interaction.

Details

  • Location: San Francisco, Levi’s Plaza. We sponsor visas and handle relocation.

  • Work Schedule: Sunday-Friday. Saturdays are yours!

  • Compensation: Competitive salary + meaningful equity. You'd be joining at the stage when ownership matters most.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,634 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
San Francisco
Founding Engineer 1 day ago
$180k – $250k per year • In office • Full-Time • 3+ years exp • New York
Node JS
Python
TypeScript
JavaScript
Node JS
BullMQ
Databases
Redis
AI/ML
AI Agents
LangGraph
LLM
Multimodal AI
LangChain
Anthropic
Deepgram
LiveKit
LLM Guardrails
OpenAI
Text-to-Speech
Frontend
Next.js
React.js
DevOps
Vercel
Apply
UX Designer 1 day ago
$17k – $51k per year (Estimated) • In office • Full-Time • 3+ years exp • Bengaluru
Design
Figma
Apply
$90k – $115k per year • Remote • Full-Time • 8+ years exp
AI/ML
Runway
Design
Adobe After Effects
Adobe Photoshop
Figma
Apply
UI/UX Designer 1 day ago
$12k – $55k per year (Estimated) • Remote • Full-Time
AI/ML
Claude
LLM
LLM Guardrails
Lovable
Design
Figma
Apply
Motion Designer 1 day ago
Remote • Full-Time
Design
Adobe After Effects
Adobe Premiere Pro
Canva
Figma
Apply
$187k – $379k per year (Estimated) • In office • Full-Time • San Francisco
AI/ML
Multimodal AI
OpenAI
Design
Figma
Apply
$187k – $379k per year (Estimated) • In office • Full-Time • San Francisco
AI/ML
Multimodal AI
OpenAI
Design
Figma
Apply
$180k – $210k per year • Equity • In office • Full-Time • San Francisco
Node JS
JavaScript
Databases
PostgreSQL
DevOps
PagerDuty
Web3
TRM Labs
Management
Slack
Apply
$252k – $335k per year • Remote/Hybrid • Full-Time • 8+ years exp • San Francisco
AI/ML
ChatGPT
Human-in-the-Loop
OpenAI
OpenAI Codex
DevOps
SLI/SLO/SLA
Apply
$223k – $424k per year (Estimated) • In office • Bachelor's Degree • San Francisco
AI/ML
AI Agents
LLM
Recommender Systems
Apply
$160k – $283k per year • Equity • In office • 5+ years exp • San Francisco
AI/ML
AI Agents
Apply
$185k – $385k per year • Remote/Hybrid • Full-Time • 5+ years exp • San Francisco
JavaScript
Python
Databases
MySQL
PostgreSQL
AI/ML
OpenAI
Frontend
React.js
Apply
See all jobs
This is one of many
368,634 more open roles from verified company boards, updated every day.