2,097,009open jobs
128,931companies
243,189added this week
Browse all
Salary
$180k – $240k per year
Location
In office (San Francisco)
Seniority
Staff · 2+ years exp
Visa
H-1B filings in 12 months: 1
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 4, 2026. First seen by Alion on Oct 29, 2026.

Overview
Company
Impact
Profile match
Preference Model is building the next generation of training data to power the future of AI, creating reinforcement learning environments with diverse tasks and robust reward functions for automated ML research engineering. Its founding team previously worked on Anthropic's data team, and its job ads cover members of technical staff in ML capabilities, kernels and infrastructure. The company is headquartered in San Francisco, California, United States.

About Us

Preference Model is a superintelligence data research company. We build RL environments for training capable, better-aligned superintelligences.

Almost every aspect of how a model behaves is shaped by the reward signals it's trained on. The biggest problem with AIs today is that they don't always do what we intend. Sometimes that's because they aren't capable enough, and sometimes it's because they aren't aligned. Both problems come down to the training objectives.

We're trying to address both of these issues in the most direct, highest leverage way available to us, which today means researching how to build RL environments better, not just for the AIs of today but for the AIs as they will be when they outsmart us.

Over the past year, we've built RL environments for several frontier labs, and we're backed by $16M in seed funding led by a16z. Our founding team has previous experience on Anthropic’s data team building data infrastructure, and datasets behind Claude.

About the Role

We're hiring our first Technical Program Manager, GTM. Frontier labs are deciding which RL environment partners to trust with their training runs, and the relationships we build with them now will shape much of where Preference Model goes next. Until now, those relationships have been run by our leadership alongside everything else. You'll be the first person whose full-time job is to own them.

This is a founding role with broad ownership. You will own communication and the relationship with our lab customers across the whole cycle: selling, delivery, scope expansion and contract negotiation. Our platform team owns the technical side of delivery. You'll have a real say in which labs we pursue, how we price our work, and what we build next.

You will help build our GTM playbook and eventually have the opportunity to expand the team.

You will report directly to a co-founder and work onsite in San Francisco alongside leadership, our capabilities team, and our platform team.

Success in this role means projects ship on timelines both sides trust, and the relationships you own are growing into larger engagements.

What You Will Do

  • Own relationships with frontier lab customers. Be their main point of contact, push each relationship forward and grow accounts into larger engagements.

  • Decide with leadership which labs and markets to pursue, and where to focus as the market for RL environments changes.

  • Run the sales cycle: send samples, learn what each lab needs, and turn early conversations into scoped projects.

  • Shape pricing and packaging, and negotiate contracts with our co-founders.

  • Build feedback loops that translate customer feedback into focus areas and priorities.

  • Keep delivery on track with the internal team: set realistic timelines, review purchase orders, and partner with the platform team, which owns technical delivery, so nothing falls between teams.

  • Represent Preference Model publicly through writing, events and the AI community.

  • Build our go-to-market function from scratch: how we sell, scope, contract and deliver, and the playbooks that make it repeatable.

What We are Looking For

  • 0 to 1 experience: You've built something from the ground up: at an early-stage startup, as a founder, or in VC.

  • A technical background: a computer science or closely related technical degree, or previous software engineering experience.

  • External customer-facing experience: for example as a forward deployed engineer, in customer success or operations, as a product manager, or in VC.

  • 2+ years of relevant experience.

  • Experience negotiating commercial terms: customer contracts, pricing, or investment deals.

  • Confidence with senior, technical stakeholders and the follow-through to keep many relationships moving at once. You can push back on unrealistic asks, deliver bad news early, and ensure nothing gets dropped.

Nice to Have:

  • Experience with LLM training or post training strongly preferred.

  • Experience at a frontier AI lab, neo lab, or a neocloud.

  • Experience at a company known for strong customer support

  • Familiarity with RL environments, evals, benchmarks, or post-training data (RLHF, RLVR).

  • You write publicly (a blog, newsletter, or essays) or are active on social media. This is a plus.

You may be a good fit if one of the following applies

  • You started as a software engineer or forward deployed engineer and have since taken on roles that pair technical depth with owning customer outcomes.

  • You have experience with LLM training or post training

  • You founded a company and sold to technical buyers yourself.

  • You've run engagements for frontier lab customers at an AI data, evals, or RL environment company.

What We Offer:

  • Competitive cash and equity compensation

  • Ownership and autonomy in a fast moving startup environment

  • Opportunity to work with top Machine Learning Engineers

  • Health, Vision, Dental, benefits

  • 401K match

  • Lunch provided daily, and a weekly snack order

We value diverse perspectives and experiences. If you're excited about this role but don't check every box, we still encourage you to apply.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,097,009 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Sales
Similar stack
Same company
San Francisco
Remote (United States) · 15+ years exp · United States
Apply
$96k – $151k per year · Remote (United States, Puerto Rico) · Full-Time · 5+ years exp · High School Diploma · United States
Apply
$155k – $195k per year · Hybrid · 10+ years exp · Bachelor's Degree · New York
Design
Adobe Photoshop
Adobe InDesign
Apply
Equity · In office · Full-Time · 5+ years exp · Bachelor's Degree · Milwaukee · Omaha · Alpharetta · Marietta
Apply
$180k – $220k per year · Remote (United States) · 15+ years exp · Bachelor's Degree · United States
Apply
In office · 8+ years exp · Bachelor's Degree · San Francisco
AI/ML
Gemini
Apply
$36k – $96k per year · In office · San Francisco
Apply
In office · Full-Time · San Francisco · Zurich
Python
AI/ML
Reinforcement Learning
Multimodal AI
Knowledge Distillation
VLM
PyTorch
Self-Supervised Learning
Post-training
Pre-training
Vision-Language-Action
World Models
Model Distillation
Robotics
Teleoperation
Imitation Learning
Reinforcement Learning
Apply
$75k – $142k per year · In office · Full-Time · 2+ years exp · Bachelor's Degree · Columbia · San Francisco
AI/ML
AI Agents
Agentforce
Apply
$149k – $260k per year · In office · Full-Time · 4+ years exp · PhD · San Francisco · Washington
Python
Java
C#
C++
Databases
MySQL
PostgreSQL
AI/ML
Claude
Function Calling
AI Agents
LLM
Agentforce
DevOps
ZooKeeper
GCP
Azure
AWS
Docker
Kubernetes
TCP/IP
DNS
Cybersecurity
Threat Modeling
OWASP
Apply
See all jobs
This is one of many
2,097,009 more open roles from verified company boards, updated every day.