2,406,540open jobs
149,823companies
297,031added this week
Browse all
Salary
$260k – $290k per year
Location
In office (San Francisco)
Seniority
Junior · 1+ year exp
Visa
Sponsorship offered in the posting
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 19, 2026. First seen by Alion on Nov 19, 2026.

Overview
Company
Impact
Profile match
True Talent Solutions Partners is a recruitment firm based in San Francisco, California, that fills roles for technology startups and venture-backed companies. It recruits for software and forward deployed engineers, product engineers, account executives and some legal and executive positions. Most of its client vacancies are in San Francisco and New York, with others in Redwood City, Austin and elsewhere in the United States.

About the Role

Build datasets, evaluation rubrics, and infrastructure that help improve advanced AI models. You will work with research teams to run experiments, identify model failure modes, and turn training objectives into practical data and evaluation systems.

What You'll Do

  • Design data slices that reveal meaningful model failure modes across finance, code, and enterprise workflows.

  • Build and refine evaluation rubrics and reward signals for RLHF and RLVR pipelines.

  • Model annotator behavior and run experiments to improve model capabilities.

  • Develop quantitative measures of dataset quality, diversity, and impact on model alignment and capabilities.

  • Create and manage real-world and synthetic data pipelines.

  • Partner with AI research teams to translate training goals into concrete data and evaluation specifications.

What We're Looking For

  • One to four years of software engineering experience building reliable data pipelines, experimentation infrastructure, or evaluation systems.

  • Strong Python skills and experience shipping software and infrastructure.

  • Hands-on experience with LLM evaluations, model post-training, reward modeling, RLHF, RLVR, or related ML infrastructure.

  • Experience creating or evaluating datasets, including assessing quality, diversity, coverage, and downstream model performance.

  • Strong experimental judgment: able to form hypotheses, define metrics, design controlled experiments, and interpret noisy results.

  • Experience designing data collection strategies and evaluation rubrics for machine learning models.

Compensation & Benefits

Base salary: $260,000 to $290,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,406,540 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Remote, many countries
Similar stack
Same company
San Francisco
In office · 3+ years exp · Bachelor's Degree · Cupertino
JavaScript
TypeScript
Databases
PostgreSQL
Cassandra
Frontend
Vue.js
React.js
Apply
$180k – $250k per year · Equity · In office · Full-Time · 3+ years exp · San Francisco
JavaScript
TypeScript
Databases
Databricks
AI/ML
Multimodal AI
Frontend
React.js
DevOps
Kubernetes
Apply
$78k – $176k per year · In office · Full-Time · 3+ years exp · Bachelor's Degree · McLean
Databases
Databricks
AI/ML
AI Agents
Anomaly Detection
Machine Learning
Analytics
ETL/ELT
Management
Oracle ERP
Apply
Software Engineer 18 days ago
$69k – $158k per year · In office · Secret · Full-Time · 2+ years exp · Bachelor's Degree · Lexington
Python
JavaScript
PHP
C#
C++
Node JS
PHP
Drupal
C#
.NET
Frontend
React.js
DevOps
CI/CD
Jenkins
Docker
Kubernetes
GitLab
Management
Agile
Scrum
Kanban
Apply
$69k – $158k per year · In office · Public Trust · Full-Time · 3+ years exp · Bachelor's Degree · McLean
JavaScript
Java
TypeScript
Java
Spring Boot
AI/ML
Claude
Frontend
Angular
React.js
DevOps
Rest API
CI/CD
Git
AWS
Cybersecurity
Okta
Management
Agile
Apply
Remote (likely EAEU) · 5+ years exp
PHP
PHP
Symfony
Xdebug
DevOps
Rest API
Git
Docker
Apply
Remote (likely EAEU) · Moscow
SQL
C#
1C
C#
.NET
Management
Directum
Apply
Remote (EAEU) · 3+ years exp · Rostov-on-Don
Python
JavaScript
PHP
TypeScript
SQL
Node JS
PHP
Bitrix
Databases
PostgreSQL
AI/ML
Claude
Claude Code
Model Context Protocol
LLM
RAG
OpenAI
Frontend
React.js
DevOps
Rest API
CI/CD
Git
Docker
GitHub
Analytics
ETL/ELT
Metabase
Superset
Management
n8n
Apply
Remote (likely EAEU) · 2+ years exp · Moscow
Python
SQL
Python
FastAPI
Databases
Apache Kafka
AI/ML
Model Context Protocol
AI Agents
DevOps
CI/CD
Docker
Kubernetes
Apply
AI Product Engineer 12 hours ago
Remote (EAEU) · Almaty
JavaScript
TypeScript
Node JS
Node JS
Nest.JS
Databases
PostgreSQL
Redis
RabbitMQ
AI/ML
Claude Code
Model Context Protocol
Frontend
React.js
Apply
$225k – $330k per year · Equity · In office · Full-Time · 5+ years exp · San Francisco
AI/ML
Computer Vision
Machine Learning
Apply
$170k – $220k per year · Equity 1–2.8% · In office · Full-Time · 3+ years exp · San Francisco
Python
SQL
Python
Django
AI/ML
AI Agents
LLM
RAG
Context Engineering
LLM Evaluation
Agentic Workflows
Apply
Founding Engineer 9 hours ago
$108k – $230k per year · Equity 0.2–1% · Remote (United States) · Full-Time · 6+ years exp · San Francisco
Python
JavaScript
TypeScript
C#
AI/ML
Cursor
Frontend
Next.js
React.js
Apply
$125k – $175k per year · Equity 1–3% · Hybrid · Full-Time · San Francisco
Python
Rust
Python
FastAPI
Databases
PostgreSQL
AI/ML
LLM
DevOps
Nginx
Apply
Founding Engineer 11 hours ago
$90k – $140k per year · Equity 2.5–5% · In office · Full-Time · 3+ years exp · Bachelor's Degree · San Francisco
Python
JavaScript
Python
FastAPI
Databases
PostgreSQL
Redis
AI/ML
Cursor
Windsurf
ChatGPT
Claude Code
Model Context Protocol
Embeddings
AI Agents
LLM
OpenAI
Anthropic
OpenAI Codex
Devin
Lovable
LLM Evaluation
Frontend
Next.js
React.js
Mobile
React Native
Expo
Apply
See all jobs
This is one of many
2,406,540 more open roles from verified company boards, updated every day.