Director, Applied Machine Learning

About Handshake

Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.

In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.

Why join Handshake now:

• Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel

• Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world's top educational institutions

• Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders

• Build a massive, fast-growing business with billions in revenue

About Handshake AI

Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.

About the Role

As Director of Applied ML, you'll lead the function that sits at the intersection of frontier AI research and enterprise-scale delivery. You'll own three core pillars: post-training and RL environments, scaled post-training infrastructure, and strategic project support across our lab partnerships. You think like an applied researcher, lead like an operator, and move fluidly between technical depth and client-facing strategy.

You'll build and grow a team, set the technical standards for how the team engages with frontier labs, and help shape the roadmap as we scale, not just execute against it. This is a rare opportunity to lead at the frontier of gen AI, with direct visibility into where model training is headed before the rest of the world sees it.

Location: San Francisco, CA | Hybrid, 3x a week in office

What you'll do:

• Lead post-training and RL environment strategy - you don't need to be the deepest technical expert, but your team needs to be able to lean on you for real guidance grounded in lab experience

• Build and scale the infrastructure and team needed to run post-training at scale across multiple applied use cases

• Own strategic project support across lab engagements - leading your team through a dynamic, evolving roadmap rather than executing the work solo

• Manage and grow a team including AI Engineers, Research Scientists and AI Forward Deployed Engineers, with a path toward managing managers as the org scales

• Partner directly with AI lab researchers and internal stakeholders across engineering and operations, translating ambiguous priorities into clear direction for your team

• Maintain direct customer relationships, following up, communicating progress, and building trust with technical partners

• Bring organizational maturity to a fast-growing team: solve today's problems with today's resources while planning several steps ahead

• Stay current on the frontier: RL, post-training, and evaluation methods, bringing relevant insight into both team strategy and customer conversations

What we're looking for:

• Experience leading and growing technical teams, ideally with a research background in applied ML or AI

• Technical depth in applied AI systems design and model post-training (GRPO/PPO, SFT, or similar) enough to support a research-leaning team, though you don't need to have trained frontier models yourself

• Experience building and scaling teams or infrastructure in an applied, production environment

• Strong cross-functional leadership, comfortable working across engineering and operations, and managing shifting timelines with a team in tow

• Excellent client-facing communication skills - you can translate technical work into business impact and hold your own with both researchers and customers

• Organizational maturity and comfort with ambiguity - you'll need to be creative in solving problems as they arrive

Extra Credit:

• Prior lab experience deploying or training agents for applied, real-world use cases

• Experience managing managers or scaling a team through multiple growth stages

• Familiarity with evaluation frameworks, annotation tooling, or human feedback collection at scale

Perks

Handshake delivers benefits that help you feel supported-and thrive at work and in life.

The below benefits are for full-time US employees.

Ownership: Equity in a fast-growing company

Financial Wellness: 401(k) match, competitive compensation, financial coaching

Family Support: Paid parental leave, fertility benefits, parental coaching

Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend

Growth: $2,000 learning stipend, ongoing development

Office: Commuting support, free lunch, and gym in our SF office

Time Off: Flexible PTO, 15 holidays + 2 flex days

Connection: Team outings & referral bonuses