368,746open jobs
9,444companies
47,506added this week
Browse all
Salary
$160k – $210k per year
Location
Remote (Serbia)
Seniority
Architect · 5+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match
Toloka is a data company founded in 2014 and headquartered in Amsterdam that supplies human-generated training, fine-tuning and evaluation data for artificial intelligence systems. It began as a large-scale crowdsourcing platform and has repositioned around expert work, combining domain specialists, machine learning tooling and quality control pipelines to produce reasoning traces, preference rankings and agentic task data. Operating within the Nebius group and backed by Bezos Expeditions since 2025, the company serves frontier model laboratories and enterprises building their own systems.

Company Intro

At Toloka AI  we create data that powers leading GenAI  models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises, and non-profit research organizations worldwide. We use a combination of Experts + Crowd + Tech Platform to teach AI models to reason and evaluate their efficacy and safety. We have experts in more than 50 different domains-from doctors and lawyers to physicists and engineers-and boast one of the most diverse global crowds, representing over 100 countries and speaking 40+ languages. We are a well-funded startup with an enviable portfolio of clients, including Anthropic, Amazon, Microsoft, Poolside, Recraft,  andShopify.

Recently, we secured a strategic investment led by Bezos Expeditions  and Nebius Group with participation from Mikhail Parakhin, CTO of Shopify  and board advisor to leading GenAI companies, who now serves as our Chairman of the Board. Our remote-first team is globally distributed around the world: USA, UK, the Netherlands,  Serbia, and more.

About the position

We are seeking an exceptional Program Director, to own and scale the execution of complex AI data projects across a major client portfolio or service vertical. This role focuses on operational excellence and flawless delivery, working in close partnership with our Business Development team to drive revenue growth through exceptional client outcomes.

You'll own the execution excellence for a substantial portfolio of projects, ensuring every delivery exceeds client expectations on quality, while hitting timeline and gross margin targets. Working closely with client researchers, C-level stakeholders, product, data, and engineering teams, you'll be the execution backbone that turns business development wins into delivered value.

The ideal candidate combines a Big 3 consulting background with hands-on technical depth in software engineering and modern AI (LLMs, ML, data platforms).

  • Full remote
  • Full-time and contract opportunities available

What you’ll do

  • Take ultimate ownership for AI program strategy, roadmaps, and success metrics, ensuring they are fully aligned with business goals and senior leadership expectations;
  • Lead end-to-end delivery of multiple complex AI initiatives (LLM-powered products, automation, analytics), ensuring all projects meet scope, budget, and quality standards;
  • Translate ambiguous business problems into clear technical workstreams and architectures, collaborating directly with data scientists, ML engineers, and software engineers;
  • Establish and own program governance, including operating rhythms, steering committees, risk/issue management, and high-level executive communications;
  • Drive solution design reviews and provide technical oversight, challenging approaches where needed to ensure the robustness, scalability, and security of AI solutions;
  • Embed responsible and ethical AI practices into program design, focusing on data privacy, bias mitigation, model monitoring, and human-in-the-loop workflows;
  • Manage vendor and partner relationships (cloud, model providers, integrators), including technical evaluations, contracts input, and performance management;
  • Lead and mentor cross-functional teams (PMs, tech leads, data scientists), fostering a high-performance delivery culture and driving continuous process improvement.

What we're Looking For

  • 10+ years in technology consulting and delivery, with significant experience at a  Big 3  or top-tier firm in technology, digital, or data;
  • 5+ years of program or portfolio management, leading large, multi-disciplinary tech programs with multi-million dollar budgets;
  • Proven track record of delivering AI, data, or analytics programs (LLM/ML products, intelligent automation) into production;
  • Hands-on technical background  in Data Science or Software Engineering (Python, Java, etc.), with the ability to read code and support technical decision-making;
  • Demonstrated ability to influence and communicate effectively with C-level stakeholders and non-technical audiences;
  • Proactiveness in suggesting process changes and a deep understanding of the LLM life cycle.

What we can offer

  • You will be part of an international and dynamic environment, driving innovation and setting new standards in the AI and technology sector;
  • Competitive compensation package including base salary, bonus, and ESOP;
  • Paid PTO and benefits will vary depending on location;
  • We offer a full remote or hybrid model (if you based in NL or Serbia);
  • IT set up and home office allowances.

Toloka compensation for this role is benchmarked to local market rates and varies by location within the United States. For candidates in the US, the base salary range  for this role is USD 160.000 - 210.000 $  per year. Since this is a remote role, actual compensation will depend on factors such as location, relevant experience, skills, knowledge, internal pay equity, and market conditions. In addition to base salary, this role may be eligible for other elements of compensation such as [bonus /commission /equity, as applicable], as well as a comprehensive benefits package. Additional information about total compensation and benefits will be shared with candidates during the hiring process.

Equal Opportunity Employer:

Toloka is committed to providing equal opportunity and fostering an inclusive environment. We welcome applications from all qualified individuals and do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, gender identity, age, marital status, veteran status, disability, or any other characteristic protected by applicable law. Selection decisions are made based on qualifications, merit, and business need.

Scam Alert Regarding Fake Job Postings

It has come to our attention that an individual or group is fraudulently impersonating Toloka to post fake jobs and solicit personal information from applicants.Please be aware:

  • Official Communication:  Our recruiting team will only  contact you from an official "toloka.ai " email address. We will NEVER use Gmail, Yahoo, Tolokainc, toloka.inc,  or other personal or seemingly business email accounts.
  • Our Process:  We will never  ask for your bank account details, credit card number, or any fees as part of the application or interview process.
  • Official Listings:  All legitimate job openings are posted on our official careers page: https://toloka.ai/careers#job-list

What to do:  If you see a suspicious job posting or have been contacted by someone you suspect is a scammer, please do not provide any personal information. Instead, report the incident to us directly at  [email protected] and report the profile/post to LinkedIn.We are taking this matter very seriously and are working with the appropriate parties to resolve it. Thank you for your vigilance.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,746 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
$187k – $378k per year (Estimated) • Remote/Hybrid • Full-Time • 6+ years exp
Python
AI/ML
AI Agents
Edge AI
Embeddings
LLM
NumPy
Pandas
Spark
Analytics
A/B Testing
Apply
$35k per year • In office • Internship • Bachelor's Degree • Freiburg im Breisgau
C++
Java
Node JS
Python
C#
JavaScript
C#
.NET
AI/ML
AI Agents
DevOps
CI/CD
GitLab
Apply
$88k – $146k per year • In office • Full-Time • 3+ years exp • Master's Degree • Seattle
Perl
Python
Ruby
SQL
Databases
MySQL
Teradata
DevOps
AWS
Analytics
Tableau
Apply
up to $12k per year • Remote/Hybrid • Full-Time • 6+ years exp • Bachelor's Degree • United States • United Kingdom
AI/ML
AI Agents
Function Calling
Human-in-the-Loop
LLM Guardrails
Apply
ARG SSR Data Engineer 4 hours ago
$38k – $95k per year (Estimated) • Remote/Hybrid • Full-Time • 4+ years exp • Argentina
Python
SQL
Databases
Trino
AI/ML
Airflow
DevOps
Amazon S3
AWS
Azure
CI/CD
GCP
Git
Analytics
ETL/ELT
Apply
Remote • Freelance
AI/ML
Anthropic
Apply
$84k – $213k per year (Estimated) • Remote • Internship • 3+ years exp
Python
AI/ML
AI Agents
AutoGen
Fine-tuning
Knowledge Distillation
LangChain
Llama
LlamaIndex
LLM
Mistral
Reinforcement Learning
Anthropic
Apply
Remote • Freelance • 8+ years exp
JavaScript
Python
TypeScript
Python
FastAPI
Databases
Apache Kafka
PostgreSQL
Redis
AI/ML
AI Agents
Claude
Anthropic
Model Context Protocol
OpenAI Codex
Frontend
React.js
DevOps
Docker
Apply
Remote • Freelance • Master's Degree
Python
AI/ML
Fine-tuning
LLM
LoRA
NumPy
Pandas
PEFT
RAG
RLHF
Synthetic Data
Transformers
Anthropic
DPO
PPO
SFT
AI Agents
Apply
$136k – $298k per year (Estimated) • Remote • Freelance • Master's Degree
Python
AI/ML
Fine-tuning
LLM
LoRA
NumPy
Pandas
PEFT
RAG
RLHF
Synthetic Data
Transformers
Anthropic
DPO
PPO
SFT
AI Agents
Apply
See all jobs
This is one of many
368,746 more open roles from verified company boards, updated every day.