368,530open jobs
9,432companies
50,439added this week
Browse all
Salary
$122k – $260k per year (Estimated)
Location
Remote (Serbia)
Seniority
Architect · 5+ years exp
Employment
Internship
Overview
Company
Impact
Profile match
Toloka is a data company founded in 2014 and headquartered in Amsterdam that supplies human-generated training, fine-tuning and evaluation data for artificial intelligence systems. It began as a large-scale crowdsourcing platform and has repositioned around expert work, combining domain specialists, machine learning tooling and quality control pipelines to produce reasoning traces, preference rankings and agentic task data. Operating within the Nebius group and backed by Bezos Expeditions since 2025, the company serves frontier model laboratories and enterprises building their own systems.

Company Intro

At Toloka AI  we create data that powers leading GenAI  models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises, and non-profit research organizations worldwide. We use a combination of Experts + Crowd + Tech Platform to teach AI models to reason and evaluate their efficacy and safety. We have experts in more than 50 different domains-from doctors and lawyers to physicists and engineers-and boast one of the most diverse global crowds, representing over 100 countries and speaking 40+ languages. We are a well-funded startup with an enviable portfolio of clients, including Anthropic, Amazon, Microsoft, Poolside, Recraft,  andShopify.

Recently, we secured a strategic investment led by Bezos Expeditions  and Nebius Group with participation from Mikhail Parakhin, CTO of Shopify  and board advisor to leading GenAI companies, who now serves as our Chairman of the Board. Our remote-first team is globally distributed around the world: USA, UK, the Netherlands,  Serbia, and more.

About the position

We are seeking an exceptional Program Director, to own and scale the execution of complex AI data projects across a major client portfolio or service vertical. This role focuses on operational excellence and flawless delivery, working in close partnership with our Business Development team to drive revenue growth through exceptional client outcomes.

You'll own the execution excellence for a substantial portfolio of projects, ensuring every delivery exceeds client expectations on quality, while hitting timeline and gross margin targets. Working closely with client researchers, C-level stakeholders, product, data, and engineering teams, you'll be the execution backbone that turns business development wins into delivered value.

The ideal candidate combines a Big 3 consulting background with hands-on technical depth in software engineering and modern AI (LLMs, ML, data platforms).

  • Full remote
  • Full-time and contract opportunities available

What you’ll do

  • Take ultimate ownership for AI program strategy, roadmaps, and success metrics, ensuring they are fully aligned with business goals and senior leadership expectations;
  • Lead end-to-end delivery of multiple complex AI initiatives (LLM-powered products, automation, analytics), ensuring all projects meet scope, budget, and quality standards;
  • Translate ambiguous business problems into clear technical workstreams and architectures, collaborating directly with data scientists, ML engineers, and software engineers;
  • Establish and own program governance, including operating rhythms, steering committees, risk/issue management, and high-level executive communications;
  • Drive solution design reviews and provide technical oversight, challenging approaches where needed to ensure the robustness, scalability, and security of AI solutions;
  • Embed responsible and ethical AI practices into program design, focusing on data privacy, bias mitigation, model monitoring, and human-in-the-loop workflows;
  • Manage vendor and partner relationships (cloud, model providers, integrators), including technical evaluations, contracts input, and performance management;
  • Lead and mentor cross-functional teams (PMs, tech leads, data scientists), fostering a high-performance delivery culture and driving continuous process improvement.

What we're Looking For

  • 10+ years in technology consulting and delivery, with significant experience at a  Big 3  or top-tier firm in technology, digital, or data;
  • 5+ years of program or portfolio management, leading large, multi-disciplinary tech programs with multi-million dollar budgets;
  • Proven track record of delivering AI, data, or analytics programs (LLM/ML products, intelligent automation) into production;
  • Hands-on technical background  in Data Science or Software Engineering (Python, Java, etc.), with the ability to read code and support technical decision-making;
  • Demonstrated ability to influence and communicate effectively with C-level stakeholders and non-technical audiences;
  • Proactiveness in suggesting process changes and a deep understanding of the LLM life cycle.

What we can offer

  • You will be part of an international and dynamic environment, driving innovation and setting new standards in the AI and technology sector;
  • Competitive compensation package including base salary, bonus, and ESOP;
  • Paid PTO and benefits will vary depending on location;
  • We offer a full remote or hybrid model (if you based in NL or Serbia);
  • IT set up and home office allowances.

Equal Opportunity Employer:

Toloka is committed to providing equal opportunity and fostering an inclusive environment. We welcome applications from all qualified individuals and do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, gender identity, age, marital status, veteran status, disability, or any other characteristic protected by applicable law. Selection decisions are made based on qualifications, merit, and business need.

Scam Alert Regarding Fake Job Postings

It has come to our attention that an individual or group is fraudulently impersonating Toloka to post fake jobs and solicit personal information from applicants.Please be aware:

  • Official Communication:  Our recruiting team will only  contact you from an official "toloka.ai " email address. We will NEVER use Gmail, Yahoo, Tolokainc, toloka.inc,  or other personal or seemingly business email accounts.
  • Our Process:  We will never  ask for your bank account details, credit card number, or any fees as part of the application or interview process.
  • Official Listings:  All legitimate job openings are posted on our official careers page: https://toloka.ai/careers#job-list

What to do:  If you see a suspicious job posting or have been contacted by someone you suspect is a scammer, please do not provide any personal information. Instead, report the incident to us directly at [email protected] and report the profile/post to LinkedIn.We are taking this matter very seriously and are working with the appropriate parties to resolve it. Thank you for your vigilance.

To learn how we collect, use, disclose, and store personal data, check out our Privacy Notice.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,530 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
$118k – $240k per year (Estimated) • In office • Full-Time • 8+ years exp • Bachelor's Degree • Tysons
C#
Go
JavaScript
Python
SQL
TypeScript
C#
.NET
AI/ML
Embeddings
Human-in-the-Loop
LLM Guardrails
RAG
Semantic Search
Semantic Search
DevOps
AWS
CI/CD
Vector
Cybersecurity
Least Privilege
Apply
$122k – $200k per year • In office • Full-Time • 10+ years exp • Jersey City • Charlotte
Java
Node JS
Python
SQL
JavaScript
Java
Hibernate
Spring Framework
Spring MVC
Databases
Apache Kafka
DynamoDB
Oracle
RabbitMQ
AI/ML
Ray
DevOps
Amazon CloudWatch
Amazon EC2
Amazon ECS
Amazon EKS
Amazon S3
Ansible
API Gateway
AWS
AWS Lambda
Azure
CI/CD
CloudFormation
GCP
Git
Grafana
IAM
Jenkins
Prometheus
Splunk
Terraform
Kubernetes
Apply
$87k – $131k per year • In office • Full-Time • 5+ years exp • Bachelor's Degree • Tysons
Java
Mobile
JUnit
DevOps
AWS
Azure
Azure DevOps
CI/CD
Datadog
Docker
Dynatrace
GCP
Git
Jenkins
Kubernetes
New Relic
Shift-Left
Splunk
Cybersecurity
Shift-Left Security
SonarQube
Management
Jira
QA
Cucumber
JMeter
Postman
Rest-Assured
Selenium
TestNG
Apply
$113k – $188k per year • In office • Full-Time • 6+ years exp • Bachelor's Degree • Tysons
Python
SQL
Python
pySpark
Databases
Amazon Redshift
Apache Iceberg
Databricks
Delta Lake
AI/ML
Airflow
Anomaly Detection
ChatGPT
Copilot
Cursor
GraphRAG
Knowledge Graph
RAG
Spark
DevOps
Amazon Kinesis
Amazon S3
AWS
AWS CDK
AWS Lambda
AWS Step Functions
CI/CD
CloudFormation
Docker
Git
GitHub
GitHub Actions
IAM
Jenkins
Terraform
Vector
Cybersecurity
Least Privilege
Analytics
ETL/ELT
Power BI
Tableau
Apply
$74k – $191k per year (Estimated) • Remote/Hybrid • Full-Time • 2+ years exp • Bachelor's Degree • Hod HaSharon
Python
AI/ML
Copilot
DevOps
Azure
Analytics
ETL/ELT
Power BI
Apply
$84k – $213k per year (Estimated) • Remote • Internship • 3+ years exp
Python
AI/ML
AI Agents
AutoGen
Fine-tuning
Knowledge Distillation
LangChain
Llama
LlamaIndex
LLM
Mistral
Reinforcement Learning
Anthropic
Apply
Remote • Freelance • 8+ years exp
JavaScript
Python
TypeScript
Python
FastAPI
Databases
Apache Kafka
PostgreSQL
Redis
AI/ML
AI Agents
Claude
Anthropic
Model Context Protocol
OpenAI Codex
Frontend
React.js
DevOps
Docker
Apply
Remote • Freelance • Master's Degree
Python
AI/ML
Fine-tuning
LLM
LoRA
NumPy
Pandas
PEFT
RAG
RLHF
Synthetic Data
Transformers
Anthropic
DPO
PPO
SFT
AI Agents
Apply
$136k – $298k per year (Estimated) • Remote • Freelance • Master's Degree
Python
AI/ML
Fine-tuning
LLM
LoRA
NumPy
Pandas
PEFT
RAG
RLHF
Synthetic Data
Transformers
Anthropic
DPO
PPO
SFT
AI Agents
Apply
$80k – $182k per year (Estimated) • Remote • Freelance • 5+ years exp
AI/ML
AI Agents
Anthropic
EU AI Act
Human-in-the-Loop
Cybersecurity
GDPR
Design
Figma
Management
Notion
Slack
Apply
See all jobs
This is one of many
368,530 more open roles from verified company boards, updated every day.