410,350open jobs
14,253companies
73,765added this week
Browse all
Salary
up to $180k per year
Location
Remote (Indonesia, Malaysia, Philippines, South Africa)
Seniority
Senior
Employment
Freelance
Overview
Company
Impact
Profile match
Mindrift is a platform operated by Toloka that recruits subject-matter experts to generate and evaluate the training data used to improve large language models. Contributors apply in their own professional field, from software engineering and medicine to law and linguistics, and complete paid projects such as writing reference answers, ranking model outputs, red-teaming responses and building reasoning traces for specific domains. The work is remote and project-based, which is why the platform posts a very large volume of freelance vacancies across many languages and specialisations at once.

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

What this opportunity involves

We're building competitive-programming problems and their automatic graders (test cases + checkers) used to train advanced AI coding models. You'll create problems, write both correct and deliberately-wrong solutions, and design the tough test cases that catch subtly-broken code. Your work is what makes the training signal trustworthy.

To apply, share: your competitive-programming handle(s) + current/peak rating, any problem-setting experience, and IOI/ICPC/olympiad history.

What you'll do

  • Write original algorithmic problems - clear statement, sound constraints, an intended solution;
  • Write correct solutions in C++ and Python;
  • Write realistic wrong solutions (common mistakes) to test against;
  • Build and harden test cases: generators, edge cases, stress and "hacking" tests;
  • Write checkers/interactors (testlib) for problems with more than one valid answer;
  • Confirm the quality bar: correct solutions pass, wrong ones fail, within time limits.

What we look for

  • Strong competitive programming background, shown by a public profile - a Codeforces rating (see levels below), OR an IOI / ICPC / national-olympiad record;
  • Fluent contest C++ (STL, complexity); comfortable writing Python;
  • Can explain why a solution is wrong and build an input that breaks it;
  • Strong written English (C1+).

Levels (by Codeforces rating, or equivalent olympiad achievement):

  • Associate - 1700-2100 (Expert / Candidate Master): easier problems;
  • Expert - 2200-2600 (Master / Grandmaster): harder problems
  • Senior / Reviewer - 2600+ (Int'l Grandmaster) or IOI/ICPC medalist: hardest problems + quality review.

Nice to have

  • IOI / ICPC alumni and top competitive programmers especially encouraged to apply;
  • Experience setting or testing problems for real contests (Codeforces rounds, ICPC, national olympiads, online judges);
  • Testlib experience (checkers, validators, generators);
  • Experience creating data for LLM code benchmarks or similar RL / evaluation datasets.

How it works

Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid

Project time expectations

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks - up to the equivalent of $90/hr. Because payment is per task, a faster pace raises your effective hourly rate.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
410,350 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
$22k – $42k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Gurgaon
Python
Apply
Software Engineer 1 hour ago
$105k – $350k per year (Estimated) • In office • Full-Time • Singapore
C#
JavaScript
Python
SQL
TypeScript
AI/ML
Anomaly Detection
DevOps
CI/CD
Git
Analytics
Power BI
Management
Power Apps
Apply
$27k – $71k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Indore
C#
Python
TypeScript
JavaScript
C#
ASP.NET Core
Databases
Apache Kafka
Kafka
AI/ML
AI Agents
Amazon SageMaker
OpenAI
Prompt Engineering
PyTorch
TensorFlow
Frontend
Angular
GraphQL
DevOps
AWS
Azure
CI/CD
Docker
GCP
IAM
Kubernetes
Rest API
Terraform
Apply
DevOps Engineer 1 hour ago
$18k – $54k per year (Estimated) • In office • Full-Time • 3+ years exp • Chennai
Bash
Python
Databases
Apache Kafka
Kafka
DevOps
AWS
CI/CD
Rest API
Apply
$17k – $41k per year (Estimated) • In office • 1+ year exp • Yekaterinburg
Python
SQL
Apply
up to $90k per year • Remote • Freelance
JavaScript
Python
Python
Beautiful Soup
AI/ML
LangChain
LLM
OpenRouter
DevOps
AWS
Docker
GitHub
Management
Google Sheets
QA
Selenium
Apply
up to $90k per year • Remote • Freelance
JavaScript
Python
Python
Beautiful Soup
AI/ML
LangChain
LLM
OpenRouter
DevOps
AWS
Docker
GitHub
Management
Google Sheets
QA
Selenium
Apply
up to $90k per year • Remote • Freelance • New York
JavaScript
Python
Python
Beautiful Soup
AI/ML
LangChain
LLM
OpenRouter
DevOps
AWS
Docker
GitHub
Management
Google Sheets
QA
Selenium
Apply
up to $60k per year • Remote • Freelance • Pune
JavaScript
Python
Python
Beautiful Soup
AI/ML
LangChain
LLM
OpenRouter
DevOps
AWS
Docker
GitHub
Management
Google Sheets
QA
Selenium
Apply
up to $50k per year • Remote • Freelance • Mexico City
JavaScript
Python
Python
Beautiful Soup
AI/ML
LangChain
LLM
OpenRouter
DevOps
AWS
Docker
GitHub
Management
Google Sheets
QA
Selenium
Apply
See all jobs
This is one of many
410,350 more open roles from verified company boards, updated every day.