2,080,763open jobs
127,499companies
242,242added this week
Browse all
Salary
up to $140k per year
Location
Remote (United States)
Employment
Part-Time

Confirmed on the employer's own hiring board on Nov 3, 2026. First seen by Alion on Oct 9, 2026.

Overview
Company
Impact
Profile match
Mindrift is a platform operated by Toloka that recruits subject-matter experts to generate and evaluate the training data used to improve large language models. Contributors apply in their own professional field, from software engineering and medicine to law and linguistics, and complete paid projects such as writing reference answers, ranking model outputs, red-teaming responses and building reasoning traces for specific domains. The work is remote and project-based, which is why the platform posts a very large volume of freelance vacancies across many languages and specialisations at once.

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.

What this opportunity involves

We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
  • Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, join us!

What we look for

This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
  • Board certification or completed residency training, with recent direct patient care (attending-level preferred);
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

Project time expectations

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks - up to the equivalent of $70/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,080,763 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Recommended for you based on this role

HR
Similar stack
Same company
In your city
In office · Full-Time · 5+ years exp · Bachelor's Degree · Philadelphia
DevOps
GitHub
Apply
$78k – $98k per year · Equity · Remote (United States) · 5+ years exp · High School Diploma · Bakersfield
Apply
$500k per year · In office · Full-Time · PhD · Goodyear
Apply
HR Analyst 3 hours ago
Hybrid · 1+ year exp · Bachelor's Degree · Brentwood
Analytics
Tableau
Power BI
Microsoft Excel
Apply
Hybrid · 5+ years exp · Bachelor's Degree · Brentwood
Apply
up to $138k per year · Remote (United States) · Freelance · Dallas · Houston · Austin · San Antonio
Python
AI/ML
AI Agents
DevOps
GitHub
Design
SolidWorks
SpaceTech
CATIA
Siemens NX
ANSYS
Apply
up to $18k per year · Remote (India) · Freelance · Bengaluru · Mumbai · Hyderabad · Chennai · New Delhi
Python
AI/ML
AI Agents
DevOps
GitHub
Design
SolidWorks
SpaceTech
CATIA
Siemens NX
ANSYS
Apply
up to $62k per year · Remote (Spain) · Freelance · Madrid · Barcelona · Valencia
Python
AI/ML
AI Agents
DevOps
GitHub
Design
SolidWorks
SpaceTech
CATIA
Siemens NX
ANSYS
Apply
up to $100k per year · Remote (France) · Freelance · Paris · Lyon
Python
AI/ML
AI Agents
DevOps
GitHub
Design
SolidWorks
SpaceTech
CATIA
Siemens NX
ANSYS
Apply
up to $72k per year · Remote (United Kingdom) · Freelance · London · Glasgow · Manchester · Birmingham · Edinburgh
Python
AI/ML
AI Agents
DevOps
GitHub
Design
SolidWorks
SpaceTech
CATIA
Siemens NX
ANSYS
Apply
See all jobs
This is one of many
2,080,763 more open roles from verified company boards, updated every day.