Salary
$40k – $58k per year
Location
Hybrid (Canada)
Employment
Contractor
Confirmed on the employer's own hiring board on Nov 1, 2026. First seen by Alion on Sep 23, 2026.
Overview
Company
Impact
Profile match
YPAI is a Norwegian AI services company based in Lysaker near Oslo that supplies multimodal training data, data annotation, dataset licensing and human model evaluation, and also builds AI assistants and other production AI systems for clients. It runs consent-led data collection and labeling projects across text, speech, image and video, using a remote freelance workforce recruited in countries across Africa, Asia, Latin America and North America. Its freelance roles include model evaluators for RLHF, text and NLP annotators, machine translation post-editors, QA reviewers, field collection and capture rig operators and dataset sourcing partners.
Rate and compare AI answers and explain why, as paid work from home. It suits careful readers who can say why an answer is wrong, not only that it is.
What the work is for
Your ratings and written reasons help train AI models and test their answers.
The work
- Rate and compare AI answers against the project's criteria.
- Write a short, concrete reason for each rating. It matters as much as the rating itself.
- Check the facts in an answer. Rewrite weak answers where the task asks for it.
- Flag unsafe, false or policy-breaking output explicitly.
What to expect
- Each project has its own rating criteria and instructions for judging answers.
- You work in YPAI's own review console, where each project's rating criteria are set up.
You need
- Strong reading comprehension in the language you evaluate.
- The ability to explain why, not only what.
- 18 years or older.
Good to know
- You will read unsafe or offensive output at times. Judging it is part of the work.
- Work depends on the projects running in the language you evaluate. There can be gaps between projects.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,058,973 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Recommended for you based on this role
Operations
Similar stack
Same company
In your city
Apply
Apply
Apply
Apply
Apply
Dataset Sourcing Partner
21 days ago
≈ $36k – $93k per year (Estimated) · Remote (Canada) · Contractor · Bachelor's Degree
Apply
Wearable Sensor Data Contributor
21 days ago
$34k – $50k per year · Remote (Canada) · Contractor
AI/ML
Physical AI
Apply
Apply
Dataset Sourcing Partner
21 days ago
≈ $13k – $25k per year (Estimated) · Remote (Greece) · Contractor · Bachelor's Degree
Apply
Apply
This is one of many
2,058,973 more open roles from verified company boards, updated every day.

