1,231,592open jobs
70,451companies
214,096added this week
Browse all
Location
Remote (Kenya)also open in Algeria, Angola, Benin, Botswana, Brazil, Burkina Faso +58
Employment
Contractor

Confirmed on the employer's own hiring board on Oct 4, 2026. First seen by Alion on Sep 23, 2026.

Overview
Company
Impact
Profile match
YPAI builds production AI systems and delivers multimodal data, annotation and evaluation under one accountable delivery model.

← All jobs

Model Evaluator

Model evaluation (RLHF) · Remote, Kenya · Freelance

Read what an AI model produced and judge it: which answer is better, where it is wrong, whether it is safe. Your judgement is the training signal, so the reasoning matters as much as the rating.

The work

  • Rate and compare model outputs against the project's rubric.
  • Write short, concrete justifications for your rating.
  • Flag unsafe, false or policy-breaking output explicitly.

You need

  • Strong reading comprehension in the language you evaluate.
  • The ability to explain why, not only what.
  • 18 years or older.

Every application is read by a person on our team, and selected candidates get an answer by email. Your application, and any CV you upload, are deleted no later than 2 years after you apply.

Takes a couple of minutes. No CV needed.

PaymentVia PayPal, Wise, or bank transfer

Minimum payoutNone. You are paid what you have earned

Fees to youNever, at any stage. If someone asks, it is not us

Who hires youYPAI, a registered Norwegian company

Application received

Thanks. Your application for Model Evaluator is registered and will be read by a person on our team. We have emailed you a receipt with what happens next. Your application, and any CV you uploaded, are deleted no later than 2 years after you applied.

Your capability profile is registered too, so future matching projects can reach you. Check your email for a sign-in link to complete it, or to edit or delete it.

Typical project ratesKES 800-1200 per hourApplying qualifies you for future YPAI projects in this contributor category. It does not guarantee work. Every project invitation confirms the rate, the payment basis, the scope and the acceptance criteria before you accept.

WhereRemote, Kenya

ContractFreelance

IntakeOngoing, apply anytime

Apply for this role

Read by a person on our team. No CV needed. Deleted no later than 2 years after you apply.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,231,592 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Operations
Similar stack
Same company
In your city
≈ $33k – $77k per year (Estimated) • Equity • Remote (France, Belgium) • Full-Time • 3+ years exp • Paris
Management
Agile
Apply
$160k per year • Remote (United States) • Contractor • 5+ years exp • Charlotte
Apply
$92k per year • Remote (Germany) • Part-Time • Munich
Apply
Remote (Germany) • Part-Time • Germany
SQL
DevOps
Incident Management
Management
Confluence
Jira
Apply
Remote (Germany) • Full-Time • Bochum
Apply
≈ $31k – $74k per year (Estimated) • In office • 23+ years exp • Delhi • Hyderabad • Bengaluru
Python
Databases
Weaviate
Pinecone
FAISS
AI/ML
AutoGen
LangChain
Claude
Fine-tuning
RLHF
Reinforcement Learning
Prompt Engineering
Function Calling
AI Agents
AutoGPT
Haystack
Mistral
CrewAI
Gemini
LLM
RAG
BabyAGI
OpenAI
GPT-4
Multi-Agent Systems
Tool Use
DevOps
GCP
Azure
AWS
Apply
In office • Full-Time • Ba Ria
Python
SQL
Databases
Weaviate
Databricks
Milvus
Pinecone
Qdrant
AI/ML
Copilot
LangGraph
AutoGen
Weights & Biases
LangChain
Claude
LlamaIndex
MLFlow
Fine-tuning
RLHF
Quantization
Scikit-learn
Prompt Engineering
AI Agents
Semantic Kernel
Transformers
TensorFlow
NumPy
PyTorch
CrewAI
LLM
RAG
Tokenization
Hallucination
Hybrid Search
Time Series Forecasting
OpenAI
Hugging Face
LLMOps
DPO
NIST AI RMF
Agentic Workflows
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
FinOps
Management
SharePoint
Apply
$173k – $243k per year • In office • Full-Time • 10+ years exp • PhD • Seattle
AI/ML
LangGraph
AutoGen
LangChain
Claude
LoRA
RLHF
Multimodal AI
Knowledge Distillation
AI Agents
NLP
LangSmith
PEFT
QLoRA
LLM
RAG
Synthetic Data
OpenAI
DPO
OpenAI Agents SDK
Knowledge Graph
Multi-Agent Systems
Model Distillation
Machine Learning
DevOps
Azure
AWS
Apply
≈ $23k – $60k per year (Estimated) • Hybrid • Full-Time • 8+ years exp • Bachelor's Degree • Pune
AI/ML
LangGraph
AutoGen
LangChain
Model Context Protocol
RLHF
Multimodal AI
Chain-of-Thought
AI Agents
DeepEval
Great Expectations
CrewAI
LLM
RAG
TruLens
Reranking
Anomaly Detection
LLM Guardrails
Constitutional AI
Multi-Agent Systems
Tool Use
DevOps
CI/CD
Chaos Engineering
Cybersecurity
OWASP Top 10
GDPR
Threat Modeling
Apply
≈ $64k – $153k per year (Estimated) • Remote (United States, Japan, Serbia) • Full-Time • PhD
Python
Go
C#
AI/ML
vLLM
CUDA Toolkit
Fine-tuning
RLHF
Quantization
Multimodal AI
Computer Vision
NLP
SGLang
TensorRT
TensorRT-LLM
PyTorch
LLM
Mixture of Experts
CUDA
Triton
OpenAI
DPO
Post-training
Speculative Decoding
KV Cache
DevOps
Wi-Fi
Apply
≈ $56k – $147k per year (Estimated) • Remote (Israel) • Contractor
Apply
Remote (Greece) • Contractor
Apply
Remote (Norway) • Contractor
Apply
Remote (Africa) • Contractor
Apply
≈ $14k – $36k per year (Estimated) • Remote (Philippines) • Contractor
Apply
See all jobs
This is one of many
1,231,592 more open roles from verified company boards, updated every day.