Salary
$100k – $200k per year
Location
In office (New York)
Confirmed on the employer's own hiring board on Nov 16, 2026. First seen by Alion on Nov 5, 2026.
Overview
Company
Impact
Profile match
YO AI Labs is an artificial intelligence platform specializing in AI model training, evaluation, and data annotation services. Headquartered in San Francisco, California, United States, the company connects domain experts and remote specialists across the globe to review, test, and benchmark generative AI model outputs. Through its decentralized workforce solutions and structured evaluation workflows, it enables frontier technology developers to enhance the accuracy, safety, and reliability of next-generation artificial intelligence systems.
QA Engineer
Role Type: Contractor
Location: Remote
Job Description
We are seeking detail-oriented QA Engineers to support an AI training project focused on quality assurance, data annotation, and AI model evaluation. Prior AI experience is not required.
Required Skills
- Software Quality Assurance
- Test Planning and Test Case Design
- Data Annotation and Labeling
- AI Model Evaluation
- Defect Reporting and Documentation
- Data Quality and Validation
- Analytical Thinking and Attention to Detail
- English Communication (B2 or higher)
Responsibilities
- Design and execute test cases to validate AI outputs.
- Review, annotate, and label datasets.
- Identify errors and inconsistencies in model predictions.
- Document test results and provide actionable feedback.
- Collaborate with teams to improve testing methodologies.
- Recommend improvements to data quality and model performance.
Qualifications
- Experience in software testing and quality assurance.
- Understanding of test planning and defect reporting.
- Experience with data annotation, RLHF, or AI evaluation is preferred.
- Strong analytical, documentation, and communication skills.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,300,357 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Your match
How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.
Recommended for you based on this role
QA
Remote, many countries
Similar stack
Same company
New York
Senior, Software Design Quality Engineer
4 hours ago
$125k – $140k per year · In office · 7+ years exp · Bothell
MedTech
ISO 13485
ISO 14971
IEC 60601
IEC 62304
IEC 62366
EU MDR
Design Controls
Design History File
Apply
Quality Assurance Automation Engineer -Dallas, TX
2 months ago
$37k per year · In office · 6+ years exp · Bachelor's Degree · Dallas
Management
Agile
Apply
Quality Assurance Engineer -Dallas, TX
2 months ago
$37k per year · In office · 6+ years exp · Bachelor's Degree · Dallas
Python
Java
SQL
Mobile
JUnit
DevOps
Rest API
Azure
CI/CD
Jenkins
AWS
Docker
Cybersecurity
Shift-Left Security
Management
Agile
Scrum
QA
TestNG
Selenium
Rest-Assured
Apply
Enterprise Applications Test Manager
2 days ago
In office · Full-Time · 7+ years exp · Philadelphia
DevOps
Rest API
Cybersecurity
GDPR
Management
ITIL
Oracle ERP
Life Sciences
GMP
MedTech
21 CFR Part 11
Apply
Apply
Старший инженер по тестированию САПР Компас-3D
5 hours ago
$12k – $17k per year · Remote (likely EAEU) · Full-Time · 3+ years exp · Samara
DevOps
Linux
Windows
Apply
$11k – $12k per year · Remote (EAEU) · 2+ years exp · Moscow
Python
Java
SQL
Python
SQLAlchemy
Databases
PostgreSQL
Apache Kafka
Mobile
JUnit
DevOps
Rest API
OpenShift
Jenkins
Git
Management
Confluence
Jira
QA
TestRail
Selenium
Cucumber
Playwright
Postman
Insomnia
Rest-Assured
Pytest
Apply
Fullstack QA Engineer (Java, Auto + Manual)
7 hours ago
Remote (EAEU) · 4+ years exp · Moscow
JavaScript
Java
SQL
Databases
Redis
Frontend
npm
Mobile
JUnit
DevOps
Rest API
Kibana
CI/CD
Git
QA
TestNG
Selenium
Playwright
Rest-Assured
Apply
$40k per year · Remote (EAEU) · Saint Petersburg
Python
SQL
C#
C#
.NET
Databases
MS SQL
DevOps
Rest API
Zabbix
Prometheus
Grafana
Windows
SOAP
Apache HTTP Server
QA
JMeter
Swagger
Apply
QA Automation инженер (Python)
9 hours ago
$25k – $30k per year · Remote (EAEU) · Full-Time · 3+ years exp · Ryazan
Python
DevOps
Rest API
Kibana
CI/CD
Git
Management
Jira
QA
Selenium
Postman
Apply
Machine Learning Engineer 2 - Freewheel
1 hour ago
$136k – $181k per year · In office · Full-Time · 2+ years exp · Master's Degree · Sunnyvale · New York
Python
Java
C++
AI/ML
Computer Vision
Machine Learning
Apply
$210k – $260k per year · Equity · Hybrid · PhD · Denver · New York · San Francisco
Apply
Technical Project Manager
1 hour ago
Hybrid · 7+ years exp · Bachelor's Degree · New York
Python
AI/ML
Reinforcement Learning
AI Agents
Post-training
Red Teaming
LLM Evaluation
LLM Guardrails
Apply
Product Manager - Private Funds Research
1 hour ago
In office · Full-Time · 7+ years exp · Bachelor's Degree · London · New York
SQL
AI/ML
LLM
Analytics
Microsoft Excel
Management
Jira
Agile
Apply
Product Manager - Private Funds Analytics
1 hour ago
In office · Full-Time · 7+ years exp · Bachelor's Degree · London · New York
SQL
AI/ML
LLM
Analytics
Microsoft Excel
Management
Jira
Agile
Apply
This is one of many
2,300,357 more open roles from verified company boards, updated every day.

