Software Test Engineer - Remote

YO AI Labs • AI Training Data & Annotation • AI Evaluation & Observability • 4 hours ago
Smart Apply
Similar jobs
1,622,553open jobs
97,402companies
249,244added this week
Browse all
Salary
$120k – $224k per year
Location
Remote (United States)

Confirmed on the employer's own hiring board on Oct 14, 2026. First seen by Alion on Oct 14, 2026. YO AI Labs scores A on the Alion truth index.

Overview
Company
Impact
Profile match

YO AI Labs

YO AI Labs is an artificial intelligence platform specializing in AI model training, evaluation, and data annotation services. Headquartered in San Francisco, California, United States, the company connects domain experts and remote specialists across the globe to review, test, and benchmark generative AI model outputs. Through its decentralized workforce solutions and structured evaluation workflows, it enables frontier technology developers to enhance the accuracy, safety, and reliability of next-generation artificial intelligence systems.
yoailabs.com • HQ: San Francisco, United States • AI Evaluation & Observability • AI Training Data & Annotation • 5000+ employees
Tech stack of YO AI Labs

QA Engineer

Role Type: Contractor

Location: Remote

About the Role

We are looking for experienced QA Engineers to support technical evaluation and AI training projects. You'll apply your testing expertise to evaluate technical outputs, identify issues, and maintain high-quality standards.

Key Responsibilities

  • Design and execute functional, regression, and edge-case test cases.
  • Perform manual and automated testing and document results.
  • Identify, report, and track bugs with clear reproduction steps.
  • Evaluate technical outputs against defined quality criteria.
  • Provide detailed feedback and annotations.
  • Collaborate with project teams to improve testing standards.

Required Skills

  • Quality Assurance
  • Software Testing
  • Automation Testing
  • Test Case Design
  • Regression Testing
  • Bug Tracking
  • Manual Testing
  • Quality Evaluation

Preferred Qualifications

  • Professional experience as a QA Engineer, SDET, Test Engineer, or similar role.
  • Strong understanding of QA methodologies and testing practices.
  • Experience with bug-tracking and test-management tools.
  • Strong analytical skills and attention to detail.
  • Excellent written and verbal communication.
  • Self-motivated and comfortable working independently in a remote environment.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,622,553 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Recommended for you based on this role

QA
Similar stack
Same company
Boston
Expert Software Tester 2 months ago
$50k – $290k per year • In office • TS/SCI • Full-Time • 10+ years exp • United States
Python
JavaScript
C#
Mobile
JUnit
DevOps
Azure DevOps
GitHub Actions
GitLab CI
Azure
CI/CD
Jenkins
AWS
Docker
Kubernetes
Bamboo
Management
Jira
Agile
Scrum
QA
TestRail
TestNG
Selenium
Cypress
Playwright
Rest-Assured
Pytest
Apply
Remote (Brazil) • Full-Time • 3+ years exp
JavaScript
Kotlin
TypeScript
Swift
Mobile
Espresso
Maestro
DevOps
GitHub Actions
GitLab CI
CI/CD
Jenkins
QA
Selenium
Cypress
Playwright
Appium
Rest-Assured
Pact
Robot Framework
XCUITest
Apply
up to $14k per year (net) • Remote (EAEU) • Full-Time • Moscow
Java
SQL
DevOps
Rest API
QA
Postman
Apply
Senior QA Engineer 1 hour ago
≈ $70k – $166k per year (Estimated) • Remote (likely United States) • Full-Time • 5+ years exp • Bachelor's Degree
Python
JavaScript
TypeScript
AI/ML
Copilot
Cursor
Claude Code
Model Context Protocol
AI Agents
DeepEval
Langfuse
LangSmith
Promptfoo
Ragas
LLM
Hallucination
LLM Evaluation
LLM Guardrails
DevOps
CI/CD
Git
Self-Healing
Cybersecurity
OWASP ZAP
OWASP Top 10
HIPAA
Management
Agile
QA
Selenium
JMeter
Cypress
Playwright
Pact
k6
Locust
Apply
≈ $61k – $121k per year (Estimated) • Hybrid • Full-Time • 2+ years exp • High School Diploma • Fenton
Management
Outlook
SharePoint
Scrum
Microsoft Office
Apply
$244k – $305k per year • Equity • Hybrid • Boston • New York
DevOps
Datadog
CI/CD
Bazel
Apply
$80k – $100k per year • Hybrid • 3+ years exp • Bachelor's Degree • Boston
Management
Microsoft Office
Apply
$160k – $260k per year • Remote (United States) • 1+ year exp • Bachelor's Degree • Boston
Python
AI/ML
SciPy
NumPy
Analytics
Matplotlib
Apply
$234k – $300k per year • Equity • Hybrid • Bachelor's Degree • Boston • New York
AI/ML
Prompt Engineering
LLM
Machine Learning
DevOps
Datadog
Apply
Remote (United Kingdom) • Full-Time • Boston
Marketing
Salesforce
Apply
See all jobs
This is one of many
1,622,553 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles