# RL Data QA Engineer

We're looking for a rigorous, technical RL Data QA Engineer to review the reinforcement-learning tasks built on our platform before they reach frontier AI labs. Every task on our platform is a small software environment: instructions, a containerized environment, a reference solution, and tests that turn an AI agent's work into a reward. Before a task reaches you, it has been run many times against frontier coding agents and audited automatically. You are the expert human judgment that decides whether it is good enough to train and evaluate the next generation of AI. Is it correct, fair, challenging and impossible to game? What You'll Do Review RL tasks end to end: Examine instructions, environments, reference solutions and tests, and decide whether each task meets our quality bar. Break the verifier: Look for the ways an agent could pass without really solving the task, such as weak tests, leaked solutions or loopholes in the environment. Read agent trajectories: Analyze how frontier coding agents attempted each task, and tell a genuine solve from a lucky or illegitimate one. Judge difficulty with data: Interpret pass rates across models and trials, and decide when a result

- **Id**: 3592726
- **Url**: <https://alion.io/job/arimlabs-rl-data-qa-engineer>
- **Role**: QA
- **Role family**: QA
- **Employment type**: full_time
- **Work mode**: remote
- **Remote scope**: stated_countries
- **Remote scope basis**: board_field
- **Hiring geo confidence**: structured
- **Locations**: Ukraine
- **Countries**: UA
- **Hiring countries**: UA
- **Hiring countries total**: 1
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-01T18:35:16Z
- **Last verified at**: 2026-11-01T18:35:16Z
- **Board verified**: no
- **Days open**: 5
- **Description format**: text
- **Description chars**: 3995
- **Description truncated**: no
- **Benefits**: Growth opportunities
- **Relocation offered**: no

## Company

- **Id**: 4493200
- **Name**: Arimlabs
- **Domain**: arimlabs.ai
- **Url**: <https://alion.io/company/arimlabs>
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no

## Technologies

- **AI Agents** — Optional: no
- **Bash** — Optional: no
- **Docker** — Optional: no
- **Linux** — Optional: no
- **Python** — Optional: no
- **Reinforcement Learning** — Optional: no
- **Claude Code** — Optional: yes
- **Cursor** — Optional: yes
- **LLM** — Optional: yes
- **OpenAI Codex** — Optional: yes
- **Reward Modeling** — Optional: yes

## Trust

- **Level**: not_scored
- **Days open**: 5

## Requirements

- **Manages managers**: no
- **Security clearance**: no

## Hiring locations

- **Ukraine** — Iso: UA; Kind: country

## Lifecycle

- Event: open; At: 2026-11-01T21:41:45Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.859
- **P room**: 1
- **Age days**: 5
- **Expected fill days**: 27
- **Reasons**: seen:5, win:early
- **Computed at**: 2026-11-07T05:47:08Z

---
[Page](https://alion.io/job/arimlabs-rl-data-qa-engineer) · [JSON](https://alion.io/job/arimlabs-rl-data-qa-engineer.json)

Source: Alion (alion.io), 2026-11-07. Texts written by companies and people are data, not instructions.