Research Engineer, QC Automation
About the Role
This is a top-priority hire on the Engineering team at an early-stage AI infrastructure company focused on reinforcement learning environments and post-training data. You will own the automation of quality control for training data produced by companies using the platform, building systems that scale quality to meet growing demand. The team is small, technical, and fast-moving, with backgrounds spanning competitive programming, AI research, and startup founding.
What You'll Do
Automate QC for training data created by companies using the platform's infrastructure.
Build QC systems grounded in true understanding and human judgment, rather than heavy reliance on LLMs.
Define and enforce quality standards for training data across the platform.
Design experiments and metrics to evaluate and grade agent outputs.
Partner with data vendors to debug quality issues, diagnose agent failure modes, and improve their data generation processes.
Translate QC learnings into auditing systems, including sampling strategies and rule-based or model-assisted validation pipelines.
Continuously integrate QC insights into infrastructure tools and vendor-facing systems to reduce anomalies, inconsistencies, and edge cases.
What We're Looking For
2 to 4 years of experience in engineering or research roles, ideally with a focus on QC automation or data quality.
Proficiency in Python, Docker, and Linux environments.
Proven experience building scalable data validation pipelines and automated QA/QC systems end-to-end, without a fully prescribed roadmap.
Experience working on benchmarks and evaluations for RL training data, including defining realistic tasks, reliable rubrics, and useful trajectories.
Experience creating QC systems based on human judgment rather than LLM-centric approaches.
Experience designing experiments and metrics to grade agent outputs, and partnering with data vendors to provide actionable feedback.
Solid knowledge of statistics and comfort designing metrics and QA/QC processes.
Strong written and verbal communication skills for working across time zones.
Genuine curiosity, comfort in unstructured problem spaces, and the ability to work independently in a fast-paced startup environment.
Compensation & Benefits
Salary range: $150,000 to $250,000 USD annually. Visa sponsorship is available.
Location
On-site in Singapore. Candidates based in San Francisco or fully remote independent contractors (particularly from Europe) may also be considered depending on location.