Confirmed on the employer's own hiring board on Nov 2, 2026. First seen by Alion on Oct 4, 2026.
Bring senior ai/ml expertise to AI evaluation projects focused on model evaluation, data leakage, training assumptions, and ML reliability.
Review model responses and worked examples for incorrect technical assumptions, missing failure cases, and reliability or security gaps. Assess whether the reasoning meets professional standards for the stated task.
Write reference answers and scoring criteria grounded in model evaluation, data leakage, training assumptions, and ML reliability. Explain consequential errors, evidence gaps, and the reasoning behind your corrections.
This is remote, project-based contract work. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.
Responsibilities
- Evaluate advanced domain tasks and AI-generated responses for factual accuracy and professional judgment.
- Apply current standards, methods, and risk considerations from technology & computing.
- Document errors, edge cases, and the reasoning behind an ideal response.
- Collaborate asynchronously with Alpheva's research and evaluation teams.
Required Qualifications
- 7+ years of substantive experience in applied machine learning or ML research.
- Demonstrated senior-level judgment in model evaluation, data leakage, training assumptions, and ML reliability, with substantial responsibility for reviewing or delivering this work.
- Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.

