# AI Evaluation Engineer based in EU

About This Opportunity We are currently building a talent pool of experienced AI Evaluation Engineers for an upcoming client project focused on AI model assessment, benchmarking, and quality assurance. This is a freelance, project-based engagement, with project scope, duration, workload, and onboarding timelines currently being finalized. We welcome expressions of interest from qualified professionals with relevant technical and evaluation experience. At this stage, we are proactively connecting with qualified professionals who may be interested in participating in the project. Candidates who are a potential fit will be considered and contacted as the project details are confirmed and the engagement moves forward. Job Summary We are seeking an AI Evaluation Engineer to assess, validate, and improve AI task quality across the end-to-end evaluation pipeline. The ideal candidate possesses strong software engineering skills, hands-on experience with Python-based environments, and the ability to identify root causes of issues within AI evaluation, benchmarking, and rollout processes. Key Responsibilities Evaluate and analyze AI tasks, benchmarks, and execution traces to identify quality

- **Id**: 3856177
- **Url**: <https://alion.io/job/thoth-pte-ltd-ai-evaluation-engineer-based-in-eu>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Employment type**: part_time
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Hiring countries total**: 0
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-09-08T17:06:48Z
- **Employer posted date**: 2026-09-08
- **Last verified at**: 2026-11-20T16:22:58Z
- **Board verified**: yes
- **Days open**: 73
- **Description format**: text
- **Description chars**: 3228
- **Description truncated**: no
- **Relocation offered**: no

## Company

- **Id**: 3775644
- **Name**: Thoth Pte. Ltd.
- **Domain**: aithoth.com
- **Url**: <https://alion.io/company/aithoth>
- **Size band**: 501-1000
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Moka

## Technologies

- **Claude Code** — Optional: no
- **Docker** — Optional: no
- **OpenAI Codex** — Optional: no
- **Python** — Optional: no
- **Reinforcement Learning** — Optional: yes

## Trust

- **Level**: ok
- **Days open**: 73

## Requirements

- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: bachelor
- **Optional**: yes

## Lifecycle

- Event: open; At: 2026-11-06T06:33:14Z

## Liveness

- **Score**: 11
- **Band**: cold
- **Label**: Long shot
- **P open**: 1
- **P active**: 0.398
- **P room**: 0.28
- **Age days**: 72
- **Expected fill days**: 27
- **Reasons**: conf:2, win:tail, crowd:
- **Computed at**: 2026-11-20T05:46:30Z

---
[Page](https://alion.io/job/thoth-pte-ltd-ai-evaluation-engineer-based-in-eu) · [JSON](https://alion.io/job/thoth-pte-ltd-ai-evaluation-engineer-based-in-eu.json)

Source: Alion (alion.io), 2026-11-20. Texts written by companies and people are data, not instructions.
