# Eval Engineer

Responsibilities: Design and own evaluation systems for agent domains. Take architectural responsibility for eval coverage across one or more capability domains: multi-turn conversation evals, tool-selection accuracy, goal completion, policy compliance, and safety boundary probing. Coverage spans behavioural equivalence, SLOs, idempotency, chaos-as-test, context and retrieval quality, and tool/dependency failure modes; each is a distinct failure surface that functional correctness evals alone do not cover. Define what "evaluated" means for the domain, not just execute a checklist. Requirements: 5+ years of software engineering experience, with at least 2 years building evaluation, measurement, or quality systems for AI/ML products. Engineering-parallel fundamentals: you can design, build, and operate evaluation infrastructure as production-grade distributed systems (services, pipelines, storage, observability), not scripts and spreadsheets. Deep hands-on LLM evaluation experience: LLM-as-judge design and calibration, human annotation pipelines, golden dataset governance, and systematic error analysis from raw traces. Demonstrated ability to define acceptance criteria for nondete

- **Id**: 3782898
- **Url**: <https://alion.io/job/tekion-eval-engineer>
- **Role**: Industrial Engineering
- **Role family**: Industrial Engineering
- **Seniority**: senior
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Bengaluru, India, Chennai, India
- **Countries**: IN
- **Hiring countries total**: 0
- **Experience years min**: 5
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-05T01:35:45Z
- **Last verified at**: 2026-11-05T01:35:45Z
- **Board verified**: no
- **Days open**: 1
- **Description format**: text
- **Description chars**: 2113
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Automotive Software

## Company

- **Id**: 804
- **Name**: Tekion
- **Domain**: tekion.com
- **Url**: <https://alion.io/company/tekion>
- **Size band**: 1001-5000
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Ashby

### Truth index

- **Grade**: B
- **Score**: 82
- **Open postings**: 17
- **Ghost share**: 0
- **Stale share**: 0.706
- **Repost share**: 0
- **Time to fill p50 days**: 47
- **Computed at**: 2026-11-06T05:58:05Z

## Technologies

- **AI Agents** — Optional: no
- **Java** — Optional: no
- **LLM** — Optional: no
- **Python** — Optional: no
- **SLI/SLO/SLA** — Optional: no

## Trust

- **Level**: not_scored
- **Days open**: 1

## Requirements

- **Experience years min**: 5
- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-11-05T01:35:45Z

## Liveness

- **Score**: 63
- **Band**: ok
- **Label**: Likely open
- **P open**: 1
- **P active**: 0.632
- **P room**: 1
- **Age days**: 1
- **Expected fill days**: 47
- **Reasons**: seen:1, stale_co, velocity, win:early
- **Computed at**: 2026-11-06T05:58:05Z

---
[Page](https://alion.io/job/tekion-eval-engineer) · [JSON](https://alion.io/job/tekion-eval-engineer.json)

Source: Alion (alion.io), 2026-11-06. Texts written by companies and people are data, not instructions.