# Senior Software Engineer, Model Evaluation

About the Role Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably. What You'll Do Design and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking. Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders. Train and fine-tune models, using evaluation results to guide experiments. Identify agent failures, improve production systems, and measure whether changes work. Help establish the team's research and evaluation practices. What We're Looking For At least 3 years of experience, operating at a senior or staff level. Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks. Practical experience training and fine-tuning models, not only using models through APIs. Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks. Supply-chain, pro

- **Id**: 4588622
- **Url**: <https://alion.io/job/clera-senior-software-engineer-model-evaluation>
- **Role**: Backend
- **Role family**: Backend
- **Seniority**: senior
- **Employment type**: full_time
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: San Francisco, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Experience years min**: 3
- **Visa sponsorship**: yes
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-19T02:45:34Z
- **Employer posted date**: 2026-11-19
- **Last verified at**: 2026-11-19T14:13:59Z
- **Board verified**: yes
- **Days open**: 0
- **Description format**: text
- **Description chars**: 1459
- **Description truncated**: no
- **Benefits**: Equity
- **Relocation offered**: no

## Company

- **Id**: 2706
- **Name**: Clera
- **Domain**: getclera.com
- **Url**: <https://alion.io/company/clera>
- **Size band**: 11-50
- **Is staffing agency**: yes
- **Employer type**: agency
- **Is intermediary**: no
- **Ats vendor**: Ashby

### Truth index

- **Grade**: B
- **Score**: 80
- **Open postings**: 40
- **Ghost share**: 0
- **Stale share**: 1
- **Repost share**: 0
- **Time to fill p50 days**: 6
- **Computed at**: 2026-11-19T09:08:57Z

## Salary

- **Min**: 180000
- **Max**: 250000
- **Currency**: USD
- **Period**: year
- **Usd annual**: 250000

## Technologies

- **Fine-tuning** — Optional: no

## Trust

- **Level**: ok
- **Days open**: 0

## Requirements

- **Experience years min**: 3
- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-11-19T07:50:13Z

## Visa

- Country: US; Licensed sponsor: no; Adverts offering sponsorship 24m: 45; Sanctioned now: no; Evidence: Offered visa sponsorship in 45 of its adverts here in 24 months; Filings 12m: 0

## Liveness

- **Score**: 36
- **Band**: fade
- **Label**: Fading
- **P open**: 1
- **P active**: 0.361
- **P room**: 1
- **Age days**: 0
- **Expected fill days**: 6
- **Reasons**: conf:1, agency, stale_co, win:early, comp:brand
- **Computed at**: 2026-11-19T09:08:57Z

## Pay

- **Stated usd annual**: 250000
- **Is top pay**: yes

---
[Page](https://alion.io/job/clera-senior-software-engineer-model-evaluation) · [JSON](https://alion.io/job/clera-senior-software-engineer-model-evaluation.json)

Source: Alion (alion.io), 2026-11-19. Texts written by companies and people are data, not instructions.
