# Software Engineer – AI Evaluation Expert (Contractual)

About Patronus AI Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on a mission to simulate all of the world’s intelligence. We are the team behind some of the earliest and most influential research in AI evaluation likeFinanceBench, Lynx,SimpleSafetyTests,CopyrightCatcher,Humanity’s Last Exam, and more. We are formerly AI researchers and engineers from companies like Meta AI, Amazon AGI, and Google. Our customers include foundation model labs and Fortune 500 enterprises like Adobe. We are backed by top-tier investors like Lightspeed Venture Partners, Notable Capital, Stanford University, Noam Brown, Gokul Rajaram, and more. About the roleWe are looking for experienced software engineers (task-based contract) to design realistic, challenging tasks for frontier AI models and to judge how well those models handle them. You'll apply your day-to-day engineering judgment to show where AI gets code, reasoning and technical instructions right, and where it falls short. What you’ll doDepending on the project, you may: Design realistic, multi-step coding and technical tasks that test an AI model's abili

- **Id**: 3784705
- **Url**: <https://alion.io/job/patronus-ai-software-engineer-ai-evaluation-expert-contractual-2>
- **Role**: Backend
- **Role family**: Backend
- **Seniority**: senior
- **Employment type**: contractor
- **Work mode**: remote
- **Remote scope**: stated_countries
- **Remote scope basis**: posting_text
- **Hiring geo confidence**: inferred
- **Hiring countries**: IN
- **Hiring countries total**: 1
- **Experience years min**: 2
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-05T01:32:16Z
- **Last verified at**: 2026-11-05T01:32:16Z
- **Board verified**: no
- **Days open**: 6
- **Description format**: text
- **Description chars**: 4039
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Artificial Intelligence

## Company

- **Id**: 4511141
- **Name**: Patronus AI
- **Domain**: patronusai.com
- **Url**: <https://alion.io/company/patronus-ai>
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no

## Salary

- **Min**: 30
- **Max**: 100
- **Currency**: USD
- **Period**: hour
- **Usd annual**: 200000

## Technologies

- **C++** — Optional: no
- **JavaScript** — Optional: no
- **LLM** — Optional: no
- **Python** — Optional: no
- **TypeScript** — Optional: no

## Trust

- **Level**: not_scored
- **Days open**: 6

## Requirements

- **Experience years min**: 2
- **Manages managers**: no
- **Security clearance**: no

## Hiring locations

- **India** — Iso: IN; Kind: country

## Lifecycle

- Event: open; At: 2026-11-05T02:28:45Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 6
- **Expected fill days**: 30
- **Reasons**: seen:6, win:early
- **Computed at**: 2026-11-11T05:49:22Z

## Pay

- **Stated usd annual**: 200000
- **Is top pay**: yes

---
[Page](https://alion.io/job/patronus-ai-software-engineer-ai-evaluation-expert-contractual-2) · [JSON](https://alion.io/job/patronus-ai-software-engineer-ai-evaluation-expert-contractual-2.json)

Source: Alion (alion.io), 2026-11-11. Texts written by companies and people are data, not instructions.