# ML Inference Engineer – Terminal-Bench Task Designer

Headquarters: Overview We are building a benchmark that tests how well AI agents handle real expert work in a terminal. We are hiring ML inference and serving experts to turn real, paid tasks from their jobs into expert-level Terminal-Bench challenges. Each task includes the environment, a working solution, and an automated check that proves the result is correct. ***THIS IS A TASK BASED COMPENSATION MODEL. PLEASE CHECK THE APPLICATION QUESTIONS FOR MORE DETAILS.*** Responsibilities • Design expert-level Terminal-Bench tasks that turn real, paid ML inference work from your own experience into challenges an AI agent must solve end to end. • Define the files, systems and environments each task runs on, such as model serving with streaming, so the challenge is realistic, reproducible and command-line solvable. • Write a working reference solution for every task and verify it runs end to end, sized for about 60 to 75 minutes of expert effort. • Build automated checks that objectively prove a result is correct, including cases where ML outputs go wrong silently, such as numerical drift or metric bugs. • Package tasks with Docker and Git so they are reproducible, and document the syste

- **Id**: 3779030
- **Url**: <https://alion.io/job/toptal-ml-inference-engineer-terminal-bench-task-designer>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Seniority**: middle
- **Work mode**: remote
- **Remote scope**: unspecified
- **Hiring geo confidence**: inferred
- **Hiring countries total**: 0
- **Experience years min**: 3
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-04T21:41:56Z
- **Last verified at**: 2026-11-04T21:41:56Z
- **Board verified**: no
- **Days open**: 4
- **Description format**: text
- **Description chars**: 2796
- **Description truncated**: no
- **Relocation offered**: no

## Company

- **Id**: 5450
- **Name**: Toptal
- **Domain**: toptal.com
- **Url**: <https://alion.io/company/toptal>
- **Is staffing agency**: yes
- **Employer type**: agency
- **Is intermediary**: yes
- **Ats vendor**: Lever

### Truth index

- **Grade**: B
- **Score**: 70
- **Open postings**: 6
- **Ghost share**: 0
- **Stale share**: 1
- **Repost share**: 0
- **Time to fill p50 days**: 68
- **Computed at**: 2026-11-09T06:03:00Z

## Technologies

- **AI Agents** — Optional: no
- **Docker** — Optional: no
- **Git** — Optional: no
- **JAX** — Optional: no
- **LLM** — Optional: no
- **Python** — Optional: no
- **PyTorch** — Optional: no
- **SGLang** — Optional: no
- **TensorRT-LLM** — Optional: no
- **vLLM** — Optional: no
- **TensorRT** — Optional: yes

## Trust

- **Level**: not_scored
- **Days open**: 4

## Requirements

- **Experience years min**: 3
- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-11-05T00:15:15Z

## Liveness

- **Score**: 54
- **Band**: ok
- **Label**: Likely open
- **P open**: 1
- **P active**: 0.542
- **P room**: 1
- **Age days**: 4
- **Expected fill days**: 68
- **Reasons**: seen:4, agency, velocity, win:early
- **Computed at**: 2026-11-09T06:03:00Z

---
[Page](https://alion.io/job/toptal-ml-inference-engineer-terminal-bench-task-designer) · [JSON](https://alion.io/job/toptal-ml-inference-engineer-terminal-bench-task-designer.json)

Source: Alion (alion.io), 2026-11-09. Texts written by companies and people are data, not instructions.