# Member of Technical Staff, Agents

About Judgment Judgment Labs is building the infrastructure for continual learning in long-horizon AI agents. We turn long agent trajectories into clean, structured data for evals, labeling, rubric generation, context engineering, and RL workflows. Instead of only showing teams what happened, Judgment helps decide what matters, what should be learned from, and how that learning should flow back into the agent. We’ve raised $32M across two rounds led by Lightspeed. The Role You'll build the product experiences that make this loop legible, and you'll build the agents that run it. This is not a role where you implement specs handed down. You'll own problems end-to-end: talking to customers, defining what to build, building it, and iterating until it's great. What You’ll Do Judgment Agent: Shape how the Judgment Agent runs large-scale investigations: parallel investigators working across thousands of production traces, each covering a different dimension (failure modes, tool errors, regressions, drift), merging results into one answer. Verification: Build the platform for verifying agent changes: hosted simulated environments for stateful agent evals, trajectory replay against changed

- **Id**: 831402
- **Url**: <https://alion.io/job/judgmentlabs-product-engineer-agent>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Seniority**: staff
- **Employment type**: full_time
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: San Francisco, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-08-13T07:25:41Z
- **Employer posted date**: 2026-08-13
- **Last verified at**: 2026-11-10T01:41:55Z
- **Board verified**: yes
- **Days open**: 88
- **Description format**: text
- **Description chars**: 3504
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: AI Agents, AI Evaluation & Observability

## Company

- **Id**: 679825
- **Name**: Judgment Labs
- **Domain**: judgmentlabs.ai
- **Url**: <https://alion.io/company/judgmentlabs>
- **Size band**: 51-200
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Ashby

## Salary estimate

- **Min usd**: 202000
- **Max usd**: 401000
- **Period**: year
- **Method**: role_seniority_country_remote_cell
- **Sample n**: 890

## Technologies

- **AI Agents** — Optional: no
- **Claude Code** — Optional: no
- **Context Engineering** — Optional: no
- **Machine Learning** — Optional: no
- **OpenAI Codex** — Optional: no
- **Post-training** — Optional: no
- **Reinforcement Learning** — Optional: no

## Trust

- **Level**: ok
- **Days open**: 88

## Requirements

- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-09-12T16:44:25Z

## Visa

- Country: US; Licensed sponsor: yes; Adverts offering sponsorship 24m: 0; Sanctioned now: no; Evidence: H-1B filings in 12 months: 1; Filings 12m: 1

## Liveness

- **Score**: 16
- **Band**: cold
- **Label**: Long shot
- **P open**: 1
- **P active**: 0.566
- **P room**: 0.28
- **Age days**: 87
- **Expected fill days**: 41
- **Reasons**: conf:0, win:tail, crowd:
- **Computed at**: 2026-11-09T06:03:00Z

---
[Page](https://alion.io/job/judgmentlabs-product-engineer-agent) · [JSON](https://alion.io/job/judgmentlabs-product-engineer-agent.json)

Source: Alion (alion.io), 2026-11-10. Texts written by companies and people are data, not instructions.