# Member of Technical Staff, Product Engineer/Full Stack

About Judgment Judgment Labs is building the infrastructure for continual learning in long-horizon AI agents. We turn long agent trajectories into clean, structured data for evals, labeling, rubric generation, context engineering, and RL workflows. Instead of only showing teams what happened, Judgment helps decide what matters, what should be learned from, and how that learning should flow back into the agent. We’ve raised $32M across two rounds led by Lightspeed. The Role You'll own problems end-to-end: talking to customers, defining what to build, building it, and iterating until it's great. This is not a role where you implement specs handed down. What You’ll Do Investigation interfaces: Design how engineers understand what their systems did and why. Long traces, tool calls, decisions, failures. How do you make a complex sequence of events legible in minutes? Verification: Build the platform for verifying system changes: hosted simulated environments, trajectory replay, and monitors for unintended behavior changes. The improvement loop: Build the workflows that turn production data into datasets, evaluations, and regression checks, so the path from "found a problem" to "verifi

- **Id**: 831404
- **Url**: <https://alion.io/job/judgmentlabs-product-engineer-full-stack>
- **Role**: Backend
- **Role family**: Backend
- **Seniority**: staff
- **Employment type**: full_time
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: San Francisco, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Experience years min**: 5
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-07-14T09:46:42Z
- **Employer posted date**: 2026-07-14
- **Last verified at**: 2026-11-10T01:41:55Z
- **Board verified**: yes
- **Days open**: 118
- **Description format**: text
- **Description chars**: 2450
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: AI Agents, AI Evaluation & Observability

## Company

- **Id**: 679825
- **Name**: Judgment Labs
- **Domain**: judgmentlabs.ai
- **Url**: <https://alion.io/company/judgmentlabs>
- **Size band**: 51-200
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Ashby

## Salary estimate

- **Min usd**: 198000
- **Max usd**: 370000
- **Period**: year
- **Method**: role_seniority_country_remote_cell
- **Sample n**: 1500

## Technologies

- **AI Agents** — Optional: no
- **Context Engineering** — Optional: no

## Trust

- **Level**: stale
- **Repost count**: 0
- **Flags**: stale
- **Days open**: 117

## Requirements

- **Experience years min**: 5
- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-09-12T16:44:25Z

## Visa

- Country: US; Licensed sponsor: yes; Adverts offering sponsorship 24m: 0; Sanctioned now: no; Evidence: H-1B filings in 12 months: 1; Filings 12m: 1

## Liveness

- **Score**: 14
- **Band**: cold
- **Label**: Long shot
- **P open**: 1
- **P active**: 0.485
- **P room**: 0.28
- **Age days**: 117
- **Expected fill days**: 41
- **Reasons**: conf:0, win:tail, crowd:
- **Computed at**: 2026-11-09T06:03:00Z

---
[Page](https://alion.io/job/judgmentlabs-product-engineer-full-stack) · [JSON](https://alion.io/job/judgmentlabs-product-engineer-full-stack.json)

Source: Alion (alion.io), 2026-11-10. Texts written by companies and people are data, not instructions.