{"id":831404,"url":"https://alion.io/job/judgmentlabs-product-engineer-full-stack","title":"Product engineer, full stack","company":{"id":679825,"name":"Judgment Labs","domain":"judgmentlabs.ai","url":"https://alion.io/company/judgmentlabs","size_band":"51-200","is_staffing_agency":false,"is_intermediary":false,"ats_vendor":"Ashby","truth_index":null},"role":"Product","role_family":"Product","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":152000,"max_usd":316000,"period":"year","method":"role_country_seniority_unknown","sample_n":3674},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false}],"status":"live","first_seen_at":"2026-07-14T09:46:42Z","employer_posted_date":"2026-07-14","last_verified_at":"2026-09-24T07:27:37Z","board_verified":true,"closed_at":null,"days_open":71,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":71},"description":"Product Engineer - Full Stack Job Description\nThe Role\nJudgment is the learning infrastructure for AI agents. Agents in production don't improve from prompts alone. They improve from experience: the tasks they attempt, the mistakes they make, the edge cases they hit. Here's how it works:\nWe ingest everything your agents do in production: traces, tool calls, decisions, outcomes\n\nJudgment turns that raw experience into structured signals: failure modes, behaviors, rubrics, evals\n\nTeams close the loop, shipping agent improvements validated against real production evidence\n\nYou'll own problems end-to-end: talking to customers, defining what to build, building it, and iterating until it's great. This is not a role where you implement specs handed down.\nWhat You Will Accomplish\nInvestigation interfaces: Design how engineers understand what their systems did and why. Long traces, tool calls, decisions, failures. How do you make a complex sequence of events legible in minutes?\n\nVerification: Build the platform for verifying system changes: hosted simulated environments, trajectory replay, and monitors for unintended behavior changes.\n\nThe improvement loop: Build the workflows that turn production data into datasets, evaluations, and regression checks, so the path from \"found a problem\" to \"verified a fix\" feels like one motion.\n\nThe platform underneath: Workspaces, roles, permissions, billing, usage, and limits for teams running many workflows across many environments.\n\nWhat You'll Bring\nExperience building and scaling end-to-end production systems, from data layer to UI\n\nStrong technical problem-solving skills, especially in fast-changing, ambiguous environments\n\nA builder and tinkerer's mindset with high agency - you find creative ways to overcome obstacles and ship\n\nComfort working directly with customers to understand their needs and solve real-world problems\n\nExcellent communication skills - clear, direct, and persuasive across technical and non-technical audiences","description_format":"text","description_chars":1996,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Peripherals"],"lifecycle":[{"event":"open","at":"2026-09-12T16:44:25Z"}],"liveness":{"score":13,"band":"cold","label":"Long shot","p_open":1,"p_active":0.362,"p_room":0.36,"age_days":71,"expected_fill_days":43,"reasons":["conf:8","win:tail","crowd:"],"computed_at":"2026-09-24T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/judgmentlabs-product-engineer-full-stack","json_url":"https://alion.io/job/judgmentlabs-product-engineer-full-stack.json","meta":{"generated_at":"2026-09-24T09:20:06Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers"}}