585,223open jobs
25,872companies
81,805added this week
Browse all
Salary
$127k – $257k per year (Estimated)
Location
Remote (United States)
Seniority
Staff · 8+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match

We are helping our client find exceptional Software Engineer - Technical Advisors who want to spend a focused period doing something most engineers never get to do: find out exactly where frontier models break on real engineering work.

You will take on hard problems across production-grade codebases, then work out precisely where and why model-generated solutions fall short. You will also build the hard problems those models are tested on. Your judgment about what separates good engineering from plausible engineering is the entire point of the role.

What you'll do

  • Evaluate Agent Sessions: Analyze how AI coding agents behave over entire coding sessions-tracking what the agent investigates, verifies, assumes, and leaves undone.
  • Review Model-Written Pull Requests: Audit model-generated pull requests against real production repositories, documenting every identified issue alongside its severity and detailed technical rationale.
  • Build Evaluation Benchmarks: Design and construct hard, container-based problems that serve as rigorous test benchmarks for frontier models.
  • Collaborate with AI Researchers: Work directly alongside AI researchers on frontier problems, producing clear written analyses that explain root-cause failures and boundary-condition gaps.
  • Maintain High Written Rationale Standards: Author original, clear technical rationale for all evaluations (all written deliverables must be independently authored without AI text generation, though AI tools are welcomed for codebase exploration and running test suites).

Requirements

Requirements:

  • 8+ years of production engineering experience preferred (exceptions only for clearly exceptional profiles).
  • Backgrounds including Senior, Staff, or Principal Software Engineers, Tech Leads, or Open-Source Maintainers.
  • Experience working in production codebases with a strict code review culture (startups, big tech, or open source are all acceptable).
  • Polyglot adaptability: Heavy experience with Python and TypeScript is common, but must be comfortable dropping into unfamiliar languages weekly.
  • Core Tooling: Demonstrated comfort using Docker, git, and the Command Line Interface (CLI) to reproduce, isolate, and debug results locally.
  • Cross-Layer Fluency: Comfort working across backend, frontend, APIs, data, testing, or developer tooling.
  • Strong written communication skills-able to articulate why code fails, not just how to fix it quickly.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
585,223 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
$61k – $157k per year (Estimated) • Remote/Hybrid • Full-Time • 7+ years exp • Wellington • Auckland
Python
Java
TypeScript
Java
Spring Framework
Spring Boot
Databases
PostgreSQL
Apache Kafka
DevOps
Rest API
Splunk
OpenShift
Dynatrace
Kong
Azure
CI/CD
Jenkins
AWS
Kubernetes
Spinnaker
Platform Engineering
Amazon EKS
Azure AKS
Management
Agile
Apply
$47k – $103k per year (Estimated) • In office • 2+ years exp • Bachelor's Degree • Auckland
Python
C++
Apply
$87k – $184k per year (Estimated) • In office • 8+ years exp • Bachelor's Degree • Toronto
Python
Apply
In office • 3+ years exp • Bachelor's Degree
Python
Verilog
Perl
AI/ML
Edge AI
Chips/EDA
Synopsys PrimeTime
Synopsys Fusion Compiler
Synopsys IC Compiler II
Apply
$154k – $257k per year (Estimated) • In office • 5+ years exp • Bachelor's Degree • Vancouver
Python
C++
Apply
Assembly Technician 3 days ago
$49k – $118k per year (Estimated) • In office • San Francisco
Apply
Simulation Engineer 4 days ago
$81k – $209k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • New York
Python
Rust
C++
Robotics
Gazebo
Isaac Sim
MuJoCo
Apply
$72k – $187k per year (Estimated) • In office • Contractor • 5+ years exp • Fremont
Python
Java
Apply
$85k – $221k per year (Estimated) • In office • Contractor • San Francisco
DevOps
SLI/SLO/SLA
Design
SolidWorks
Fusion 360
Apply
$59k – $143k per year (Estimated) • In office • Contractor • Tempe
Apply
See all jobs
This is one of many
585,223 more open roles from verified company boards, updated every day.