Salary
≈ $127k – $257k per year (Estimated)
Location
Remote (United States)
Seniority
Staff · 8+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match
We are helping our client find exceptional Software Engineer - Technical Advisors who want to spend a focused period doing something most engineers never get to do: find out exactly where frontier models break on real engineering work.
You will take on hard problems across production-grade codebases, then work out precisely where and why model-generated solutions fall short. You will also build the hard problems those models are tested on. Your judgment about what separates good engineering from plausible engineering is the entire point of the role.
What you'll do
- Evaluate Agent Sessions: Analyze how AI coding agents behave over entire coding sessions-tracking what the agent investigates, verifies, assumes, and leaves undone.
- Review Model-Written Pull Requests: Audit model-generated pull requests against real production repositories, documenting every identified issue alongside its severity and detailed technical rationale.
- Build Evaluation Benchmarks: Design and construct hard, container-based problems that serve as rigorous test benchmarks for frontier models.
- Collaborate with AI Researchers: Work directly alongside AI researchers on frontier problems, producing clear written analyses that explain root-cause failures and boundary-condition gaps.
- Maintain High Written Rationale Standards: Author original, clear technical rationale for all evaluations (all written deliverables must be independently authored without AI text generation, though AI tools are welcomed for codebase exploration and running test suites).
Requirements
Requirements:
- 8+ years of production engineering experience preferred (exceptions only for clearly exceptional profiles).
- Backgrounds including Senior, Staff, or Principal Software Engineers, Tech Leads, or Open-Source Maintainers.
- Experience working in production codebases with a strict code review culture (startups, big tech, or open source are all acceptable).
- Polyglot adaptability: Heavy experience with Python and TypeScript is common, but must be comfortable dropping into unfamiliar languages weekly.
- Core Tooling: Demonstrated comfort using Docker, git, and the Command Line Interface (CLI) to reproduce, isolate, and debug results locally.
- Cross-Layer Fluency: Comfort working across backend, frontend, APIs, data, testing, or developer tooling.
- Strong written communication skills-able to articulate why code fails, not just how to fix it quickly.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
585,223 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Your match
How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.
Recommended for you based on this role
Similar stack
Same company
In your city
Senior Technical Specialist
1 day ago
≈ $61k – $157k per year (Estimated) • Remote/Hybrid • Full-Time • 7+ years exp • Wellington • Auckland
Python
Java
TypeScript
Java
Spring Framework
Spring Boot
Databases
PostgreSQL
Apache Kafka
DevOps
Rest API
Splunk
OpenShift
Dynatrace
Kong
Azure
CI/CD
Jenkins
AWS
Kubernetes
Spinnaker
Platform Engineering
Amazon EKS
Azure AKS
Management
Agile
Apply
Flight Software Engineer I
1 day ago
≈ $47k – $103k per year (Estimated) • In office • 2+ years exp • Bachelor's Degree • Auckland
Python
C++
Apply
Analog Design, Principal Engineer-18339
1 day ago
≈ $87k – $184k per year (Estimated) • In office • 8+ years exp • Bachelor's Degree • Toronto
Python
Apply
In office • 3+ years exp • Bachelor's Degree
Python
Verilog
Perl
AI/ML
Edge AI
Chips/EDA
Synopsys PrimeTime
Synopsys Fusion Compiler
Synopsys IC Compiler II
Apply
R&D Engineering, Staff Engineer - 16018
1 day ago
≈ $154k – $257k per year (Estimated) • In office • 5+ years exp • Bachelor's Degree • Vancouver
Python
C++
Apply
Apply
Simulation Engineer
4 days ago
≈ $81k – $209k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • New York
Python
Rust
C++
Robotics
Gazebo
Isaac Sim
MuJoCo
Apply
≈ $72k – $187k per year (Estimated) • In office • Contractor • 5+ years exp • Fremont
Python
Java
Apply
Mechanical Engineer, Rapid Prototyping
18 days ago
≈ $85k – $221k per year (Estimated) • In office • Contractor • San Francisco
DevOps
SLI/SLO/SLA
Design
SolidWorks
Fusion 360
Apply
Robot Service Technician Assistant
23 days ago
≈ $59k – $143k per year (Estimated) • In office • Contractor • Tempe
Apply
This is one of many
585,223 more open roles from verified company boards, updated every day.

