Confirmed on the employer's own hiring board on Nov 16, 2026. First seen by Alion on Nov 16, 2026. Raydar scores B on the Alion truth index.
About the company
Our client is a software company.
The role
Raydar is recruiting for this role on behalf of our client. Own how an AI product team measures and improves the quality of its autonomous systems, pairing evaluation design with hands-on backend engineering. The role combines technical leadership on reliability with building the platform services that support these systems in production.
What you'll do
- Shape the team's approach to evaluation strategy and structured error analysis.
- Design and build knowledge and evaluation infrastructure for long-running AI systems.
- Lead investigations into AI system behavior and turn findings into platform-wide reliability fixes.
- Build and strengthen backend services that run, assess and monitor AI workloads at scale.
- Help set the reliability and quality roadmap for the AI platform, working closely with the wider AI team.
- Coach engineers on evaluation rigor and analytical practice.
Requirements
What we're looking for
- 1-2 years of experience building end-to-end AI agents or AI platforms at scale, including agent loops, evaluations and error analysis.
- Demonstrated seniority well beyond early-career engineering; founders with a strong record are also considered.
- Backend, data platform or full-stack engineering experience.
- Proven experience putting high-volume, externally facing AI software into live operation.
- Comfortable with a split schedule that includes roughly three on-site days weekly in the San Francisco area.
Bonus points
- Experience at recently IPO'd technology companies or AI-native startups.
- Distributed systems experience.
- Degree from a top 50 computer science program, in the US or internationally.
Benefits
Compensation and benefits
- Base salary: $220K to $315K
- Equity
Location and work model
- San Francisco, CA, United States
- Hybrid, 3 days in-office
- Full-time

