2,018,701open jobs
119,523companies
251,634added this week
Browse all
Salary
$150k – $300k per year
Location
In office (San Francisco)
Seniority
Senior · 3+ years exp
Visa
Filed H-1B visas in the last two years
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 28, 2026. First seen by Alion on Oct 27, 2026.

Overview
Company
Impact
Profile match
Coval helps teams prove voice agents are ready with voice AI testing, production evals, and human QA across the full agent lifecycle.

The role

Own the systems behind Coval’s evaluations. Coval is the evaluation platform for conversational AI: we help enterprise teams simulate before launch, observe in production and review with humans. This role owns the machinery that makes all of it run.

That means the distributed pipelines, queues and orchestration that score tens of thousands of conversations a day, plus the data layer and cost controls underneath them. You’ll own the systems enterprises run their voice agents through, and you’ll get in while they’re still being built.

What you’ll do

  • Build out our distributed execution engine: the workers, queues and orchestration that fan out tens of thousands of simulated conversations a day and bring back scores
  • Own the data side, from the databases holding conversations, audio and judge results to the pipelines that move them between stages
  • Make real cost trade-offs. Every model call and storage byte has a price, and you keep unit economics sane as volume climbs
  • Stand up and maintain the environments where our LoRA training jobs run, as a key part of the plumbing for our ML work

What we’re looking for

  • 4+ years building real systems, with Python and AWS as home turf
  • Experience with managed services and Terraform, which we use heavily, and the judgment to know when a managed service stops being the right answer
  • You’ve operated something under load and know what it feels like when a queue backs up at 2am
  • You can look at a half-built system and decide what to finish, what to fix, what to start next and what to buy time on
  • High agency: on a small Series A team, nobody writes your tickets. You figure out what matters next and take it there
  • Ambitious and kind. As a founding member of the engineering team, you’ll shape the architecture and the standards everyone else builds against
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,018,701 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

DevOps
Similar stack
Same company
San Francisco
$89k – $133k per year · Hybrid · Full-Time · 5+ years exp · Bachelor's Degree · Rochester · Cleveland · Columbus
Python
PowerShell
DevOps
Ansible
GCP
VMWare
Azure
Windows Server
Git
AWS
Docker
Kubernetes
Bitbucket
Google GKE
Proxmox VE
Incident Management
Linux
Windows
DNS
DHCP
Cybersecurity
Active Directory
LDAP
Management
Jira
Agile
Scrum
Kanban
Apply
$115k – $150k per year · Hybrid · Full-Time · 7+ years exp · Denver
Python
JavaScript
TypeScript
C#
DevOps
Splunk
New Relic
Datadog
Dynatrace
Azure
CI/CD
AWS
Platform Engineering
Amazon CloudWatch
Apply
$220k – $405k per year · In office · Full-Time · San Francisco · Seattle · New York
Python
Rust
Databases
PostgreSQL
Redis
DynamoDB
ElasticSearch
Vespa
AI/ML
Perplexity
CoreWeave
DevOps
Terraform
GCP
Helm
Cilium
Istio
Datadog
Envoy
Prometheus
CI/CD
GitOps
ArgoCD
AWS
Kubernetes
Grafana
Karpenter
Amazon EKS
Amazon EC2
eBPF
Progressive Delivery
FinOps
SLI/SLO/SLA
Amazon S3
IAM
TCP/IP
DNS
Cybersecurity
SOC 2
Apply
$80k – $160k per year · Remote (United States) · Full-Time · Bachelor's Degree · United States
Apply
$136k – $232k per year · Equity · In office · Full-Time · 4+ years exp · Bachelor's Degree · Milpitas
Python
Go
Bash
AI/ML
Machine Learning
DevOps
Terraform
Ansible
GCP
OpenShift
Helm
OpenTelemetry
VMWare
K3s
Prometheus
Azure
CI/CD
GitOps
ArgoCD
AWS
Docker
Kubernetes
Grafana
Configuration Management
KVM
Hyper-V
Linux
TCP/IP
DNS
Apply
≈ $13k – $34k per year (Estimated) · Hybrid · 3+ years exp · Bachelor's Degree · Pasig
Python
SQL
Databases
Snowflake
Google BigQuery
Amazon Redshift
AI/ML
Unstructured.io
Dagster
dbt
DevOps
Terraform
CloudFormation
AWS
Docker
Kubernetes
Trunk-Based Development
Incident Management
Analytics
ETL/ELT
Dimensional Modeling
Apply
Hybrid · 4+ years exp · Pasig
Python
DevOps
CI/CD
AWS
Windows
Apply
≈ $162k – $304k per year (Estimated) · In office · 10+ years exp · Bachelor's Degree · Austin
Python
Java
SQL
Databases
PostgreSQL
AI/ML
Scikit-learn
Pandas
NumPy
DevOps
GCP
Datadog
Azure
AWS
Grafana
Analytics
Power BI
Matplotlib
Apply
$150k – $300k per year · Equity 0–1% · In office · Full-Time · 3+ years exp · San Francisco
AI/ML
LoRA
Function Calling
PEFT
LLM
SFT
Post-training
Structured Outputs
Context Engineering
Voice Agents
Apply
≈ $11k – $21k per year (Estimated) · Hybrid · 5+ years exp · Mandaluyong
Python
SQL
Databases
Snowflake
Google BigQuery
DevOps
Rest API
Analytics
ETL/ELT
Informatica
Management
Agile
Apply
$150k – $300k per year · Equity 0–1% · In office · Full-Time · 3+ years exp · San Francisco
AI/ML
LoRA
Function Calling
PEFT
LLM
SFT
Post-training
Structured Outputs
Context Engineering
Voice Agents
Apply
Solutions Engineer 6 days ago
$180k – $250k per year · In office · Full-Time · 6+ years exp · San Francisco
Python
TypeScript
AI/ML
Function Calling
LLM
Text-to-Speech
LiveKit
Vapi
Voice Agents
DevOps
Rest API
WebRTC
Apply
$150k – $250k per year · In office · Full-Time · 6+ years exp · San Francisco
AI/ML
AI Agents
Human-in-the-Loop
Apply
$100k – $300k per year · Equity 0–1% · In office · Full-Time · 6+ years exp · San Francisco
Python
DevOps
AWS
Apply
$100k – $250k per year · Equity 0–1% · In office · Full-Time · 3+ years exp · San Francisco
Python
TypeScript
AI/ML
AI Agents
Frontend
Next.js
React.js
DevOps
AWS
Apply
$177k – $239k per year · Equity · In office · Full-Time · 10+ years exp · San Francisco
AI/ML
Fine-tuning
JAX
Prompt Engineering
AI Agents
Speech Recognition
AWS Bedrock
PyTorch
RAG
Amazon SageMaker
AWS Bedrock AgentCore
AWS Trainium
Context Engineering
LLM Guardrails
Multi-Agent Systems
Machine Learning
DevOps
AWS
Apply
$116k – $160k per year · Equity · In office · Full-Time · 5+ years exp · Master's Degree · Seattle · New York · Arlington · San Francisco
Apply
$240k – $375k per year · In office · 15+ years exp · Bachelor's Degree · San Francisco
Apply
$65k per year · Equity · In office · Full-Time · 1+ year exp · High School Diploma · San Francisco
Apply
$120k – $140k per year · In office · 5+ years exp · Bachelor's Degree · San Francisco
Apply
See all jobs
This is one of many
2,018,701 more open roles from verified company boards, updated every day.