2,382,526open jobs
148,700companies
288,503added this week
Browse all
Salary
$120k – $145k per year
Location
In office (United States)
Seniority
Senior · 5+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 19, 2026. First seen by Alion on Nov 18, 2026. Evolent scores A on the Alion truth index.

Overview
Company
Impact
Profile match
Evolent is a healthcare company headquartered in Arlington, Virginia, that partners with health plans and providers to manage specialty care for complex and costly conditions in oncology, cardiology, musculoskeletal care, radiology, genetic testing, physical medicine and surgery. Founded in 2011 and listed on the New York Stock Exchange, it combines utilization management, clinical pathways, analytics and technology with health plan administrative services and runs a large technology team in Pune, India. It hires software, platform, DevOps and quality engineers, data scientists and AI product managers, analytics staff and utilization management intake coordinators, many of them remote.

Your Future Evolves Here

Evolent partners with health plans and providers to achieve better outcomes for people with most complex and costly health conditions. Working across specialties and primary care, we seek to connect the pieces of fragmented health care system and ensure people get the same level of care and compassion we would want for our loved ones.

Evolent employees enjoy work/life balance, the flexibility to suit their work to their lives, and autonomy they need to get things done. We believe that people do their best work when they're supported to live their best lives, and when they feel welcome to bring their whole selves to work. That's one reason why diversity and inclusion are core to our business.

Join Evolent for the mission. Stay for the culture.

What You’ll Be Doing:

Core Responsibilities

  • Own the diagnostic loop for LLM-based clinical services: take failure modes surfaced by clinical reviewers and product managers, form root-cause hypotheses (prompt design, context assembly, retrieval, guideline encoding, model behavior, upstream data), and design experiments that isolate the cause.
  • Test candidate fixes - prompt and configuration variants, context changes, model alternatives - and verify improvements with structured evaluations, not anecdotes; confirm fixes don't regress other behavior.
  • Own the evaluation roadmap and quality bar for the team's AI services: which metrics gate deployment, how golden sets and regression suites grow, and what "good enough to ship" means in evidence.
  • Use and extend the team's evaluation platform: build golden sets and regression suites, define metrics (accuracy, guideline adherence, grounding/faithfulness), run and interpret eval batteries. Fluency in *using* modern eval tooling matters; the platform exists - extending it thoughtfully is in scope, rebuilding it is not.
  • Partner with clinical reviewers (medical directors) to turn review findings into labeled evidence and executable evaluation criteria; partner with product managers to prioritize which failure modes matter most.
  • Mentor others in evaluation methods and grow the evals function as it scales, including readiness to take direct reports as the team expands.
  • Support the annual clinical-guidelines update cycle with regression evaluation as guidelines, prompts, and models change; ramp with the team's senior data scientists in Q4 2026.
  • Document the diagnostic playbook: failure taxonomies, experiment templates, variant history - a method others can run, not a private intuition. This is a practicing role - the diagnostic loop is the job, at every level of seniority.
  • Handle clinical data (including PHI) according to organizational security, privacy, and compliance requirements.

Minimum Requirements

  • Bachelor's degree in Data Science, Computer Science, Statistics, or a related quantitative field - or equivalent experience.
  • 5+ years of data science or applied machine learning experience, including shipping and maintaining models or AI systems in production.
  • 2+ years of recent, hands-on experience evaluating and improving LLM-based systems: structured error analysis, prompt/configuration iteration, experiment design, metrics interpretation - as a practitioner, not only as a reviewer of others' work.
  • Demonstrated experience with LLM evaluation methods and tools - golden/regression sets, LLM-as-judge with validation, tracing and observability tooling.
  • Strong Python and solid data-analysis skills (SQL a plus); comfort computing and reasoning about metrics such as sensitivity, specificity, and PPV.
  • Hypothesis-driven working style: the instinct to isolate variables and prove a fix, rather than tweak and hope.
  • Strong written communication - findings and go/no-go evidence must be legible to engineers, clinicians, and leadership.

Preferred Requirements

  • Healthcare experience: utilization management, prior authorization, clinical documentation, or clinical/claims data; comfort reading clinical guideline and medical-policy content.
  • Experience mentoring data scientists or leading small technical workstreams; interest in growing into people leadership as a function scales.
  • Experience working with clinical reviewers or other domain experts to convert expert judgment into labeled data and evaluation criteria.
  • Experience with LLM observability/telemetry stacks (OpenTelemetry-based tracing, Logfire, Langfuse, or similar).
  • Statistics or experimentation background (A/B testing, statistical significance, sample-size reasoning).
  • Master's degree in a quantitative field.

To ensure a secure hiring process we have implemented several identity verification steps, including submission of a government issued photo ID. We conduct identity verification during interviews, and final interviews may require onsite attendance. All candidates must complete a comprehensive background check, in-person I-9 verification, and may be subject to drug screening prior to employment. The use of artificial intelligence tools during interviews is prohibited and monitored. Misrepresentation will result in immediate disqualification from consideration.

Technical Requirements:

We require that all employees have the following technical capability at their home: High speed internet over 10 Mbps and, specifically for all call center employees, the ability to plug in directly to the home internet router.

Evolent is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability status. If you need reasonable accommodation to access the information provided on this website, please contact [email protected] for further assistance.

The expected base salary/wage range for this position is $120,000 - 145,000. As part of our total compensation package, Evolent is proud to offer comprehensive benefits (including health insurance benefits) to qualifying employees. All compensation determinations are based on the skills and experience required for the position and commensurate with experience of selected individuals, which may vary above and below the stated amounts.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,382,526 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Remote, many countries
Similar stack
Same company
United States
$81k – $110k per year · Hybrid · Full-Time · 8+ years exp · Bachelor's Degree · Los Angeles · Oakland · New York · San Diego
Python
Apply
Remote (United States) · Full-Time · 7+ years exp · United States
Python
Java
SQL
Java
Maven
Databases
Snowflake
Oracle
DevOps
Rest API
CI/CD
Jenkins
Git
AWS
Docker
Analytics
ETL/ELT
Informatica
Management
Agile
Scrum
Kanban
Apply
Data Scientist II 1 day ago
$81k – $121k per year · Hybrid · Full-Time · 3+ years exp · Master's Degree · Roslindale
Python
SQL
SAS
Stata
AI/ML
NLP
Machine Learning
Cybersecurity
HIPAA
Apply
Data Architect 1 day ago
Hybrid · Full-Time · 3+ years exp · Bachelor's Degree · Charlotte
Analytics
Informatica
Management
Agile
Waterfall
Apply
$94k – $142k per year · Remote (United States) · Nationals only · Full-Time · 5+ years exp · Bachelor's Degree · United States
Python
SQL
Databases
Databricks
AI/ML
Time Series
Analytics
Tableau
ETL/ELT
Apply
Data Scientist 1 day ago
Remote (EAEU) · 5+ years exp · Saint Petersburg
Python
SQL
Python
pySpark
AI/ML
Hadoop
CatBoost
Spark
XGBoost
Scikit-learn
LightGBM
Pandas
NumPy
Apply
Remote (EMEA) · Contractor · Cape Town
SQL
DevOps
Rest API
Apply
$112k – $147k per year · In office · Full-Time · 5+ years exp · Bachelor's Degree · Chicago
Python
JavaScript
TypeScript
SQL
C#
AI/ML
AI Agents
LLM
Human-in-the-Loop
LLM Guardrails
Agentic Workflows
DevOps
Rest API
CI/CD
Git
AWS
Management
Oracle ERP
Apply
$90k – $117k per year · In office · Full-Time · Bachelor's Degree · Chicago
Python
Go
JavaScript
Java
TypeScript
SQL
C#
Node JS
Databases
Oracle
DynamoDB
Apache Kafka
AI/ML
Model Context Protocol
Embeddings
Function Calling
AI Agents
Structured Outputs
LLM Guardrails
Agentic Workflows
Frontend
GraphQL
DevOps
Rest API
gRPC
Terraform
CloudFormation
Kong
CI/CD
Git
AWS
Kubernetes
Amazon EKS
AWS Lambda
Amazon EC2
Amazon S3
IAM
Amazon ECS
Amazon CloudWatch
Amazon EventBridge
API Gateway
SOAP
Management
Agile
Oracle ERP
Apply
In office · Full-Time · 12+ years exp · Bachelor's Degree · Bengaluru
Python
Java
SQL
Scala
Databases
Snowflake
Databricks
ClickHouse
Apache Iceberg
Delta Lake
Apache Kafka
Trino
AI/ML
Spark
Airflow
Dagster
dbt
Flink
DevOps
GCP
Azure
CI/CD
AWS
Apply
Network Engineer 4 hours ago
In office · Full-Time · 4+ years exp · Bachelor's Degree · Manila
Python
PHP
SQL
Ruby
PowerShell
Bash
Perl
AI/ML
AI Agents
DevOps
GCP
AWS
Incident Management
Linux
Windows
TCP/IP
DNS
BGP
OSPF
MPLS
Cybersecurity
Wireshark
Zscaler
PKI
Apply
Hybrid · Full-Time · 3+ years exp · Master's Degree · Tokyo
Python
C++
C++
PyTorch C++
OpenGL
AI/ML
Weights & Biases
OpenCV
MLFlow
FastAI
Computer Vision
TensorRT
MMDetection
PyTorch
TensorBoard
Point Cloud Library
Synthetic Data
Machine Learning
DevOps
CI/CD
Docker
Robotics
ROS
ROS2
Isaac Sim
MuJoCo
Open3D
Localization
Motion Planning
Perception
Sim-to-Real
Design
Blender
Apply
Database Administrator 2 months ago
≈ $17k – $33k per year (Estimated) · Remote (India) · Full-Time · 5+ years exp · Pune
SQL
Databases
PostgreSQL
Databricks
MS SQL
Azure Cosmos DB
Azure SQL Database
Microsoft Fabric
DevOps
Terraform
Azure DevOps
GitHub Actions
Azure
CI/CD
Bicep
Cybersecurity
SOC 2
DLP
Analytics
Azure Data Factory
Apply
In office · Part-Time · 10+ years exp · Bachelor's Degree · United States
Apply
$75k – $85k per year · In office · Full-Time · 1+ year exp · Bachelor's Degree · United States
Analytics
Microsoft Excel
Apply
Remote (India) · Full-Time · 3+ years exp · Bachelor's Degree · Pune
Python
PowerShell
Cybersecurity
CyberArk
Zero Trust
Least Privilege
BeyondTrust
Delinea
Active Directory
LDAP
Management
ServiceNow
ITSM
Apply
$120k – $140k per year · In office · Full-Time · 5+ years exp · Bachelor's Degree · United States
Python
SQL
C#
DevOps
Rest API
GCP
Azure
CI/CD
AWS
MedTech
HL7
FHIR
Apply
$175k – $389k per year · Remote (United States) · Full-Time · 8+ years exp · United States
Apply
$47k – $91k per year · Remote (United States) · Full-Time · 2+ years exp · High School Diploma · Atlanta · Nashville · Charlotte
Marketing
Salesforce
Apply
In office · 5+ years exp · Bachelor's Degree · United Kingdom · United States
Analytics
Microsoft Excel
Marketing
Salesforce
Apply
Remote (United States) · Full-Time · 2+ years exp · United States
Apply
$64k – $70k per year · Remote (United States) · Full-Time · 3+ years exp · Bachelor's Degree · United States
Apply
See all jobs
This is one of many
2,382,526 more open roles from verified company boards, updated every day.