LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $230,281/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Executive
Networking
Product
Design
Analytics
Support
Enterprise Apps
Quantum

Sarvam AI

sarvam.ai
Sarvam AI is a leading Indian artificial intelligence company focused on building full-stack sovereign generative AI infrastructure, foundational large language models (LLMs), and speech technologies tailored for India’s diverse languages and enterprise requirements.
sarvam.ai • HQ: Bengaluru, India • Natural Language Processing • LLM & Generative AI • Artificial Intelligence • 501-1000 employees
HQ: Bengaluru, India • Natural Language Processing • LLM & Generative AI • Artificial Intelligence • 501-1000 employees
Verified live · 7 hours ago 5 months ago

Data Scientist - Evaluations, Chanakya

$22k – $56k per year (Estimated) • Middle • 3+ years expIn office (Bengaluru, India) • Full-Time • Middle
Python
AI/ML
Fine-tuning
LangSmith
NumPy
Prompt Engineering
RLHF
Hugging Face
LLM Evaluation
Apply
Report

Infinity Constellation

infinity.com
Infinity Constellation is a venture studio and holding company headquartered in Melbourne, Australia. The group builds and operates a portfolio of software ventures under its own brands, including applied AI products, rather than investing passively in outside companies. It staffs each venture with dedicated engineering, design, and product teams while sharing finance, infrastructure, and hiring functions across the constellation.
infinity.com • HQ: Melbourne, Australia • LLM & Generative AI • Software • Venture Capital • Financial Services • AI Agents • Artificial Intelligence
HQ: Melbourne, Australia • LLM & Generative AI • Software • Venture Capital • Financial Services • AI Agents • Artificial Intelligence
Open 137 days 5 months ago

Engineering Manager (AI) - Supernal

$166k – $276k per year (Estimated) • Lead • 5+ years exp • Remote (United States) • Full-Time • Senior
PostgreSQL
Supabase
AI/ML
LLM
AI Agents
Human-in-the-Loop
LLM Evaluation
Apply
Open 137 days 5 months ago

Senior AI Engineer (Core) - Supernal

$138k – $248k per year (Estimated) • Senior • Remote (United States) • Full-Time • Senior
Python
Python
Django
Databases
Chroma
pgvector
Pinecone
PostgreSQL
Qdrant
Weaviate
AI/ML
AutoGen
CrewAI
Embeddings
LangChain
LangGraph
LlamaIndex
LLM
RAG
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Text-to-Speech
AI Agents
Function Calling
DevOps
Datadog
Kubernetes
OpenTelemetry
Platform Engineering
Vector
WebRTC
Apply
Report

Deliveroo

deliveroo.co.uk
Deliveroo is an award-winning delivery service founded in 2013 by William Shu and Greg Orlowski. Deliveroo works with approximately 176,000 best-loved restaurants and grocery partners, as well as around 150,000 riders to provide the best food delivery experience in the world. Deliveroo is headquartered in London, with offices around the globe.
deliveroo.co.uk • Lucca • London • Paris • Manchester • Birmingham • Marketplaces • Transportation & Logistics • Delivery
Lucca • London • Paris • Manchester • Birmingham • Marketplaces • Transportation & Logistics • Delivery
Verified live · 1 hour ago 5 months ago

Senior Machine Learning Engineer

$94k – $194k per year (Estimated) • Senior • In office (London, United Kingdom) • Full-Time • Senior
Python
AI/ML
Fine-tuning
LLM
AI Agents
LLM Evaluation
DevOps
CircleCI
Docker
Kubernetes
Apply
Report

Dynamo

dynamo.ai
Dynamo AI offers end-to-end AI Performance, Security, and Compliance solutions for delivering Enterprise-grade Generative AI.
dynamo.ai • Washington • New York • San Francisco • London • Paris • LLM & Generative AI • Artificial Intelligence
Washington • New York • San Francisco • London • Paris • LLM & Generative AI • Artificial Intelligence
Open 151 dayVerified live · 8 hours ago 5 months ago

Senior Applied ML Research Engineer, Agentic Security

$59k – $149k per year (Estimated) • Senior • In office (Paris, France) • PhD • Full-Time • Senior
LLM Evaluation
LLM Guardrails
AI Agents
Apply
Report

United Overseas Bank

uobgroup.com
United Overseas Bank (UOB) is a leading multinational financial services corporation headquartered in Singapore, serving as one of Southeast Asia's major banking institutions. The group offers a comprehensive range of personal, commercial, corporate, and private banking services alongside investment, wealth management, and treasury solutions. Leveraging an extensive regional network across the Asia-Pacific region and key global financial centers, it helps individuals, businesses, and institutional clients navigate cross-border trade and economic growth.
uobgroup.com • HQ: Singapore • Financial Services • Banking • 1001-5000 employees
HQ: Singapore • Financial Services • Banking • 1001-5000 employees
$138k – $295k per year (Estimated) • Executive • 10+ years expRemote/Hybrid (Singapore) • Full-Time • Architect
Python
SQL
Python
pySpark
AI/ML
Fine-tuning
LangChain
LIME
Llama
LlamaIndex
LLM
LoRA
PEFT
PyTorch
RAG
RLHF
SHAP
TensorFlow
Transformers
Spark
AI Agents
Function Calling
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Red Teaming
Time Series Forecasting
DevOps
AWS
Azure
GCP
Kubernetes
Vector
Cybersecurity
Threat Modeling
Apply
Report

Quantiphi

quantiphi.com
Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.
quantiphi.com • HQ: Boston, United States • Analytics Platforms • Data & Analytics • 1001-5000 employees
HQ: Boston, United States • Analytics Platforms • Data & Analytics • 1001-5000 employees
Open 160 daysVerified live · 1 hour ago 6 months ago

Associate Lead - Testing (QA + MLOps)

$23k – $65k per year (Estimated) • Lead • 12+ years expIn office (Bengaluru, Mumbai, India) • Full-Time • Staff
Python
AI/ML
AWS Bedrock
Embeddings
Hallucination
LangChain
LLM
NLP
Prompt Engineering
PyTorch
RAG
Scikit-learn
Synthetic Data
TensorFlow
AI Agents
Amazon SageMaker
Feature Store
LLM Evaluation
DevOps
AWS
AWS Lambda
CI/CD
CloudFormation
Git
Terraform
Amazon CloudWatch
Amazon Kinesis
Amazon S3
API Gateway
IAM
Apply
Report

DP World

dpworld.com
DP World is a global logistics, port operations, and supply chain management enterprise. Headquartered in Dubai, United Arab Emirates, the multinational state-owned organization specializes in container terminal operations, marine services, cargo handling, and economic free zones across six continents. The enterprise operates an extensive global infrastructure network encompassing over 70 maritime and inland terminals - including flagship assets such as the Port of Jebel Ali and the Jebel Ali Free Zone (Jafza) - alongside feeder shipping fleets, logistics parks, and digital trade platforms.
dpworld.com • HQ: Dubai, United Arab Emirates • Supply Chain • Logistics • Transportation & Logistics • 5000+ employees
HQ: Dubai, United Arab Emirates • Supply Chain • Logistics • Transportation & Logistics • 5000+ employees
Verified live · 3 hours ago 6 months ago

Machine Learning Scientist

$30k – $124k per year (Estimated)In office (Bengaluru, India)
Python
SQL
AI/ML
AI Agents
Claude
Claude Code
LLM Evaluation
MLFlow
PPO
PyTorch
TensorFlow
Ray
RLlib
Stable-Baselines3
DevOps
CI/CD
Docker
Git
Robotics
Digital Twin
Imitation Learning
Apply
Report

Fuku

eatfuku.com
Fuku is a fast-casual restaurant concept founded by chef David Chang that specializes in Asian- and Southern-inspired spicy fried chicken. Originating from a secret menu item at Momofuku Noodle Bar in New York, the brand has grown into a standalone culinary concept known for its signature chicken sandos, tenders, and sides. Today, Fuku operates through brick-and-mortar locations, major sports arenas, airports, and high-traffic venues across the United States.
eatfuku.com • HQ: New York, United States • Delivery • Food & Beverages • Catering & Food Services • 501-1000 employees
HQ: New York, United States • Delivery • Food & Beverages • Catering & Food Services • 501-1000 employees
Open 182 daysVerified live · 2 hours ago 6 months ago

Senior Prompt Engineering Engineer

$145k – $260k per year (Estimated) • Senior • San Francisco • Remote (United States) • Full-Time • Senior
Python
TypeScript
AI/ML
Claude
Copilot
DeepEval
Gemini
LangChain
LangGraph
LangSmith
LlamaIndex
LLM
NLP
Prompt Engineering
Ragas
Weights & Biases
LLM Evaluation
LLM Guardrails
AI Agents
Synthetic Data
DevOps
Vector
Apply
Report

Govwell

govwell.com
Municipal and county governments in 40+ states use GovWell's AI operating system to deliver better services, work smarter, and build public trust.
govwell.com • HQ: New York, United States • Software • Operating Systems
HQ: New York, United States • Software • Operating Systems
Open 187 daysTop 25% pay 7 months ago

AI Product Engineer

$200k – $300k per year • Equity • Remote/Hybrid (New York, United States) • Full-Time
JavaScript
Node JS
TypeScript
Databases
PostgreSQL
AI/ML
Gemini
Hallucination
LLM Evaluation
OpenAI
RAG
Frontend
GraphQL
React.js
DevOps
AWS
Apply
Report

Satori Analytics

satorianalytics.com
About Us Data and AI changes everything! Who we are At Satori Analytics, we are strong believers in the transformative power of data and AI.
satorianalytics.com • HQ: Athens, Greece • Data Science • Artificial Intelligence • Data & Analytics
HQ: Athens, Greece • Data Science • Artificial Intelligence • Data & Analytics
Open 196 daysVerified live · 1 day ago 7 months ago

Senior AI Engineer

Senior • 4+ years expRemote/Hybrid (Athens, Greece) • Master's Degree • Full-Time • Senior
Python
Python
FastAPI
Databases
Databricks
FAISS
pgvector
Pinecone
PostgreSQL
Qdrant
Weaviate
AI/ML
Hallucination
RAG
Anthropic
LLM Guardrails
OpenAI
Fine-tuning
LangChain
LlamaIndex
LLM
LLM Evaluation
AI Agents
Function Calling
Mobile
Clean Architecture
DevOps
AWS
Azure
CI/CD
Docker
Analytics
A/B Testing
Marketing
Salesforce
Apply
Report

Flux

flux.ai
Introducing a new way to work: Give Flux a job and it plans, explains, and executes workflows inside a full browser-based eCAD you can edit anytime.
flux.ai • San Francisco • Embedded Systems • Electronic Components • Hardware
San Francisco • Embedded Systems • Electronic Components • Hardware
Open 221 dayTop 25% pay 8 months ago

Head of Hardware Design

$245k – $270k per year • Executive • In office (San Francisco, United States) • Full-Time • Architect
LLM Evaluation
LLM Guardrails
DevOps
GitHub
Chips/EDA
Ansys SIwave
Cadence Allegro
HyperLynx
KiCad
Mentor Xpedition
OrCAD
Design
Figma
Apply
Report

Extend

extend.com
Extend allows any merchant to offer extended warranties and protection plans through our easy-to-integrate APIs or pre-built eCommerce applications. They power extended warranties both online and offl...ine while also providing consumers with a mo...
extend.com • New York • E-commerce Platforms • Financial Services • Insurance
New York • E-commerce Platforms • Financial Services • Insurance
Open 230 days 8 months ago

Growth Engineer

$170k – $200k per year • In office (New York, United States) • Relocation • Full-Time
Human-in-the-Loop
LLM Evaluation
OCR
OpenAI
Apply
Report

Prompthealth

prompthealth.com
Prompt is a healthcare software company focused on electronic medical records, with a particular emphasis on making clinical documentation and practice workflows simpler and more efficient. From its positioning, the product is designed to help clinicians capture patient information accurately, reduce the time spent on admin, and keep records organised in a way that supports day to day care. For job seekers, this points to a business working on practical problems that sit right at the intersection of software usability, clinical reality, and regulatory expectations.
prompthealth.com • HQ: San Francisco, United States • Artificial Intelligence • Physical Therapy • Health Care
HQ: San Francisco, United States • Artificial Intelligence • Physical Therapy • Health Care
$160k – $220k per year • Equity • Senior • 4+ years exp • Remote (United States) • Full-Time • Senior
Python
Python
FastAPI
Pydantic
SQLAlchemy
Databases
PostgreSQL
AI/ML
LLM
RAG
Human-in-the-Loop
LLM Guardrails
Structured Outputs
Hybrid Search
Streamlit
LLM Evaluation
DevOps
Amazon EC2
AWS
Docker
Amazon S3
Vector
Apply
Report

Reducto

reducto.com
Click here to enter Click here to enter Click here to enter Click here to enter.
reducto.com • San Francisco • New York • Document Management • Data & Analytics • Artificial Intelligence
San Francisco • New York • Document Management • Data & Analytics • Artificial Intelligence
Open 278 daysTop 25% pay 10 months ago

Forward Deployed Engineer

$200k – $300k per year • Middle • 3+ years expIn office (San Francisco, United States) • Full-Time • Middle
Python
AI/ML
Streamlit
AI Agents
LLM Evaluation
OCR
Apply
Report

Nuvei

nuvei.com
Unify pay-ins, payouts, and data on one intelligent platform. Accept every payment method, optimize performance locally, and scale globally with Nuvei.
nuvei.com • HQ: Montreal, Canada • FinTech • Financial Services • Payments • Est. 2003
HQ: Montreal, Canada • FinTech • Financial Services • Payments • Est. 2003
Open 300 daysVerified live · 1 day ago 10 months ago

ML Engineer

Senior • 5+ years expRemote/Hybrid (Tel Aviv, Israel) • Full-Time • Senior
Python
Databases
Databricks
Snowflake
AI/ML
CrewAI
LangGraph
LLM
LangChain
AI Agents
Hallucination
LLM Evaluation
DevOps
Splunk
Marketing
Salesforce
Apply
Report

Superdial

superdial.com
SuperDial is the #1 voice AI platform for RCM teams. Automate prior auths, claim status, and eligibility with real-time documentation in your EHR or RCM platform.
superdial.com • HQ: New York, United States • AI Agents • Speech & Audio AI • Artificial Intelligence
HQ: New York, United States • AI Agents • Speech & Audio AI • Artificial Intelligence
Open 374 daysTop 25% pay 1 year ago

Staff Software Engineer, Applied AI

$200k – $275k per year • Equity • Staff+ • 5+ years expIn office • Full-Time • Staff
Go
Java
Python
TypeScript
AI/ML
LangChain
LlamaIndex
LLM
RAG
Anthropic
Hugging Face
LLM Evaluation
LLM Guardrails
LLMOps
OpenAI
Edge AI
DevOps
AWS
Azure
CI/CD
Docker
GCP
Kubernetes
Terraform
Vector
Cybersecurity
HIPAA
Apply
Report

Mactores

mactores.com
Mactores is a trusted leader among businesses in providing modern data platform solutions. Since 2008, Mactores have been enabling businesses to accelerate their value through automation by providing End-to-End Data Solutions that are automated, agile, and secure. We collaborate with customers to strategize, navigate, and accelerate an ideal path forward with a digital transformation via assessments, migration, or modernization.
mactores.com • HQ: Seattle, United States • AI Agents
HQ: Seattle, United States • AI Agents
Open 675 daysVerified live · 1 day ago 2 years ago

Generative AI Forward Deployed Engineer

$23k – $64k per year (Estimated) • Middle • 3+ years expMumbai • Remote (India) • Full-Time • Middle
Python
TypeScript
C#
C++
Java
Rust
C#
.NET
Databases
Amazon Aurora
Amazon Redshift
DynamoDB
Apache Kafka
AI/ML
AI Agents
AWS Bedrock
CrewAI
Fine-tuning
Function Calling
LangGraph
LoRA
Prompt Engineering
QLoRA
RAG
Reranking
RLHF
LangChain
PEFT
Amazon SageMaker
AWS Strands Agents
DPO
LLM Evaluation
Knowledge Graph
DevOps
AWS
AWS Lambda
CI/CD
Vector
Amazon Kinesis
API Gateway
Cybersecurity
HIPAA
PCI DSS
SOC 2
Apply
Report
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 491 active listings from 297 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $230,281 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.