LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $230,281/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Executive
Networking
Product
Design
Analytics
Support
Enterprise Apps
Quantum

Ebury

ebury.com
Ebury is a London financial technology company founded in 2009 that provides cross border payments, foreign exchange and trade finance to small and mid-sized businesses. It operates in dozens of currencies through its own platform and local payment infrastructure. The company is majority owned by Santander and serves clients across Europe, the Americas and Asia.
ebury.com • HQ: London, United Kingdom • Information Technology • LLM & Generative AI • Financial Services • 1001-5000 employees • Est. 2009
HQ: London, United Kingdom • Information Technology • LLM & Generative AI • Financial Services • 1001-5000 employees • Est. 2009
Verified live · 2 hours ago 2 months ago

Full stack Engineer - AI

$91k – $165k per year (Estimated) • Senior • 5+ years expIn office (London, United Kingdom) • Senior
Python
SQL
TypeScript
JavaScript
Python
Django
FastAPI
Flask
AI/ML
AI Agents
AWS Bedrock
Chain-of-Thought
Langfuse
LLM
RAG
Ragas
LangChain
AWS Strands Agents
Function Calling
LLM Evaluation
OpenAI Agents SDK
AutoGen
LangGraph
Context Engineering
Frontend
React.js
Vite
Mobile
Clean Architecture
DevOps
AWS
AWS Lambda
Docker
GCP
GitHub Actions
Terraform
WebSockets
Amazon ECS
GitHub
AWS Fargate
Amazon S3
API Gateway
QA
Vitest
Apply
Report

InMobi

inmobi.com
InMobi is a global adtech and consumer technology multinational headquartered in Bengaluru, India, with a major corporate presence in Singapore, San Francisco, and London. Founded in 2007 (originally as mKhoj), it made history in 2011 by becoming India's first unicorn startup.
inmobi.com • HQ: Bengaluru, India • Sales & Marketing • Advertising • Est. 2007
HQ: Bengaluru, India • Sales & Marketing • Advertising • Est. 2007
$34k – $70k per year (Estimated) • Senior • 5+ years expIn office (Bengaluru, India) • Bachelor's Degree • Senior
Python
AI/ML
Hallucination
LLM Evaluation
LLM
DevOps
AWS
CI/CD
GCP
Analytics
A/B Testing
Apply
$26k – $60k per year (Estimated) • Middle • 4+ years expIn office (Bengaluru, India) • Bachelor's Degree • Middle
Python
Databases
Apache Kafka
AI/ML
Hallucination
LangChain
LangGraph
LLM Evaluation
LLM
DevOps
AWS
Azure
CI/CD
Docker
GCP
Prometheus
Analytics
A/B Testing
Apply
Report

Recast Software

recastsoftware.com
Extend the power of Configuration Manager, Intune, and more to achieve compliance and reclaim efficiency with Recast.
recastsoftware.com • Minneapolis • Bengaluru • Endpoint Security • Information Technology • IT Infrastructure • Est. 2015
Minneapolis • Bengaluru • Endpoint Security • Information Technology • IT Infrastructure • Est. 2015
22 days ago

AI Engineer

$30k – $75k per year (Estimated) • Senior • 5+ years expRemote/Hybrid (Bengaluru, India) • Senior
Python
SQL
AI/ML
Airflow
Google Colab
LLM
Prompt Engineering
Semantic Search
Spark
LLM Evaluation
LLM Guardrails
Semantic Search
AI Agents
Function Calling
RAG
DevOps
AWS
Azure
CI/CD
Git
Vector
Apply
Report

Ciandt

ciandt.com
Ciandt is a leading provider of digital transformation services. We help organizations transform their businesses by leveraging the latest technologies. Our solutions provide comprehensive digital strategy, design, development, and implementation capabilities.
ciandt.com • HQ: Campinas, Brazil • IT Consulting • Software • Information Technology • 5000+ employees • Est. 1995
HQ: Campinas, Brazil • IT Consulting • Software • Information Technology • 5000+ employees • Est. 1995
Brazil • Remote (Brazil) • Full-Time
Python
AI/ML
AI Agents
Langfuse
LLM
Human-in-the-Loop
LLM Evaluation
QA
Pytest
Apply
Report

Normal Computing

normalcomputing.com
Normal Computing is an artificial intelligence and semiconductor technology company headquartered in New York City, New York, and founded in 2022. The firm develops a full-stack platform including AI-native Electronic Design Automation software and thermodynamic Application-Specific Integrated Circuits designed to optimize AI inference and long-context reasoning. Backed by investors such as Samsung Catalyst, the company partners with major semiconductor manufacturers to deploy its co-design solutions for complex system-on-chip verification and hardware acceleration.
normalcomputing.com • HQ: New York, United States • Machine Learning • LLM & Generative AI • EDA • Software • Semiconductors • AI Infrastructure • Hardware • Artificial Intelligence • Est. 2022
HQ: New York, United States • Machine Learning • LLM & Generative AI • EDA • Software • Semiconductors • AI Infrastructure • Hardware • Artificial Intelligence • Est. 2022
Top 25% payVerified live · 1 day ago 22 days ago

AI Research Engineer

$200k – $400k per year • Remote/Hybrid (New York, United States, London, United Kingdom, Zurich, Switzerland, Copenhagen, Denmark) • PhD • Full-Time
Python
AI/ML
JAX
LLM
PyTorch
Reinforcement Learning
RLHF
Synthetic Data
LangChain
Ray
LLM Evaluation
AI Agents
AutoGen
CrewAI
LangGraph
RLlib
Transformers
Apply
Report

Postman

postman.com
Postman is a software company headquartered in San Francisco, California, that was founded in 2014. Its platform offers a comprehensive suite of tools for the entire API lifecycle, including design, documentation, testing, and monitoring, as well as collaborative workspaces for development teams. The company operates on a global scale, supporting over 30 million developers and the majority of Fortune 500 companies through its cloud-based and desktop applications.
postman.com • HQ: San Francisco, United States • Communication & Collaboration • Artificial Intelligence • Quality Assurance • Web Development • AI Agents • Information Technology • DevOps • Software • Est. 2014
HQ: San Francisco, United States • Communication & Collaboration • Artificial Intelligence • Quality Assurance • Web Development • AI Agents • Information Technology • DevOps • Software • Est. 2014
Verified live · 2 hours ago 1 month ago

AI Engineer, Internship - Summer 2026 - Applications Open Now

Intern • In office (Berkeley, United States) • Bachelor's Degree • Internship • Intern
Python
TypeScript
AI/ML
AI Agents
Knowledge Distillation
LLM
PyTorch
PEFT
LLM Evaluation
SFT
Function Calling
Claude
Claude Code
Cursor
Fine-tuning
LoRA
Quantization
OpenAI Codex
DevOps
CI/CD
Docker
GitHub
Cybersecurity
Threat Modeling
QA
Postman
Apply
Top 25% payVerified live · 2 hours ago 5 months ago

Principal Offensive Security Engineer

$275k – $300k per year • Equity • Lead • 8+ years expIn office (San Francisco, United States) • Principal
AI Agents
LLM
RAG
ISO 42001
LLM Evaluation
Model Context Protocol
Red Teaming
Frontend
GraphQL
DevOps
AWS
CI/CD
gRPC
Kubernetes
Cybersecurity
FedRAMP
HIPAA
ISO 27001
Okta
SentinelOne
SOC 2
Wiz
QA
Postman
Apply
Report

Benepass

getbenepass.com
We're your partner in delivering benefits that enable people can learn and grow. People are most happy and productive when they take care of themselves and their families. That's why we started Benepass.
getbenepass.com • Chandler • Mental Health • Natural Language Processing • Artificial Intelligence • Est. 2019
Chandler • Mental Health • Natural Language Processing • Artificial Intelligence • Est. 2019
Verified live · 1 day ago 24 days ago

Lead AI Systems Engineer

$190k – $220k per year • Lead • In office • Full-Time • Staff
JavaScript
Python
TypeScript
AI/ML
Cursor
LLM
RAG
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
AI Agents
DevOps
CI/CD
Platform Engineering
Apply
Report

Turing AI

turing.ai
Turing AI (Turing Video, Inc.) is an AI-native cloud physical security and surveillance software enterprise headquartered in San Mateo, California. Founded in 2017 in the heart of Silicon Valley, the company provides an integrated AI-powered video security and safety platform designed to safeguard commercial real estate, enterprise campuses, retail locations, and critical infrastructure. Turing AI combines smart cloud video management systems (VMS), AI-enabled IP security cameras, operational analytics, and mobile alert systems, enabling enterprise security teams to automate threat detection, manage multi-site surveillance feeds, and streamline incident response.
turing.ai • HQ: Palo Alto, United States • Hardware • AI Infrastructure • Audio Visual • Est. 2017
HQ: Palo Alto, United States • Hardware • AI Infrastructure • Audio Visual • Est. 2017
Open 161 dayVerified live · 1 hour ago 6 months ago

Research Engineer

$43k – $120k per year (Estimated) • Middle • 4+ years exp • Remote (Brazil) • Middle
C++
Java
Python
Rust
SQL
AI/ML
Fine-tuning
Multimodal AI
Synthetic Data
VLM
LLM Evaluation
OCR
Post-training
AI Agents
Function Calling
RLHF
Human-in-the-Loop
Cybersecurity
GDPR
Apply
Open 161 dayVerified live · 1 hour ago 6 months ago

Research Engineer

$75k – $209k per year (Estimated) • Middle • 4+ years exp • Remote (Colombia) • Middle
C++
Java
Python
Rust
SQL
AI/ML
Fine-tuning
Multimodal AI
Synthetic Data
VLM
LLM Evaluation
OCR
Post-training
AI Agents
Function Calling
RLHF
Human-in-the-Loop
Cybersecurity
GDPR
Apply
Report

Berlitz

berlitz.com
Get the language skills, cultural understanding, and confidence to open up your world with Berlitz language school. Learn Arabic or one of 40+ languages.
berlitz.com • Education • Language Learning
Education • Language Learning
Verified live · 2 hours ago 25 days ago

Senior Machine Learning Engineer

$70k – $178k per year (Estimated) • Senior • 5+ years exp • Remote (Germany) • Full-Time • Senior
C++
Julia
Python
Rust
C++
PyTorch C++
TensorFlow C++
Databases
PostgreSQL
AI/ML
Fine-tuning
JAX
LLM
LLM Evaluation
Multimodal AI
NLP
PyTorch
Speech Recognition
TensorFlow
Text-to-Speech
Knowledge Distillation
Quantization
DevOps
Git
Amazon S3
Analytics
ETL/ELT
Apply
Report

OKX

okx.com
OKX is a global cryptocurrency exchange and digital asset platform. It offers spot, margin, futures, and options trading, plus a Web3 wallet, DeFi access, and NFT features. The company has positioned itself as a broad crypto ecosystem for both beginners and advanced traders.
okx.com • HQ: San Jose, United States • HQ: Dubai, United Arab Emirates • Blockchain & Crypto • Cryptocurrencies • Crypto Exchanges • 1001-5000 employees • Est. 2017
HQ: San Jose, United States • HQ: Dubai, United Arab Emirates • Blockchain & Crypto • Cryptocurrencies • Crypto Exchanges • 1001-5000 employees • Est. 2017
Verified live · 2 hours ago 2 months ago

Senior Product Manager, Multilingual AI and Evals

$135k – $278k per year (Estimated) • Senior • 3+ years expIn office (Singapore) • Visa sponsorship • Bachelor's Degree • Senior • Chinese
AI Agents
Fine-tuning
Hallucination
LLM Evaluation
Mobile
MVP
Apply
Top 25% payVerified live · 2 hours ago 2 months ago

Senior AI Platform & Agentic Infrastructure Engineer

$178k – $321k per year • Senior • In office (San Jose, United States) • Senior
Go
Python
SQL
TypeScript
AI/ML
Claude
Claude Code
Hallucination
Model Context Protocol
AI Agents
Anthropic
LLM Evaluation
LLM Guardrails
OpenAI
OpenAI Agents SDK
Anomaly Detection
LLM
NIST AI RMF
DevOps
AWS
CI/CD
GCP
Terraform
Vector
Cybersecurity
Threat Modeling
Least Privilege
SOC 2
Management
Google Workspace
Apply
Report

Ionic Partners

ionicpartners.com
At Ionic Partners we believe in the power of people, platforms, and process to transform the world. We envision a global economy that uses businesses as a force for good and creates opportunity for all. Our mission is to create a better, more equi...
ionicpartners.com • Ontario • Kitchener • Venture Capital • Financial Services
Ontario • Kitchener • Venture Capital • Financial Services
Verified live · 1 day ago 25 days ago

Principal AI-Native Engineer, Ionic Partners

$67k – $160k per year (Estimated) • Lead • 8+ years exp • Remote (Argentina, Brazil, Colombia, Mexico, Chile) • Bachelor's Degree • Full-Time • Principal
LLM
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
AI Agents
Mobile
Ionic
Apply
Report

CAST

castsoftware.com
CAST is the leader in the emerging field of software intelligence specializing in complex software systems, with MRI-like precision, to deliver accurate, actionable, and automated views of software architecture.
castsoftware.com • Bengaluru • Quality Assurance • Software • Information Technology • Est. 1990
Bengaluru • Quality Assurance • Software • Information Technology • Est. 1990
25 days ago

Senior AI Engineer

$30k – $76k per year (Estimated) • Senior • 4+ years expIn office (Bengaluru, India) • Senior
Go
Java
Node JS
Python
SQL
JavaScript
AI/ML
Hybrid Search
LangChain
LangGraph
Llama
LlamaIndex
LLM
Model Context Protocol
NLP
Prefect
RAG
Anthropic
Context Engineering
GraphRAG
LLM Evaluation
LLM Guardrails
LLMOps
OpenAI
AI Agents
Function Calling
DevOps
AIOps
AWS
Azure
CI/CD
GCP
Docker
Kubernetes
Apply
Report

Amgen

amgen.com
Amgen is a global biopharmaceutical pioneer headquartered in Thousand Oaks, California, that specializes in discovering, developing, and manufacturing innovative biologic therapies. The company focuses on treating serious illnesses with high unmet medical needs across key areas including oncology, cardiovascular disease, inflammation, rare diseases, and nephrology. Leveraging advanced human genetics, molecular engineering, and biosimilar development, it serves millions of patients worldwide through established blockbuster treatments and cutting-edge pipelines.
amgen.com • HQ: Thousand Oaks, United States • Biotechnology • Health Care • Pharmaceuticals • 1001-5000 employees • Est. 1980
HQ: Thousand Oaks, United States • Biotechnology • Health Care • Pharmaceuticals • 1001-5000 employees • Est. 1980
Verified live · 1 day ago 25 days ago

Sr Data Scientist/AI Applications Engineer

$27k – $68k per year (Estimated) • Senior • 7+ years expIn office (Hyderabad, India) • Bachelor's Degree • Full-Time • Senior
Python
AI/ML
Context Engineering
Human-in-the-Loop
LLM Evaluation
AI Agents
RAG
Robotics
Digital Twin
Apply
Report

A Place for Mom

aplaceformom.com
Find the top assisted living, memory care & other senior living communities near you. Read reviews, get pricing & connect with a local Senior Living Advisor.
aplaceformom.com • Houston • Austin • Rochester • Fort Worth • Albuquerque • Marketplaces • Health Care • Elderly Care
Houston • Austin • Rochester • Fort Worth • Albuquerque • Marketplaces • Health Care • Elderly Care
Verified live · 1 hour ago 26 days ago

Staff Software Engineer - Full Stack

$160k – $200k per year • Staff+ • 10+ years exp • Remote (United States) • Full-Time • Staff
Python
SQL
TypeScript
C#
C#
.NET
Databases
Databricks
Snowflake
AI/ML
Claude
Claude Code
LLM
LLM Evaluation
LLM Guardrails
Model Context Protocol
Structured Outputs
AI Agents
DevOps
AWS
CI/CD
Cybersecurity
HIPAA
Apply
Report

Red Hat Developer

redhat.com
Red Hat is the world’s leading provider of open source solutions, using a community-powered approach to provide reliable and high-performing cloud, virtualization, storage, Linux, and middleware technologies. Red Hat also offers award-winning support, training, and consulting services.
redhat.com • HQ: Somerville, United States • Software • Artificial Intelligence • Information Technology • 1001-5000 employees • Est. 1993
HQ: Somerville, United States • Software • Artificial Intelligence • Information Technology • 1001-5000 employees • Est. 1993
Verified live · 4 hours ago 26 days ago

Senior AI/ML Engineer

$92k – $231k per year (Estimated) • Senior • In office (Singapore) • Bachelor's Degree • Full-Time • Senior
C++
Python
AI/ML
AgentOps
CUDA
CUDA Toolkit
Docling
Fine-tuning
Kubeflow
LangChain
LangGraph
LlamaIndex
LLM
Model Context Protocol
PEFT
Ray
vLLM
LLM Evaluation
ROCm
SFT
AI Agents
NLP
Transformers
Edge AI
Hugging Face
DevOps
CI/CD
Git
Vector
Kubernetes
Red Hat
Apply
Verified live · 4 hours ago 26 days ago

AI/ML Engineer

In office (Singapore) • Bachelor's Degree • Full-Time
C++
Python
C++
PyTorch C++
AI/ML
AgentOps
CUDA
CUDA Toolkit
Docling
Fine-tuning
Kubeflow
LangChain
LangGraph
LlamaIndex
LLM
MLFlow
Model Context Protocol
PEFT
Ray
vLLM
LLM Evaluation
ROCm
SFT
AI Agents
NLP
PyTorch
Transformers
Edge AI
Hugging Face
DevOps
CI/CD
Git
Kubernetes
Vector
Red Hat
Apply
Report

Sabre

sabre.com
Sabre Corporation is a global travel technology provider headquartered in Southlake, Texas, with roots dating back to its founding in 1960. The company develops and maintains a large-scale global distribution system that connects travel suppliers like airlines and hotels with travel buyers such as agencies and corporate travel departments. It operates an extensive marketplace across more than 160 countries, offering modular software, data analytics, and AI-powered retailing tools to optimize operations for the entire travel industry.
sabre.com • HQ: Southlake, United States • Predictive Analytics • Artificial Intelligence • Analytics Platforms • Data & Analytics • Business Process Automation (BPA) • Software • Travel & Tourism • Travel Technology • 1001-5000 employees • Est. 1960
HQ: Southlake, United States • Predictive Analytics • Artificial Intelligence • Analytics Platforms • Data & Analytics • Business Process Automation (BPA) • Software • Travel & Tourism • Travel Technology • 1001-5000 employees • Est. 1960
Verified live · 1 day ago 26 days ago

Principal GenAI & Agentic AI Engineer

$35k – $85k per year (Estimated) • Lead • 15+ years expIn office (Bengaluru, India) • Full-Time • Principal
Java
Python
SQL
TypeScript
Databases
Delta Lake
Google BigQuery
AI/ML
Fine-tuning
Gemini
LLM
Multimodal AI
Prompt Engineering
RAG
Spark
Vertex AI
LLM Evaluation
LLM Guardrails
LLMOps
AI Agents
Google ADK
DevOps
CI/CD
GCP
Google Cloud Run
Terraform
Vector
IAM
Cybersecurity
Okta
Apply
Report

Uber

uber.com
Uber Technologies, Inc. is a global transportation and mobility platform headquartered in San Francisco, California. Founded in 2009 by Garrett Camp and Travis Kalanick, the company revolutionized urban transit by pioneering ride-hailing via a smartphone app.
uber.com • HQ: San Francisco, United States • Transportation & Logistics • Delivery • Ride Hailing • 1001-5000 employees • Est. 2009
HQ: San Francisco, United States • Transportation & Logistics • Delivery • Ride Hailing • 1001-5000 employees • Est. 2009
Verified live · 1 hour ago 26 days ago

Staff Machine Learning Engineer - Uber AI Solutions

$232k – $258k per year • Equity • Staff+ • 5+ years expIn office (San Francisco, United States) • Bachelor's Degree • Staff
C++
Go
Java
Python
AI/ML
LLM
Multimodal AI
LLM Evaluation
AI Agents
Speech Recognition
Apply
Report

Capgemini

capgemini.com
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. Headquartered in Paris, France, the multinational corporation offers a comprehensive suite of services that includes consulting, digital transformation, technology, and engineering.
capgemini.com • HQ: Paris, France • Professional Services • Information Technology • IT Consulting • Est. 1967
HQ: Paris, France • Professional Services • Information Technology • IT Consulting • Est. 1967
Verified live · 5 hours ago 26 days ago

AI Engineer

$27k – $111k per year (Estimated)In office (Hyderabad, Pakistan) • Bachelor's Degree • Full-Time
Python
TypeScript
AI/ML
ChatGPT
CrewAI
LangGraph
LLM
RAG
LangChain
Anthropic
AWS Strands Agents
Context Engineering
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
OpenAI
AI Agents
Portkey
DevOps
CI/CD
Vector
AWS
Azure
GCP
Kubernetes
OpenShift
Apply
Report

Ginkgo Bioworks

ginkgo.bio
Ginkgo Bioworks operates automated foundries for designing and testing engineered organisms. Partners use its platform to develop enzymes, materials and agricultural biologicals. The company also built a biosecurity monitoring business.
ginkgo.bio • HQ: Boston, United States • Biomedical Engineering • Regenerative Medicine • Biotechnology • Est. 2008
HQ: Boston, United States • Biomedical Engineering • Regenerative Medicine • Biotechnology • Est. 2008
Verified live · 1 day ago 3 months ago

Software Engineer 2, Autonomous Lab

$86k – $120k per year • Equity • Middle • In office (Boston, United States) • Relocation • Bachelor's Degree • Full-Time • Middle
Python
TypeScript
JavaScript
Databases
PostgreSQL
AI/ML
AI Agents
LLM Evaluation
Function Calling
LangChain
LLM
Model Context Protocol
Frontend
React.js
DevOps
CI/CD
Kubernetes
AWS
Azure
GCP
Git
Rest API
Apply
Report

Sierrastudio

sierrastudio.com
$49k – $124k per year (Estimated) • Senior • 5+ years exp • Remote (United States, Brazil) • Visa sponsorship • Bachelor's Degree • Senior
Python
SQL
JavaScript
Python
Celery
Django
Django REST Framework
Databases
pgvector
PostgreSQL
Redis
AI/ML
Claude
Claude Code
Gemini
LLM
Prompt Engineering
RAG
Semantic Search
Anthropic
LLM Evaluation
Semantic Search
Structured Outputs
AI Agents
Frontend
HTMX
Tailwind CSS
Mobile
Twilio
DevOps
AWS
AWS Fargate
CI/CD
Docker
GitHub Actions
Amazon ECS
GitHub
Management
Slack
Apply
$49k – $124k per year (Estimated) • Senior • 5+ years exp • Remote (United States, Brazil) • Full-Time • Senior
Python
SQL
JavaScript
Python
Celery
Django
Django REST Framework
Databases
pgvector
PostgreSQL
Redis
AI/ML
Claude
Claude Code
Gemini
LLM
Prompt Engineering
RAG
Semantic Search
Anthropic
LLM Evaluation
Semantic Search
Structured Outputs
AI Agents
Frontend
HTMX
Tailwind CSS
Mobile
Twilio
DevOps
AWS
AWS Fargate
CI/CD
Docker
GitHub Actions
Amazon ECS
GitHub
Management
Slack
Apply
Report
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 491 active listings from 297 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $230,281 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.