LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

LY

ly.com
ly.com • Beijing • Chengdu • Suzhou • Est. 2002 • Hiring 23, 23 new
Beijing • Chengdu • Suzhou • Est. 2002 • Hiring 23, 23 new
同程旅行(LY.COM)是一家专业的一站式旅游预订平台,提供近万家景点门票、特价机票、出国旅游、周边游、自驾游及酒店预订服务;专业旅游线路服务、让您的旅行更安心!.
No named decision-maker yet.
No careers mailbox known
3 days ago Hiring now · 86%

AI Agent 开发工程师-苏州(27届)

$32k – $40k per year • Junior • 1+ year exp • In office (Suzhou, China) • Full-Time • Junior
Python
AI/ML
Cursor
Claude
Dify
Model Context Protocol
RLHF
Prompt Engineering
Function Calling
AI Agents
LLM
RAG
LLM Evaluation
+4
Apply

Binance

binance.com
binance.com • HQ: Abu Dhabi, United Arab Emirates • Crypto Wallets • Blockchain Infrastructure • Mining & Staking • Crypto Payments • Crypto Exchanges • 1001-5000 employees • Est. 2017 • Hiring 182, 180 new
HQ: Abu Dhabi, United Arab Emirates • Crypto Wallets • Blockchain Infrastructure • Mining & Staking • Crypto Payments • Crypto Exchanges • 1001-5000 employees • Est. 2017 • Hiring 182, 180 new
Binance is the world's largest cryptocurrency exchange by trading volume, founded in 2017 by Changpeng Zhao and Yi He. The platform offers spot, margin and derivatives trading across hundreds of digital assets, alongside staking, savings products, payments, an institutional custody arm and a self-custodial Web3 wallet. The group also created BNB Chain, one of the most used smart contract networks, and now operates under a licensed regional structure after a 2023 settlement with United States authorities that installed new leadership and compliance oversight.
Yi He · Co-Founder & Head of Binance Labs · decision-maker
Richard Teng · Chief Executive Officer · decision-maker
Changpeng Zhao · Co-Founder & former Chief Executive Officer · founder
Careers mailbox is known
Verified live · 4 hours ago 3 days ago Hiring now · 90%

Binance Accelerator Program - Full Stack Engineer (Backend Oriented) Fully Remote

Junior • Malaysia • New Zealand • Taiwan • Hong Kong • Singapore • Remote (Singapore) • Junior
Python
Java
Databases
Redis
Apache Kafka
AI/ML
Function Calling
AI Agents
LLM
RAG
LLM Evaluation
LLM Guardrails
Tool Use
LangGraph
LangChain
LlamaIndex
Model Context Protocol
Embeddings
LLMOps
DevOps
CI/CD
Docker
Kubernetes
+12
Apply

EY

ey.com
ey.com • HQ: London, United Kingdom • Management Consulting • Financial Advisory, Valuation & Restructuring • Tax Advisory & Preparation • Audit & Assurance Firms • 5000+ employees • Est. 1989 • Hiring 4517, 1310 new
HQ: London, United Kingdom • Management Consulting • Financial Advisory, Valuation & Restructuring • Tax Advisory & Preparation • Audit & Assurance Firms • 5000+ employees • Est. 1989 • Hiring 4517, 1310 new
Headquartered in London, United Kingdom, EY (Ernst & Young) is a multinational professional services network and one of the "Big Four" accounting firms. The organization provides financial assurance and auditing, tax advisory, management and technology consulting, and strategy and transactions advisory through its EY-Parthenon arm. Operating across more than 150 countries, it delivers risk management, digital transformation, data analytics, and regulatory compliance solutions to multinational corporations, financial institutions, and government entities worldwide.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 3 hours ago Visa sponsor 3 days ago Hiring now · 90%

Cyber - AI Engineer - Manager - Consulting

$174k – $290k per year • Senior • 5+ years exp • In office (McLean, United States) • Bachelor's Degree • Senior
Python
AI/ML
Fine-tuning
Function Calling
AI Agents
LLM
RAG
Structured Outputs
Red Teaming
LLM Evaluation
Tool Use
DevOps
GCP
Azure
CI/CD
Git
AWS
Cybersecurity
OWASP Top 10
SIEM
+9
Apply
Top 25% payVerified live · 3 hours ago Visa sponsor 3 days ago Hiring now · 90%

Cyber - AI Engineer - Senior - Consulting

$126k – $210k per year • Senior • 3+ years exp • In office (Toledo, United States) • Bachelor's Degree • Senior
Python
AI/ML
Fine-tuning
Function Calling
AI Agents
LLM
RAG
Structured Outputs
Red Teaming
LLM Evaluation
Tool Use
DevOps
GCP
Azure
CI/CD
Git
AWS
Cybersecurity
OWASP Top 10
SIEM
+9
Apply
Top 25% payVerified live · 3 hours ago Visa sponsor 7 days ago Hiring now · 87%

Americas Tax Technology Group - Solutions Architect - Senior Manager

$90k – $260k per year • Staff+ • 10+ years exp • Hybrid (Nashville, United States) • Bachelor's Degree • Architect
C
C
SDL
AI/ML
Model Context Protocol
Function Calling
AI Agents
RAG
A2A
LLM Evaluation
LLM Guardrails
Multi-Agent Systems
Copilot Studio
DevOps
OpenTelemetry
Azure
CI/CD
Kubernetes
Management
SharePoint
Agile
+9
Apply

Starlims

starlims.com
starlims.com • HQ: Hollywood, United States • 51-200 employees • Likely startup • Hiring 6, 6 new
HQ: Hollywood, United States • 51-200 employees • Likely startup • Hiring 6, 6 new
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 3 days ago Hiring now · 90%

Software Engineer - Agentic System Development - STARLIMS Corporation

≈ $87k – $219k per year (Estimated) • Senior • 6+ years exp • Remote (likely United States) • Senior
Python
TypeScript
JavaScript
C#
Node JS
C#
.NET
Databases
DynamoDB
AI/ML
Model Context Protocol
Function Calling
AI Agents
LLM
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Tool Use
Embeddings
OpenAI
Anthropic
Agentic Workflows
Frontend
Tailwind CSS
Next.js
React.js
DevOps
Terraform
AWS
AWS Lambda
AWS Step Functions
API Gateway
Kubernetes
Amazon EKS
Amazon ECS
Management
n8n
QA
Playwright
Jest
Pytest
+26
Apply

Lean Solutions Group

leangroup.com
leangroup.com • HQ: Coral Springs, United States • Logistics • Transportation & Logistics • Artificial Intelligence • 201-500 employees • Est. 2012 • Staffing · EOR • Hiring 55, 55 new
HQ: Coral Springs, United States • Logistics • Transportation & Logistics • Artificial Intelligence • 201-500 employees • Est. 2012 • Staffing · EOR • Hiring 55, 55 new
Founded in 2012, Lean Solutions Group is a nearshore and offshore services provider specializing in workforce optimization, business process outsourcing (BPO), and technology solutions. Headquartered in Coral Springs, Florida, the company maintains extensive operational and talent delivery centers across Latin America and Asia. By combining skilled human resources with AI-powered tools and software systems, the enterprise enables companies across transportation, logistics, supply chain, financial services, and manufacturing to scale operations, streamline back-office tasks, and optimize customer support.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 3 days ago Hiring now · 90%

Senior AI Engineer

≈ $96k – $246k per year (Estimated) • Senior • 5+ years exp • In office (Colombia) • Senior
Python
SQL
C#
C#
.NET
Databases
Databricks
Azure SQL Database
Microsoft Fabric
AI/ML
Claude
Embeddings
Prompt Engineering
LLM
RAG
Hallucination
OpenAI
Anthropic
Structured Outputs
LLM Evaluation
LLM Guardrails
LangChain
DSPy
LlamaIndex
Fine-tuning
DevOps
Azure
+15
Apply

Arc XP

arcxp.com
arcxp.com • Washington • CMS & Digital Experience Platforms • Est. 2013 • Hiring 8, 1 new
Washington • CMS & Digital Experience Platforms • Est. 2013 • Hiring 8, 1 new
Explore Arc XP, a hybrid CMS purpose-built for media companies. Innovate and grow with AI-powered features and built-in tools for monetization and engagement.
No named decision-maker yet.
No careers mailbox known
Verified live · 4 hours ago 3 days ago Hiring now · 86%

Senior Staff Software Engineer, Content Intelligence

$145k – $241k per year • Staff+ • 8+ years exp • United States • Remote (United States) • Full-Time • Staff
Python
Python
FastAPI
Databases
DynamoDB
Apache Kafka
AI/ML
Embeddings
AI Agents
AWS Bedrock
LLM
RAG
Reranking
LLM Evaluation
LLM Guardrails
Claude Code
Multimodal AI
DevOps
Terraform
OpenTofu
Terragrunt
CloudFormation
AWS
AWS Lambda
Amazon S3
Amazon ECS
Datadog
Cybersecurity
Threat Modeling
+16
Apply
Top 25% payVerified live · 4 hours ago 1 month ago Fading · 35%

Staff Software Engineer, Cloud Architecture & Engineering Velocity

$132k – $219k per year • Staff+ • 8+ years exp • United States • Remote (United States) • Bachelor's Degree • Full-Time • Staff
Python
Go
Java
Node JS
JavaScript
Databases
DynamoDB
AI/ML
Copilot
Cursor
Claude Code
Function Calling
AI Agents
AWS Bedrock
RAG
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
Amazon SageMaker
DevOps
Terraform
AWS CDK
CloudFormation
CI/CD
AWS
Cloudflare
Nginx
AWS Lambda
Akamai
FinOps
IAM
Amazon ECS
AWS Step Functions
API Gateway
Cybersecurity
Okta
+25
Apply

Booz Allen Hamilton

boozallen.com
boozallen.com • HQ: McLean, United States • Intelligence • Management Consulting • National Security • IT Consulting & Digital Transformation • 5000+ employees • Est. 1914 • IT services • Trust A • Hiring 1855, 38 new
HQ: McLean, United States • Intelligence • Management Consulting • National Security • IT Consulting & Digital Transformation • 5000+ employees • Est. 1914 • IT services • Trust A • Hiring 1855, 38 new
Booz Allen Hamilton is an American consulting firm founded in 1914 that has spent most of the past century working for the United States government, and today derives almost all of its revenue from federal clients. It supplies technology and mission services to defence, intelligence, civil and health agencies, covering systems engineering, cyber operations, data platforms and increasingly artificial intelligence deployed inside classified environments. Headquartered in McLean, Virginia and listed on the New York Stock Exchange, it employs tens of thousands of security-cleared staff and competes with the other large federal services contractors for multi-year programme awards.
Sophie Sweeney · Director · decision-maker
Sarah St · Directors · decision-maker
Matt Calderone · Chief Financial Officer · decision-maker
Horacio Rozanski · Chairman, President & Chief Executive Officer · decision-maker
No careers mailbox known
Top 25% payVerified live · 1 hour ago Visa sponsor 3 days ago Likely open · 62%

Enterprise Cybersecurity AI Infrastructure Engineer

$78k – $176k per year • Senior • 5+ years exp • In office (McLean, United States) • High School Diploma • Full-Time • Secret • Senior
Python
SQL
Databases
Databricks
AI/ML
Function Calling
AI Agents
Tool Use
Machine Learning
Spark
MLFlow
PyTorch
LLM
Ray
LLM Evaluation
NIST AI RMF
DevOps
Terraform
GitHub Actions
Terragrunt
CI/CD
AWS
GitHub
IAM
Docker
Kubernetes
Cybersecurity
Least Privilege
FedRAMP
SIEM
OWASP
+19
Apply
Top 25% payVerified live · 1 hour ago Visa sponsor 1 month ago Long shot · 10%

Agentic AI Engineer

$113k – $257k per year • Senior • 6+ years exp • In office (McLean, United States) • Bachelor's Degree • Full-Time • Secret • Senior
LangGraph
AutoGen
LangChain
LlamaIndex
Model Context Protocol
Function Calling
AI Agents
Pydantic AI
CrewAI
LLM
RAG
A2A
Knowledge Graph
LLM Evaluation
Cursor
Windsurf
llama.cpp
vLLM
TensorFlow
PyTorch
DevOps
Azure
AWS
+14
Apply

Kaltura

kaltura.com
kaltura.com • HQ: New York, United States • Video Conferencing & Webinars • Streaming & OTT Platforms • 501-1000 employees • Est. 2006 • NASDAQ: KLTR • Hiring 30, 21 new
HQ: New York, United States • Video Conferencing & Webinars • Streaming & OTT Platforms • 501-1000 employees • Est. 2006 • NASDAQ: KLTR • Hiring 30, 21 new
Kaltura is a New York video technology company founded in 2006 that supplies enterprise and education video platforms. Its products cover live events, virtual classrooms and video portals with an open source heritage. The company is listed on Nasdaq and serves universities, broadcasters and enterprises.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago Visa sponsor 3 days ago Hiring now · 90%

Forward Deployed Engineer

$105k – $130k per year • Middle • 4+ years exp • Remote (United States) • Middle
LangGraph
LangChain
Model Context Protocol
Prompt Engineering
Function Calling
AI Agents
NLP
Speech Recognition
DeepEval
Langfuse
Ragas
LLM
RAG
Text-to-Speech
LLM Evaluation
LLM Guardrails
+8
Apply
Verified live · 3 hours ago 4 days ago Hiring now · 90%

Senior AI Engineer — Exploration & Prototyping

≈ $88k – $225k per year (Estimated) • Senior • 7+ years exp • Hybrid (Bnei Brak, Israel) • Bachelor's Degree • Full-Time • Senior
Python
AI/ML
Model Context Protocol
Function Calling
AI Agents
LLM
LiveKit
LLM Evaluation
Tool Use
Machine Learning
DevOps
GCP
WebRTC
Azure
AWS
+5
Apply

Mutual of Omaha Mortgage, Inc.

mutualmortgage.com
mutualmortgage.com • Philadelphia • Atlanta • San Diego • Indianapolis • Detroit • Real Estate Brokerage • Real Estate • Financial Services • 201-500 employees • Est. 1909 • Hiring 37, 37 new
Philadelphia • Atlanta • San Diego • Indianapolis • Detroit • Real Estate Brokerage • Real Estate • Financial Services • 201-500 employees • Est. 1909 • Hiring 37, 37 new
Since 1909, Mutual of Omaha has been committed to serving customers with integrity, care, and financial expertise. We’re here to help you achieve homeownership.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 6 hours ago 3 days ago Hiring now · 99%

Software Engineer – AI Systems - Mutual of Omaha Mortgage

$135k – $150k per year • Junior • 2+ years exp • Hybrid (Irvine, United States) • Bachelor's Degree • Junior
Python
TypeScript
SQL
Python
Flask
Django
Databases
MySQL
PostgreSQL
MS SQL
AI/ML
Claude
Prompt Engineering
Function Calling
AI Agents
Anthropic SDK
Anthropic
LLM Evaluation
Prompt Caching
Agentic Workflows
Multi-Agent Systems
Tool Use
DevOps
Azure
CI/CD
Git
AWS
Docker
QA
Pytest
+17
Apply

PermitFlow

permitflow.com
permitflow.com • HQ: New York, United States • PropTech • Construction Management Software • 201-500 employees • Est. 2021 • Startup • Trust A • Hiring 43, 3 new
HQ: New York, United States • PropTech • Construction Management Software • 201-500 employees • Est. 2021 • Startup • Trust A • Hiring 43, 3 new
PermitFlow is a construction technology company that builds AI-powered software to research permit requirements, prepare applications and track building permits for general contractors, developers and other builders. Founded in 2021, it sells to commercial and national accounts and hires machine learning engineers, sales engineers, account executives and customer success managers. The company is headquartered in New York City, New York, United States.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 3 hours ago Visa sponsor 4 days ago Hiring now · 86%

Principal Software Engineer, AI

$250k – $300k per year • Lead • 10+ years exp • Hybrid (New York, United States) • Relocation • Full-Time • Principal
Function Calling
AI Agents
LLM
OpenAI
Human-in-the-Loop
Context Engineering
LLM Evaluation
Tool Use
Apply

Cloudflare

cloudflare.com
cloudflare.com • HQ: San Francisco, United States • Cloud Security • DNS Services • Web Security & DDoS Protection • CDN & Edge Delivery • 1001-5000 employees • Est. 2009 • Trust B • Hiring 397, 26 new
HQ: San Francisco, United States • Cloud Security • DNS Services • Web Security & DDoS Protection • CDN & Edge Delivery • 1001-5000 employees • Est. 2009 • Trust B • Hiring 397, 26 new
Cloudflare is an American internet infrastructure company founded in 2009 that operates a global network sitting in front of a large share of the world's websites and applications. Traffic passing through it is cached, accelerated and filtered for attacks, and the same network now runs a zero trust access product for corporate applications, a serverless compute platform called Workers, object storage without egress fees, and a developer platform for databases, queues and artificial intelligence inference. Headquartered in San Francisco and listed on the New York Stock Exchange, it publishes widely read research on internet traffic patterns and attack trends.
Michelle Zatlyn · Co-founder and President · decision-maker
Matthew Prince · Co-founder and Chief Executive Officer · decision-maker
Lee Holloway · Co-founder · founder
No careers mailbox known
Verified live · 3 hours ago 4 days ago Likely open · 63%

Security Engineer, Applied Research & Labs

≈ $134k – $260k per year (Estimated) • Middle • 4+ years exp • Hybrid (Austin, United States) • Middle
Python
TypeScript
AI/ML
Function Calling
AI Agents
LLM
OpenAI Agents SDK
Context Engineering
LLM Evaluation
Multi-Agent Systems
Tool Use
Galileo
DevOps
Cloudflare
DNS
+5
Apply

OpenAI

openai.com
openai.com • HQ: San Francisco, United States • Artificial Intelligence • Code Intelligence • Generative Video • Conversational AI • AI Research Labs • Foundation Models • LLM & Generative AI • 5000+ employees • Est. 2015 • Trust B • Hiring 792, 48 new
HQ: San Francisco, United States • Artificial Intelligence • Code Intelligence • Generative Video • Conversational AI • AI Research Labs • Foundation Models • LLM & Generative AI • 5000+ employees • Est. 2015 • Trust B • Hiring 792, 48 new
OpenAI is an American artificial intelligence research and deployment company founded in 2015 with the mission of ensuring that artificial general intelligence benefits all of humanity. It develops the GPT family of large language models and turns them into consumer and developer products, including the ChatGPT assistant, the Sora video model, the Codex coding agent and a commercial API used by millions of developers. Structured as a public benefit corporation controlled by a non-profit foundation, the company is backed by Microsoft and SoftBank and operates from San Francisco.
Greg Brockman · Co-Founder & President · decision-maker
Sam Altman · Co-Founder & Chief Executive Officer · decision-maker
Jakub Pachocki · Chief Scientist · decision-maker
Brad Lightcap · Chief Operating Officer · decision-maker
No careers mailbox known
Verified live · 1 hour ago 4 days ago Likely open · 63%

Applied AI Engineer, Digital Natives

≈ $119k – $275k per year (Estimated) • Hybrid (Munich, Germany) • Relocation • Full-Time • German
Python
JavaScript
TypeScript
AI/ML
OpenAI
LLM Evaluation
Apply
Verified live · 1 hour ago 24 days ago Fading · 44%

Applied AI Engineer, Codex

≈ $84k – $178k per year (Estimated) • Hybrid (Paris, France) • Relocation • Full-Time • French: C1 • English: C1
Python
JavaScript
TypeScript
AI/ML
OpenAI
OpenAI Codex
LLM Evaluation
Agentic Workflows
Apply

MX

mxtechnologies.ai
mxtechnologies.ai • HQ: Lehi, United States • Financial Software & Embedded Finance • Hiring 12, 2 new
HQ: Lehi, United States • Financial Software & Embedded Finance • Hiring 12, 2 new
MX is a fintech company that builds technology helping banks, credit unions and fintechs deliver smarter and more intuitive financial experiences to millions of people. It hires cloud and infrastructure engineers, technical program managers, engineering managers and creative and accounting leaders. The company is headquartered in Lehi, Utah, United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 27 min ago Visa sponsor 4 days ago Hiring now · 86%

Senior Software Engineer I

≈ $129k – $237k per year (Estimated) • Senior • 5+ years exp • In office (Lehi, United States) • Senior
TypeScript
Node JS
Elixir
JavaScript
Ruby
Ruby
Ruby on Rails
Sidekiq
Databases
PostgreSQL
Redis
NATS
RabbitMQ
AI/ML
Model Context Protocol
Vertex AI
Function Calling
LLM
RAG
OpenAI
LLM Evaluation
LLM Guardrails
Tool Use
Frontend
Redux
React.js
Vite
Storybook
Material UI
DevOps
Rest API
OpenTelemetry
Datadog
Azure
CI/CD
Docker
Kubernetes
QA
Playwright
Vitest
+26
Apply

Benchmark IT Solutions LLC

benchmarkit.solutions
benchmarkit.solutions • Pune • Fort Lauderdale • Morrisville • Pittsburgh • Information Technology • Est. 2005 • IT services • Hiring 3, 3 new
Pune • Fort Lauderdale • Morrisville • Pittsburgh • Information Technology • Est. 2005 • IT services • Hiring 3, 3 new
Benchmark IT Solutions is leading software product engineering companies, dedicated to delivering innovative solutions that propel businesses forward.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 4 days ago Hiring now · 90%

AI Technical Lead

≈ $22k – $56k per year (Estimated) • Lead • 1+ year exp • In office (Pune, India) • Full-Time • Staff
Python
AI/ML
Computer Vision
LLM
RAG
DINOv2
OpenAI
OCR
LLM Evaluation
LLM Guardrails
Tool Use
DevOps
GCP
Azure
AWS
Azure AKS
Kubernetes
Cybersecurity
ISO 27001
PCI DSS
SOC 2
HIPAA
Least Privilege
QA
Playwright
+13
Apply

WorldRemit

worldremit.com
worldremit.com • HQ: London, United Kingdom • Money Transfer & Remittances • 201-500 employees • Est. 2010 • Hiring 24, 5 new
HQ: London, United Kingdom • Money Transfer & Remittances • 201-500 employees • Est. 2010 • Hiring 24, 5 new
WorldRemit is a London money transfer company founded in 2010 that sends remittances digitally to recipients in developing markets. Its network pays out to bank accounts, mobile money wallets and cash agents across scores of countries. The company was one of the first to move migrant remittances from cash shops to smartphones.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago Visa sponsor 4 days ago Hiring now · 90%

Senior Software Engineer - AI

≈ $83k – $158k per year (Estimated) • Senior • Hybrid (United Kingdom) • Full-Time • Senior
Python
Java
Kotlin
SQL
Java
Spring Boot
Databases
PostgreSQL
Apache Kafka
AI/ML
AI Agents
Claude
Anthropic
LLM Evaluation
Agentic Workflows
DevOps
Rest API
gRPC
Terraform
Loki
ArgoCD
AWS
Kubernetes
Grafana
+12
Apply

Pfizer

pfizer.com
pfizer.com • HQ: New York, United States • Infectious Disease Therapeutics • Oncology Therapeutics • Prescription Drugs • 1001-5000 employees • Est. 1849 • NYSE: PFE • Hiring 251, 127 new
HQ: New York, United States • Infectious Disease Therapeutics • Oncology Therapeutics • Prescription Drugs • 1001-5000 employees • Est. 1849 • NYSE: PFE • Hiring 251, 127 new
Pfizer is an American multinational pharmaceutical and biotechnology company headquartered in New York City, developing, manufacturing and marketing prescription medicines and vaccines in areas such as oncology, internal medicine, inflammation and immunology, and infectious diseases. Founded in 1849 by Charles Pfizer and Charles Erhart, it is listed on the New York Stock Exchange and operates research and manufacturing sites across the US, Europe and Asia, including a digital hub in Thessaloniki and large commercial teams in China. Its board hires medical information specialists, quality assurance and GMP audit managers, marketing leads, accountants, engineers and AI experience designers.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 4 hours ago Visa sponsorship 4 days ago Hiring now · 90%

Translational AI Engineer

$139k – $232k per year • Senior • 6+ years exp • Hybrid (Cambridge, United States) • Relocation • Bachelor's Degree • Full-Time • Senior
Python
TypeScript
Databases
PostgreSQL
AI/ML
LangChain
LlamaIndex
Fine-tuning
Prompt Engineering
AI Agents
PyTorch
RAG
Hugging Face
LLM Evaluation
LLM Guardrails
Agentic Workflows
DevOps
GCP
Azure
CI/CD
AWS
Analytics
ETL/ELT
+11
Apply

Infiterra

infiterra.com
infiterra.com • Thessaloniki • Engomi • Managed IT Services (MSP) • Subscription Commerce • Commerce • Est. 2018 • Likely startup • Hiring 5, 1 new
Thessaloniki • Engomi • Managed IT Services (MSP) • Subscription Commerce • Commerce • Est. 2018 • Likely startup • Hiring 5, 1 new
Automate subscription billing, ordering, and quote-to-cash workflows with Infiterra, the subscription commerce platform for IT distributors and MSPs.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 4 days ago Hiring now · 90%

Senior AI Engineer

≈ $38k – $97k per year (Estimated) • Senior • Remote (United Kingdom, Greece) • Full-Time • Senior • English: C1
Python
AI/ML
Fine-tuning
Function Calling
AI Agents
LLM
RAG
Anomaly Detection
Structured Outputs
Agentic Workflows
Tool Use
LangGraph
LangChain
Model Context Protocol
LLM Evaluation
DevOps
CI/CD
Kubernetes
+8
Apply

Infrrd

infrrd.ai
infrrd.ai • HQ: San Jose, United States • Machine Learning • Custom Software Development • 1-10 employees • Est. 2017 • Startup • Hiring 4, 2 new
HQ: San Jose, United States • Machine Learning • Custom Software Development • 1-10 employees • Est. 2017 • Startup • Hiring 4, 2 new
Infrrd caters to a Machine Intelligence Company that help enterprises get more done with our vision, natural language processing and predictive algorithms focused Artificial Intelligence Platform.
Amit Jnagal · Executive Officer, Director · decision-maker
Ashish Gupta · Director
Alan Rich · Director
Srinivas Ramanujam · Director
Careers mailbox is known
4 days ago Hiring now · 90%

Senior QA Automation Engineer

≈ $13k – $31k per year (Estimated) • Senior • 7+ years exp • In office (Bengaluru, India) • Senior
Python
JavaScript
TypeScript
Java
Python
Flask
FastAPI
Java
Spring Boot
AI/ML
Claude Code
LLM
LLM Evaluation
Frontend
Angular
React.js
DevOps
Rest API
GitHub Actions
GitLab CI
CI/CD
Jenkins
Docker
Kubernetes
Shift-Left
Cybersecurity
Shift-Left Security
QA
Playwright
Postman
Rest-Assured
Pytest
JMeter
Pact
k6
Locust
+21
Apply
9 days ago Hiring now · 81%

Senior QA Automation Engineer - Playwright

≈ $13k – $31k per year (Estimated) • Senior • 7+ years exp • In office (Bengaluru, India) • Senior
Python
JavaScript
TypeScript
Java
Python
Flask
FastAPI
Java
Spring Boot
AI/ML
Claude Code
LLM
LLM Evaluation
Frontend
Angular
React.js
DevOps
Rest API
GitHub Actions
GitLab CI
CI/CD
Jenkins
Docker
Kubernetes
Shift-Left
Cybersecurity
Shift-Left Security
QA
Playwright
Postman
Rest-Assured
Pytest
JMeter
Pact
k6
Locust
+21
Apply

UnitedHealth Group

unitedhealthgroup.com
unitedhealthgroup.com • HQ: Eden Prairie, United States • Health Insurance & Benefits • Pharmacies • Hospitals & Health Systems • 5000+ employees • Est. 1977 • NYSE: UNH • Trust B • Hiring 2073, 315 new
HQ: Eden Prairie, United States • Health Insurance & Benefits • Pharmacies • Hospitals & Health Systems • 5000+ employees • Est. 1977 • NYSE: UNH • Trust B • Hiring 2073, 315 new
UnitedHealth Group is an American health care and health insurance company headquartered in Eden Prairie, Minnesota, near Minneapolis. It works through two businesses, UnitedHealthcare for health benefits and Optum for care delivery, pharmacy services, data and technology, and it is the largest health care company by revenue, ranked fourth on the 2026 Fortune Global 500. Openings include customer service advocates, care coordinators, pharmacy technicians, clinical staff and software, data and AI engineers in the US, India, the Philippines and Ireland.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 4 days ago Likely open · 62%

AI/ML Engineer - Python, Agentic AI

≈ $21k – $46k per year (Estimated) • Senior • 7+ years exp • In office (Bengaluru, India) • Bachelor's Degree • Senior
Python
Java
TypeScript
C#
Databases
Weaviate
Pinecone
FAISS
AI/ML
LangChain
Model Context Protocol
Embeddings
Function Calling
AI Agents
DeepEval
Ragas
Semantic Kernel
RAG
Hallucination
Human-in-the-Loop
LLM Evaluation
Agentic Workflows
Tool Use
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
+19
Apply
Verified live · 1 hour ago 4 days ago Likely open · 62%

Senior AI/ML Engineer - Python, Agentic AI, Cloud

≈ $21k – $46k per year (Estimated) • Senior • 8+ years exp • In office (Bengaluru, India) • Bachelor's Degree • Senior
Python
Java
TypeScript
C#
Databases
Weaviate
Pinecone
FAISS
AI/ML
LangChain
Model Context Protocol
Embeddings
Function Calling
AI Agents
DeepEval
Ragas
Semantic Kernel
RAG
Hallucination
Human-in-the-Loop
LLM Evaluation
Agentic Workflows
Tool Use
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
+19
Apply
Top 25% payVerified live · 1 hour ago 19 days ago Fading · 44%

Sr. AI/ML Engineer- Remote or Eden Prairie, MN

$120k – $215k per year • Senior • 5+ years exp • Eden Prairie • Remote (United States) • Bachelor's Degree • Senior
PostgreSQL
pgvector
OpenSearch
AI/ML
Copilot
LangGraph
Claude
Claude Code
Model Context Protocol
AI Agents
Pydantic AI
LLM
Google ADK
OpenAI Codex
OpenAI Agents SDK
AWS Strands Agents
Google AI Studio
LLM Evaluation
Edge AI
LangChain
Vertex AI
Embeddings
DeepEval
Langfuse
LangSmith
Promptfoo
Ragas
AWS Bedrock
RAG
Reranking
Semantic Search
Braintrust
AWS Bedrock AgentCore
Semantic Search
DevOps
CI/CD
AWS
Azure
Kubernetes
Amazon EKS
Azure AKS
Management
Slack
+32
Apply

TNS

tnsi.com
tnsi.com • HQ: Reston, United States • Financial Software & Embedded Finance • Managed Network Services • 501-1000 employees • Trust B • Hiring 46, 2 new
HQ: Reston, United States • Financial Software & Embedded Finance • Managed Network Services • 501-1000 employees • Trust B • Hiring 46, 2 new
TNS (Transaction Network Services) is a US provider of data communications and interoperability services, headquartered in Reston, Virginia, that runs private networks and infrastructure-as-a-service for payments, telecommunications and financial markets. Founded in 1990 to serve the point-of-sale industry, it now offers payment connectivity, unattended payments for parking and EV charging, caller identity and branded calling, roaming and IPX services and trading connectivity from offices in the US, Europe, India, Australia and Brazil. It hires network engineers, NOC technicians, payments and security analysts, cloud architects and service delivery managers.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 days ago 4 days ago Likely open · 63%

Sr AI Architect/Engineer

$150k – $250k per year • Staff+ • In office (Reston, Washington, New York, United States, Sheffield, United Kingdom) • Full-Time • Architect
Copilot
Claude
Function Calling
AWS Bedrock
LLM
RAG
Anthropic
LLM Evaluation
LLM Guardrails
Prompt Caching
Tool Use
Copilot Studio
DevOps
AWS
IAM
Amazon CloudWatch
Terraform
Azure
CI/CD
Cybersecurity
Least Privilege
Microsoft Entra ID
Management
SharePoint
+13
Apply
Machines can read this selection · checked 07:33 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.