LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Sitetracker

sitetracker.com
sitetracker.com • HQ: Montclair, United States • Project & Work Management Software • 501-1000 employees • Est. 2013 • Trust B • Hiring 20, 1 new
HQ: Montclair, United States • Project & Work Management Software • 501-1000 employees • Est. 2013 • Trust B • Hiring 20, 1 new
Headquartered in Montclair, New Jersey, Sitetracker is an enterprise software company specializing in critical infrastructure lifecycle management solutions. The company provides a cloud-based Asset Lifecycle Management (ALM) platform designed for telecommunications operators, renewable energy developers, EV charging networks, and utilities.
Brett Cupta · Executive Officer · decision-maker
Timothy May · Director · decision-maker
Giuseppe Incitti · Executive Officer, Director · decision-maker
Michael Creegan · Executive Officer · decision-maker
Careers mailbox is known
Top 25% payVerified live · 3 hours ago Visa sponsor 1 day ago Hiring now · 90%

Senior Data Scientist (Agentic UX), Design

$145k – $215k per year • Senior • Remote (United States) • Full-Time • Senior
Cursor
Claude Code
AI Agents
LLM
LLM Evaluation
Analytics
A/B Testing
Management
Slack
Scrum
Apply

Boon

getboon.ai
getboon.ai • HQ: San Francisco, United States • Custom Software Development • Startup • Hiring 4, 1 new
HQ: San Francisco, United States • Custom Software Development • Startup • Hiring 4, 1 new
Boon is the AI teammate for preconstruction teams — reads full plan-and-spec sets, catches spec/drawing conflicts, generates RFIs, levels bids, and runs takeoff inside the tools your team already uses.
No named decision-maker yet.
No careers mailbox known
Verified live · 27 min ago 1 day ago Hiring now · 86%

Technical Architect

≈ $166k – $277k per year (Estimated) • Staff+ • 10+ years exp • Remote (United States) • Full-Time • Architect
Python
Ruby
Ruby
Sidekiq
Databases
PostgreSQL
RabbitMQ
AI/ML
MLFlow
Computer Vision
AI Agents
VLM
LLM
OpenAI Agents SDK
OCR
LLM Evaluation
DevOps
GCP
Helm
CI/CD
AWS
Kubernetes
+10
Apply

Alice

alice.io
alice.io • New York • London • Hanoi • Ramat Gan • San Francisco • Foundation Models • LLM & Generative AI • Artificial Intelligence • Threat Intelligence • AI Governance & Compliance • AI Safety & Alignment • 51-200 employees • Startup • Hiring 29, 6 new
New York • London • Hanoi • Ramat Gan • San Francisco • Foundation Models • LLM & Generative AI • Artificial Intelligence • Threat Intelligence • AI Governance & Compliance • AI Safety & Alignment • 51-200 employees • Startup • Hiring 29, 6 new
Alice is the most trusted partner for GenAI safety and security. Built on a decade of threat intelligence research, Alice helps organizations detect, prevent, and respond to AI risks across the full model lifecycle.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 1 day ago Hiring now · 90%

Senior Data Product Manager, AI

≈ $117k – $261k per year (Estimated) • Senior • 5+ years exp • Hybrid (Ramat Gan, Israel) • Full-Time • Senior
Prompt Engineering
AI Agents
LLM
RAG
Red Teaming
LLM Evaluation
LLM Guardrails
Apply
Verified live · 2 hours ago 29 days ago Fading · 34%

Researcher, Evaluations and Benchmarks

≈ $136k – $273k per year (Estimated) • Middle • 3+ years exp • New York • Remote (United States) • Master's Degree • Full-Time • Middle • English
vLLM
Function Calling
AI Agents
DPO
SFT
GRPO
Post-training
LLM Evaluation
LLM Guardrails
Tool Use
Machine Learning
+3
Apply

InPost

inpost.eu
inpost.eu • HQ: Kraków, Poland • Logistics • Delivery • Courier Services • 5000+ employees • Est. 1999 • Trust B • Hiring 110, 25 new
HQ: Kraków, Poland • Logistics • Delivery • Courier Services • 5000+ employees • Est. 1999 • Trust B • Hiring 110, 25 new
InPost is a leading European logistics company and out-of-home delivery provider best known for its extensive network of Automated Parcel Machines (APMs) and pick-up/drop-off points. The company offers last-mile parcel delivery, courier services, and efficient returns handling tailored for major e-commerce merchants and individual shoppers. By combining modern automated infrastructure with a mobile application, it delivers a convenient, flexible, and eco-friendly alternative to traditional door-to-door delivery.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 1 day ago Hiring now · 90%

Staff ML Platform Engineer - Fintech Engineering (m/f/n)

≈ $77k – $133k per year (Estimated) • Staff+ • 7+ years exp • Hybrid (Warsaw, Poland) • Full-Time • Senior • English: B2
Python
Databases
Databricks
AI/ML
Spark
MLFlow
SHAP
XGBoost
Scikit-learn
AI Agents
PyTorch
LLM
Feature Store
LLM Evaluation
LLM Guardrails
Machine Learning
DevOps
CI/CD
+7
Apply
Verified live · 1 hour ago 1 day ago Hiring now · 90%

Senior ML Engineer - Fintech Engineering (m/f/n)

≈ $63k – $105k per year (Estimated) • Senior • Hybrid (Warsaw, Poland) • Contractor • Senior • English: B2
Python
SQL
Databases
Databricks
AI/ML
Spark
SHAP
AI Agents
LIME
Feature Store
LLM Evaluation
LLM Guardrails
DevOps
CI/CD
+3
Apply
Verified live · 1 hour ago 11 days ago Hiring now · 74%

Principal Software Engineer - Fintech Platform (m/f/n)

≈ $68k – $110k per year (Estimated) • Lead • 10+ years exp • Hybrid (Warsaw, Poland) • Bachelor's Degree • Full-Time • Senior • Polish (Optional) • English: B2
AI Agents
LLM
Time Series Forecasting
LLM Evaluation
Multi-Agent Systems
Tool Use
DevOps
Rest API
GCP
Azure
AWS
Cybersecurity
PCI DSS
+3
Apply

Zinkworks

zinkworks.com
zinkworks.com • Athlone • Shannon • Cloud Consulting & Migration • IT Consulting & Digital Transformation • 11-50 employees • Trust A • Hiring 14, 3 new
Athlone • Shannon • Cloud Consulting & Migration • IT Consulting & Digital Transformation • 11-50 employees • Trust A • Hiring 14, 3 new
About Us Zinkworks is a trusted partner to Telecommunications and Financial Services organizations around the world. We help modernise legacy systems, move mission-critical systems into the cloud, and exploit the power of AI-driven automation.
No named decision-maker yet.
Careers mailbox is known
Verified live · 10 hours ago 1 day ago Hiring now · 86%

Senior AI/ML Engineer

≈ $86k – $171k per year (Estimated) • Senior • In office (Athlone, Ireland) • Full-Time • Senior
Python
Databases
Google BigQuery
BigQuery
AI/ML
Vertex AI
Scikit-learn
Function Calling
AI Agents
NumPy
LLM
Anomaly Detection
Time Series Forecasting
LLM Evaluation
LLM Guardrails
Tool Use
RAG
DevOps
GCP
CI/CD
Git
Management
Jira
+11
Apply

Nuvei

nuvei.com
nuvei.com • HQ: Montreal, Canada • Crypto Payments • Payment Processing & Gateways • 51-200 employees • Est. 2003 • Trust A • Hiring 58, 16 new
HQ: Montreal, Canada • Crypto Payments • Payment Processing & Gateways • 51-200 employees • Est. 2003 • Trust A • Hiring 58, 16 new
Nuvei is a Canadian payment technology company that provides merchants with payment processing, acquiring, payouts and risk management across online, mobile and in-store channels, supporting hundreds of local payment methods and cryptocurrencies. Founded in 2003, it serves sectors such as e-commerce, online gaming, financial services and marketplaces, and was taken private by Advent International in 2024. The company is headquartered in Montreal, Quebec, Canada.
David Schwartz · Executive Officer · decision-maker
Phil Atherton · Executive Officer · decision-maker
Keith Birdsong · Executive Officer · decision-maker
Mordechay Bring · Executive Officer · decision-maker
Careers mailbox is known
Verified live · 3 hours ago 1 day ago Hiring now · 90%

Agentic Software Engineer

Hybrid (Tel Aviv, Israel) • Full-Time
Model Context Protocol
Function Calling
AI Agents
RAG
Hallucination
LLM Evaluation
Agentic Workflows
Tool Use
DevOps
GCP
Azure
CI/CD
AWS
Platform Engineering
+5
Apply
Verified live · 3 hours ago 1 day ago Hiring now · 90%

Agentic Softwaer Engineering Expert

≈ $89k – $227k per year (Estimated) • Senior • Hybrid (Tel Aviv, Israel) • Full-Time • Senior
Model Context Protocol
AI Agents
LLM Evaluation
DevOps
CI/CD
Platform Engineering
Apply

Vi

vi.co
vi.co • HQ: Tel Aviv, Israel • Health Data & Interoperability • Medical AI • Est. 2011 • Startup • Hiring 10, 4 new
HQ: Tel Aviv, Israel • Health Data & Interoperability • Medical AI • Est. 2011 • Startup • Hiring 10, 4 new
Vi is a health technology company that builds productized artificial intelligence for healthcare enterprises such as providers, payers and health systems. Its data science products target patient outcomes and operational efficiency, including patient engagement and care management use cases. The company originated as the Israeli startup LifeBEAM and is headquartered in Israel.
No named decision-maker yet.
Careers mailbox is known
Verified live · 4 hours ago 1 day ago Hiring now · 90%

Senior Data Scientist

≈ $77k – $199k per year (Estimated) • Senior • 4+ years exp • In office (Tel Aviv, Israel) • Full-Time • Senior
Python
SQL
AI/ML
Spark
Embeddings
AI Agents
LLM
LLM Evaluation
Agentic Workflows
DevOps
AWS
CI/CD
Docker
+3
Apply

Marsh McLennan

marshmclennan.com
marshmclennan.com • HQ: New York, United States • 1001-5000 employees • Est. 1871 • Hiring 191, 79 new
HQ: New York, United States • 1001-5000 employees • Est. 1871 • Hiring 191, 79 new
Marsh McLennan is a global professional services firm in risk, strategy and people, headquartered in New York and listed on the New York Stock Exchange. It operates through four businesses, Marsh in insurance broking, Guy Carpenter in reinsurance, Mercer in health, wealth and benefits consulting and Oliver Wyman in management consulting, with about 90,000 colleagues in some 130 countries. It hires catastrophe risk analysts, reinsurance brokers, benefits consultants, sales executives, paralegals, software engineers and IT support staff in hubs such as London, Cluj-Napoca and Mexico City.
No named decision-maker yet.
No careers mailbox known
Verified live · 4 min ago 1 day ago Hiring now · 90%

Software Engineer (Generative AI and Innovation)

Junior • 2+ years exp • Hybrid (Dublin, Ireland) • Full-Time • Junior
Python
JavaScript
TypeScript
Node JS
Node JS
Nest.JS
AI/ML
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
RAG
Semantic Search
Structured Outputs
Semantic Search
LLM Evaluation
LLM Guardrails
Tool Use
Frontend
Vue.js
Angular
React.js
DevOps
AWS
Kubernetes
Management
Agile
+14
Apply

Svitla Systems

svitla.com
svitla.com • HQ: Corte Madera, United States • DevOps & Platform Engineering • IT Outsourcing & Dedicated Teams • Custom Software Development • Est. 2003 • Trust B • Hiring 100, 15 new
HQ: Corte Madera, United States • DevOps & Platform Engineering • IT Outsourcing & Dedicated Teams • Custom Software Development • Est. 2003 • Trust B • Hiring 100, 15 new
Svitla Systems is a global digital solutions and custom software engineering company headquartered in California, with delivery centers across North America, Latin America, Europe, and Asia. Founded in 2003, the company offers end-to-end IT services, including cloud architecture, AI/machine learning integration, data engineering, DevOps, and mobile and web application development.
No named decision-maker yet.
Careers mailbox is known
Verified live · 5 hours ago 1 day ago Hiring now · 90%

Senior Data Engineer

≈ $90k – $204k per year (Estimated) • Senior • 5+ years exp • Remote (likely Argentina, Colombia, Mexico, Costa Rica) • Senior
Python
SQL
AI/ML
AI Agents
LLM
LLM Evaluation
DevOps
GitHub
Apply
Verified live · 5 hours ago 1 day ago Hiring now · 90%

Senior Full-Stack Engineer

≈ $54k – $125k per year (Estimated) • Senior • 6+ years exp • Argentina • Remote (Argentina) • Senior
JavaScript
AI/ML
AI Agents
LLM
LLM Evaluation
LLM Guardrails
Frontend
React.js
Mobile
React Native
DevOps
CI/CD
GitHub
+1
Apply

Level

level.me
level.me • HQ: Austin, United States • Trust A • Hiring 30, 2 new
HQ: Austin, United States • Trust A • Hiring 30, 2 new
Level is an educational technology and interactive learning company headquartered in Austin, Texas, with team presence in Bellevue, Washington, and Auckland, New Zealand. The company builds a digital learning platform that merges learning science and standards-aligned curricula with interactive game mechanics and software design to make academic practice engaging and rewarding. Focused initially on K-8 education - beginning with Math and English Language Arts (ELA) - its application delivers structured practice modules for students, workflow and engagement tools for teachers, and progress-tracking resources for parents.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 1 day ago Likely open · 63%

Applied AI Engineer

≈ $129k – $245k per year (Estimated) • Senior • 7+ years exp • In office (Austin, United States) • Full-Time • Senior
Python
TypeScript
AI/ML
LangGraph
Claude
LlamaIndex
Embeddings
Prompt Engineering
Function Calling
Chain-of-Thought
AI Agents
Anthropic SDK
Instructor
Outlines
Pydantic AI
CrewAI
LLM
In-Context Learning
Hybrid Search
OpenAI Agents SDK
Human-in-the-Loop
Structured Outputs
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
Mastra
LangChain
DSPy
Model Context Protocol
GraphRAG
DevOps
GCP
AWS
Cybersecurity
NIST CSF
+25
Apply
Open 142 daysVerified live · 2 hours ago 5 months ago Long shot · 5%

Senior Applied AI Engineer

≈ $129k – $245k per year (Estimated) • Senior • 7+ years exp • In office (Austin, United States) • Relocation • Full-Time • Senior
Python
TypeScript
AI/ML
LangGraph
Claude
LlamaIndex
Embeddings
Prompt Engineering
Function Calling
Chain-of-Thought
AI Agents
Anthropic SDK
Instructor
Outlines
Pydantic AI
CrewAI
LLM
In-Context Learning
Hybrid Search
OpenAI Agents SDK
Human-in-the-Loop
Structured Outputs
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
Mastra
LangChain
DSPy
Model Context Protocol
GraphRAG
DevOps
GCP
AWS
+24
Apply

BOLD

bold.com
bold.com • Noida • San Francisco • Taipei • Job Boards & Aggregators • Recruiting & Staffing • Est. 2007 • Trust B • Hiring 23, 1 new
Noida • San Francisco • Taipei • Job Boards & Aggregators • Recruiting & Staffing • Est. 2007 • Trust B • Hiring 23, 1 new
Our family of BOLD solutions help jobseekers and employers. Our online destinations provide unique solutions that help people find jobs, and employers find people.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 2 days ago Likely open · 60%

Director, Security

≈ $50k – $131k per year (Estimated) • Head+ • 12+ years exp • Hybrid (Noida, India) • Architect
Python
Go
Java
SQL
Databases
GraphDB
AI/ML
LLM
LLM Guardrails
EU AI Act
Tool Use
LLM Evaluation
NIST AI RMF
Agentic Workflows
DevOps
Terraform
Azure
CI/CD
AWS
Kubernetes
Amazon EKS
Azure AKS
IAM
Cybersecurity
OWASP Top 10
PCI DSS
GDPR
Least Privilege
OWASP
+17
Apply

QAD

qad.com
qad.com • HQ: Santa Barbara, United States • Supply Chain & Logistics Software • Manufacturing & Industrial Software • ERP & Business Management Software • 201-500 employees • Est. 1979 • Trust B • Hiring 50, 13 new
HQ: Santa Barbara, United States • Supply Chain & Logistics Software • Manufacturing & Industrial Software • ERP & Business Management Software • 201-500 employees • Est. 1979 • Trust B • Hiring 50, 13 new
QAD is an American enterprise software company that develops QAD Adaptive ERP and related supply chain, quality and production management applications for manufacturers in the automotive, life sciences, consumer products, food and beverage, high technology and industrial sectors. Founded in 1979 and taken private by Thoma Bravo in 2021, it also owns the Redzone factory productivity platform and runs a large development centre in Pune. The company is headquartered in Santa Barbara, California, United States.
No named decision-maker yet.
Careers mailbox is known
Verified live · 4 hours ago 2 days ago Hiring now · 90%

Principal AI Engineer - Enterprise Transformation

≈ $21k – $55k per year (Estimated) • Lead • 6+ years exp • In office (Pune, India) • PhD • Full-Time • Senior • English
Python
Java
TypeScript
Databases
Weaviate
pgvector
Pinecone
ElasticSearch
OpenSearch
PostgreSQL
AI/ML
LangGraph
LlamaIndex
Vertex AI
Fine-tuning
Prompt Engineering
Knowledge Distillation
AI Agents
DeepEval
Langfuse
LangSmith
Ragas
Semantic Kernel
AWS Bedrock
CrewAI
LLM
RAG
Google ADK
Reranking
Hybrid Search
Braintrust
Amazon SageMaker
AWS Strands Agents
Feature Store
Human-in-the-Loop
Structured Outputs
Context Engineering
LLM Evaluation
Agentic Workflows
Model Distillation
LangChain
DevOps
Terraform
GCP
CI/CD
AWS
Platform Engineering
IAM
+37
Apply

Infor

infor.com
infor.com • HQ: Atlanta, United States • ERP & Business Management Software • 5000+ employees • Est. 2002 • Trust A • Hiring 196, 100 new
HQ: Atlanta, United States • ERP & Business Management Software • 5000+ employees • Est. 2002 • Trust A • Hiring 196, 100 new
Infor is an enterprise software company headquartered in Atlanta that builds industry-specific business applications, including ERP suites such as Infor LN, M3 and CloudSuite, delivered mainly as multi-tenant cloud services. Founded in 2002 and owned by Koch Industries, it serves manufacturing, distribution, healthcare, public sector and other industries, with development and support centers in the US, India, the Philippines, the Netherlands, Spain, the UK and elsewhere. Its hiring covers software engineers working in Java, .NET and C++, product support and QA analysts, ERP consultants, solution architects, and customer success and sales roles.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 2 days ago Hiring now · 82%

Software Engineer ( Python + PySpark + Agentic AI ) - 5 + Years

Hybrid (Hyderabad, Pakistan) • Full-Time
Python
SQL
JavaScript
Java
Node JS
Python
Flask
FastAPI
Django
pySpark
Databases
PostgreSQL
Delta Lake
Apache Kafka
Amazon DocumentDB
AI/ML
Copilot
Cursor
LangGraph
LangChain
Spark
Claude Code
LlamaIndex
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
AI Agents
AWS Bedrock
LLM
RAG
OpenAI
Anthropic
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Tool Use
Scikit-learn
NumPy
DevOps
Git
AWS
Docker
Amazon EKS
Amazon S3
Linux
Helm
GitOps
Kubernetes
Analytics
AWS Glue
QA
Pytest
+39
Apply

Rubrik

rubrik.com
rubrik.com • HQ: Palo Alto, United States • Cloud Security • Backup & Disaster Recovery • Est. 2014 • NYSE: RBRK • Trust A • Hiring 134, 16 new
HQ: Palo Alto, United States • Cloud Security • Backup & Disaster Recovery • Est. 2014 • NYSE: RBRK • Trust A • Hiring 134, 16 new
Rubrik is an American data security company that sells backup, recovery and cyber resilience software protecting enterprise data across data centers, cloud platforms and SaaS applications. Its platform combines immutable backups with threat detection, data security posture management and recovery tools, and it serves enterprises and public sector agencies worldwide. Listed on the New York Stock Exchange since 2024, the company is headquartered in Palo Alto, California, United States.
Julia van der Vink · Executive Officer, Director · decision-maker
Robert Black · Executive Officer, Director · decision-maker
Nicholas van der Vink · Executive Officer · decision-maker
Careers mailbox is known
Verified live · 4 hours ago 2 days ago Likely open · 63%

Senior AI Evals Engineer

≈ $31k – $68k per year (Estimated) • Senior • 8+ years exp • In office (Bengaluru, India) • Bachelor's Degree • Senior
Python
Java
TypeScript
SQL
AI/ML
Vertex AI
Prompt Engineering
Function Calling
AI Agents
DeepEval
LangSmith
Promptfoo
Gemini
LLM
RAG
Google ADK
Hallucination
Hugging Face
LLM Evaluation
Agentic Workflows
Tool Use
LangGraph
LangChain
Claude
Fine-tuning
NLP
Pandas
OpenAI
Anthropic
OpenAI Agents SDK
Human-in-the-Loop
LLM Guardrails
Machine Learning
DevOps
GCP
GitHub Actions
Datadog
CI/CD
Jenkins
Git
Kubernetes
Grafana
Azure
AWS
Management
Jira
Agile
Scrum
QA
Pytest
Selenium
Playwright
+40
Apply

Atlassian

atlassian.com
atlassian.com • HQ: Sydney, Australia • IT Service & Asset Management • Intranet & Knowledge Management • Developer Tools • Project & Work Management Software • 1001-5000 employees • Est. 2002 • NASDAQ: TEAM • Trust A • Hiring 337, 44 new
HQ: Sydney, Australia • IT Service & Asset Management • Intranet & Knowledge Management • Developer Tools • Project & Work Management Software • 1001-5000 employees • Est. 2002 • NASDAQ: TEAM • Trust A • Hiring 337, 44 new
Atlassian is an Australian software company founded in Sydney in 2002 by Mike Cannon-Brookes and Scott Farquhar, who funded it on credit cards and grew it for years without a traditional sales force. Its products became the default coordination layer for software teams: Jira for issue and project tracking, Confluence for documentation, Bitbucket for source control and Jira Service Management for IT support. Listed on Nasdaq since 2015, the company has expanded into video messaging with Loom and agentic AI through Rovo, and derives almost all of its revenue from cloud subscriptions after retiring its self-hosted server products.
Scott Farquhar · Co-Founder · decision-maker
Mike Cannon-Brookes · Co-Founder & Chief Executive Officer · decision-maker
Joe Binz · Chief Financial Officer · decision-maker
Careers mailbox is known
Verified live · 2 hours ago 2 days ago Hiring now · 99%

Principal Technical Program Manager

≈ $192k – $338k per year (Estimated) • Lead • 8+ years exp • Seattle • Sydney • Remote (United States) • Principal
Model Context Protocol
Function Calling
AI Agents
LLM
LLM Evaluation
Agentic Workflows
Tool Use
DevOps
GCP
OpenTelemetry
Azure
AWS
+3
Apply
Verified live · 2 hours ago 12 days ago Fading · 41%

Senior Principal Technical Program Manager - Agent Infrastructure

≈ $194k – $341k per year (Estimated) • Lead • 12+ years exp • Seattle • Remote (United States) • Principal
Embeddings
AI Agents
LLM
RAG
LLM Guardrails
Model Context Protocol
LLM Evaluation
EU AI Act
Frontend
GraphQL
DevOps
Rest API
gRPC
GCP
Azure
AWS
Cybersecurity
GDPR
FedRAMP
+8
Apply
Verified live · 2 hours ago 12 days ago Fading · 33%

Senior Machine Learning System Engineer

≈ $168k – $304k per year (Estimated) • Senior • Seattle • San Francisco • Austin • New York • Remote (United States) • Senior
AI Agents
PyTorch
RAG
Reranking
Semantic Search
Triton
Semantic Search
LLM Evaluation
Machine Learning
DevOps
Platform Engineering
FinOps
SLI/SLO/SLA
Management
Confluence
Jira
+6
Apply

Cover Genius

covergenius.com
covergenius.com • HQ: Sydney, Australia • InsurTech • 501-1000 employees • Est. 2014 • Startup • Hiring 33, 5 new
HQ: Sydney, Australia • InsurTech • 501-1000 employees • Est. 2014 • Startup • Hiring 33, 5 new
Cover Genius is a Sydney insurance technology company founded in 2014 that embeds protection into other companies' checkouts. Its XCover platform is licensed in dozens of countries and pays claims automatically for travel, retail and mobility partners. The company works with airlines, marketplaces and property platforms worldwide.
Amir Massoudi · Executive Officer · decision-maker
Lexie Marchuk · Executive Officer · decision-maker
Angus McDonald · Executive Officer, Director · decision-maker
James Sutcliffe · Director
No careers mailbox known
Verified live · 3 hours ago 2 days ago Hiring now · 90%

Staff Data Scientist - GenAI

≈ $84k – $171k per year (Estimated) • Staff+ • 8+ years exp • Hybrid (Vancouver, Canada) • Bachelor's Degree • Full-Time • Staff
Python
AI/ML
Model Context Protocol
Function Calling
AI Agents
AWS Bedrock
LLM
LLM Evaluation
Multi-Agent Systems
Tool Use
Machine Learning
DevOps
AWS
Management
Stripe
+4
Apply

DoorDash

doordash.com
doordash.com • HQ: San Francisco, United States • Marketplaces • Delivery • 5000+ employees • Est. 2013 • NASDAQ: DASH • Trust B • Hiring 373, 34 new
HQ: San Francisco, United States • Marketplaces • Delivery • 5000+ employees • Est. 2013 • NASDAQ: DASH • Trust B • Hiring 373, 34 new
DoorDash is an American delivery company founded in 2013 that started with restaurant orders in suburban markets the incumbents had ignored, and now holds the largest share of United States food delivery. It has extended the same courier network into grocery, convenience, alcohol and retail delivery, sells a white-label fulfilment service to merchants who want deliveries from their own apps, and operates an advertising business selling placement to restaurants and brands. Headquartered in San Francisco and listed on Nasdaq, it acquired the European platform Deliveroo and the hospitality software firm SevenRooms in 2025.
Tony Xu · Co-founder and Chief Executive Officer · decision-maker
Ravi Inukonda · Chief Financial Officer · decision-maker
Stanley Tang · Co-founder · founder
No careers mailbox known
Verified live · 1 hour ago Visa sponsor 2 days ago Likely open · 63%

Software Engineer, ML Infrastructure (MDX)

$4k – $14k per year • Equity • Junior • 2+ years exp • In office (San Francisco, Sunnyvale, Seattle, United States) • Bachelor's Degree • Junior
Python
AI/ML
Cursor
Claude Code
AI Agents
OpenAI Codex
Feature Store
LLM Guardrails
Agentic Workflows
Model Context Protocol
MLFlow
Function Calling
Kubeflow
LLM
Ray
LLM Evaluation
Tool Use
Machine Learning
DevOps
GCP
AWS
Kubernetes
Self-Healing
+13
Apply
Verified live · 1 hour ago Visa sponsor 3 days ago Likely open · 63%

Senior Machine Learning Engineer, New Verticals Agentic Foundations

$4k – $14k per year • Equity • Senior • 3+ years exp • Hybrid (San Francisco, Sunnyvale, Seattle, United States) • Master's Degree • Senior
Python
AI/ML
Fine-tuning
Function Calling
AI Agents
NLP
TensorFlow
PyTorch
LLM
SFT
Post-training
LLM Evaluation
LLM Guardrails
Tool Use
Machine Learning
+6
Apply
Verified live · 1 hour ago Visa sponsor 2 months ago Long shot · 23%

Member of Technical Staff, Lead Researcher

$4k – $14k per year • Equity • Lead • In office (San Francisco, Sunnyvale, United States) • PhD • Staff
Multimodal AI
Function Calling
AI Agents
Post-training
Pre-training
Human-in-the-Loop
LLM Evaluation
Tool Use
Embodied AI
+1
Apply

Freddie Mac

freddiemac.com
freddiemac.com • HQ: McLean, United States • Mortgage Lending & Brokers • 501-1000 employees • Est. 1970 • Trust B • Hiring 88, 15 new
HQ: McLean, United States • Mortgage Lending & Brokers • 501-1000 employees • Est. 1970 • Trust B • Hiring 88, 15 new
Freddie Mac, the Federal Home Loan Mortgage Corporation, is a government-sponsored enterprise headquartered in McLean, Virginia, that buys mortgages from lenders and packages them into securities to provide liquidity to the US housing finance market. Chartered by Congress in 1970, it has funded trillions of dollars in single-family and multifamily loans and has operated under the conservatorship of the Federal Housing Finance Agency since 2008. It hires software engineers, product owners, risk and valuation professionals, treasury and capital markets operations staff, multifamily production associates and account executives.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 5 hours ago 2 days ago Hiring now · 86%

Technology Strategy Director

$209k – $313k per year • Head+ • 12+ years exp • In office (McLean, United States) • PhD • Full-Time • Architect
Python
TypeScript
Databases
Neo4j
OpenSearch
AI/ML
Copilot
LangGraph
AutoGen
Model Context Protocol
AI Agents
LangSmith
AWS Bedrock
LLM
RAG
OpenAI
Anthropic
GraphRAG
Knowledge Graph
LLM Evaluation
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
LangChain
DevOps
Azure
AWS
SLI/SLO/SLA
Amazon S3
+18
Apply

NTT DATA

nttdata.com
nttdata.com • HQ: Tokyo, Japan • Data Centers & Colocation • Managed IT Services (MSP) • Financial Software & Embedded Finance • IT Consulting & Digital Transformation • Systems Integrators • 501-1000 employees • Est. 1988 • Trust B • Hiring 1564, 502 new
HQ: Tokyo, Japan • Data Centers & Colocation • Managed IT Services (MSP) • Financial Software & Embedded Finance • IT Consulting & Digital Transformation • Systems Integrators • 501-1000 employees • Est. 1988 • Trust B • Hiring 1564, 502 new
NTT DATA is a Tokyo system integrator founded in 1988 that spun out of the data communications arm of NTT. It is one of the largest information technology services firms in the world, building banking, public sector and payment systems and operating global consulting and managed services. The company runs the CAFIS payment network used across Japanese retail and banking.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 2 days ago Likely open · 63%

AI Engineer

Middle • 3+ years exp • Sibiu • Remote (Romania) • Bachelor's Degree • Full-Time • Middle
Python
SQL
Databases
Weaviate
Chroma
pgvector
Pinecone
PostgreSQL
AI/ML
LangGraph
LangChain
LlamaIndex
Fine-tuning
Embeddings
Scikit-learn
JAX
Prompt Engineering
Function Calling
Chain-of-Thought
AI Agents
TensorFlow
PyTorch
LLM
RAG
Google ADK
Tokenization
Human-in-the-Loop
LLM Guardrails
Multi-Agent Systems
Tool Use
Vertex AI
Gemini
Semantic Search
Semantic Search
LLM Evaluation
DevOps
Rest API
gRPC
GCP
Azure
CI/CD
Git
AWS
OpenTelemetry
Datadog
Prometheus
Grafana
Management
Gmail
WhatsApp
+38
Apply

Bernard

bernard.io
bernard.io • HQ: New York, United States • Field Service Management Software • AI Agents • Likely startup • Hiring 6, 2 new
HQ: New York, United States • Field Service Management Software • AI Agents • Likely startup • Hiring 6, 2 new
Bernard is an AI company that fixes first-visit failures in appliance repair by answering service calls, running diagnostics and predicting the right parts against live inventory. Its system sends technicians out with a plan and is live with enterprise customers, and the company hires voice agent platform engineers, machine learning platform engineers, account executives and client success managers. The company is headquartered in New York, United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 2 days ago Hiring now · 90%

AI Engineer, Software Factory

≈ $144k – $315k per year (Estimated) • In office (New York, United States) • Full-Time
Python
TypeScript
JavaScript
Node JS
Node JS
Fastify
Databases
PostgreSQL
Supabase
Neo4j
AI/ML
LLM Evaluation
LLM Guardrails
Frontend
Next.js
React.js
DevOps
Grafana
GitHub
Management
Slack
+7
Apply
Machines can read this selection · checked 21:00 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.