LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Freddie Mac

freddiemac.com
freddiemac.com • HQ: McLean, United States • Mortgage Lending & Brokers • 501-1000 employees • Est. 1970 • Trust B • Hiring 90, 17 new
HQ: McLean, United States • Mortgage Lending & Brokers • 501-1000 employees • Est. 1970 • Trust B • Hiring 90, 17 new
Freddie Mac, the Federal Home Loan Mortgage Corporation, is a government-sponsored enterprise headquartered in McLean, Virginia, that buys mortgages from lenders and packages them into securities to provide liquidity to the US housing finance market. Chartered by Congress in 1970, it has funded trillions of dollars in single-family and multifamily loans and has operated under the conservatorship of the Federal Housing Finance Agency since 2008. It hires software engineers, product owners, risk and valuation professionals, treasury and capital markets operations staff, multifamily production associates and account executives.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 6 hours ago 2 days ago Hiring now · 90%

Technology Strategy Director

$209k – $313k per year • Head+ • 12+ years exp • In office (McLean, United States) • PhD • Full-Time • Architect
Python
TypeScript
Databases
Neo4j
OpenSearch
AI/ML
Copilot
LangGraph
AutoGen
Model Context Protocol
AI Agents
LangSmith
AWS Bedrock
LLM
RAG
OpenAI
Anthropic
GraphRAG
Knowledge Graph
LLM Evaluation
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
LangChain
DevOps
Azure
AWS
SLI/SLO/SLA
Amazon S3
+18
Apply

NTT DATA

nttdata.com
nttdata.com • HQ: Tokyo, Japan • Data Centers & Colocation • Managed IT Services (MSP) • Financial Software & Embedded Finance • IT Consulting & Digital Transformation • Systems Integrators • 5000+ employees • Est. 1988 • Trust B • Hiring 1537, 433 new
HQ: Tokyo, Japan • Data Centers & Colocation • Managed IT Services (MSP) • Financial Software & Embedded Finance • IT Consulting & Digital Transformation • Systems Integrators • 5000+ employees • Est. 1988 • Trust B • Hiring 1537, 433 new
NTT DATA is a Tokyo system integrator founded in 1988 that spun out of the data communications arm of NTT. It is one of the largest information technology services firms in the world, building banking, public sector and payment systems and operating global consulting and managed services. The company runs the CAFIS payment network used across Japanese retail and banking.
Abhijit Dubey · 代表取締役社長 · decision-maker
No careers mailbox known
Verified live · 1 hour ago 2 days ago Likely open · 63%

AI Engineer

Middle • 3+ years exp • Sibiu • Remote (Romania) • Bachelor's Degree • Full-Time • Middle
Python
SQL
Databases
Weaviate
Chroma
pgvector
Pinecone
PostgreSQL
AI/ML
LangGraph
LangChain
LlamaIndex
Fine-tuning
Embeddings
Scikit-learn
JAX
Prompt Engineering
Function Calling
Chain-of-Thought
AI Agents
TensorFlow
PyTorch
LLM
RAG
Google ADK
Tokenization
Human-in-the-Loop
LLM Guardrails
Multi-Agent Systems
Tool Use
Vertex AI
Gemini
Semantic Search
Semantic Search
LLM Evaluation
DevOps
Rest API
gRPC
GCP
Azure
CI/CD
Git
AWS
OpenTelemetry
Datadog
Prometheus
Grafana
Management
Gmail
WhatsApp
+38
Apply

Bernard

bernard.io
bernard.io • HQ: New York, United States • Field Service Management Software • AI Agents • Likely startup • Hiring 6, 2 new
HQ: New York, United States • Field Service Management Software • AI Agents • Likely startup • Hiring 6, 2 new
Bernard is an AI company that fixes first-visit failures in appliance repair by answering service calls, running diagnostics and predicting the right parts against live inventory. Its system sends technicians out with a plan and is live with enterprise customers, and the company hires voice agent platform engineers, machine learning platform engineers, account executives and client success managers. The company is headquartered in New York, United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 2 days ago Hiring now · 90%

AI Engineer, Software Factory

≈ $144k – $315k per year (Estimated) • In office (New York, United States) • Full-Time
Python
TypeScript
JavaScript
Node JS
Node JS
Fastify
Databases
PostgreSQL
Supabase
Neo4j
AI/ML
LLM Evaluation
LLM Guardrails
Frontend
Next.js
React.js
DevOps
Grafana
GitHub
Management
Slack
+7
Apply

Capstan Medical

capstanmedical.com
capstanmedical.com • HQ: Santa Cruz, United States • Cardiovascular Devices • Medical & Healthcare Robotics • Est. 2019 • Startup • Trust C • Hiring 21, 1 new
HQ: Santa Cruz, United States • Cardiovascular Devices • Medical & Healthcare Robotics • Est. 2019 • Startup • Trust C • Hiring 21, 1 new
Capstan Medical develops robotically delivered heart valve implants for minimally invasive structural heart repair. Its system combines a miniature robot with steerable catheters and imaging, and open roles are in manufacturing, robot productization and supplier development engineering. The company is headquartered in Santa Cruz, California, United States.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 2 days ago Likely open · 60%

Senior Machine Learning Engineer, Perception and Controls

≈ $161k – $308k per year (Estimated) • Senior • 4+ years exp • Hybrid (Menlo Park, United States) • Master's Degree • Full-Time • Senior
Python
C++
C++
PyTorch C++
AI/ML
Computer Vision
PyTorch
Synthetic Data
LLM Evaluation
Machine Learning
ONNX
TensorRT
Ray
Edge AI
Robotics
Localization
ROS
ROS2
Sensor Fusion
+8
Apply

Micron Technology

micron.com
micron.com • HQ: Boise, United States • Enterprise Storage Systems • Semiconductor Manufacturing • Memory & Storage Chips • 5000+ employees • Est. 1978 • NASDAQ: MU • Trust B • Hiring 2797, 152 new
HQ: Boise, United States • Enterprise Storage Systems • Semiconductor Manufacturing • Memory & Storage Chips • 5000+ employees • Est. 1978 • NASDAQ: MU • Trust B • Hiring 2797, 152 new
Micron Technology is an American semiconductor company founded in Boise, Idaho in 1978 and one of only a handful of manufacturers of both DRAM and NAND flash memory. It designs and fabricates memory and storage products used in data centres, personal computers, smartphones, cars and industrial equipment, and sells them under the Micron and consumer-facing Crucial brands. High-bandwidth memory for AI accelerators has become the fastest-growing part of the business, and the company operates fabrication and assembly sites across the United States and Asia.
Mark Murphy · Executive Vice President & Chief Financial Officer · decision-maker
Sanjay Mehrotra · Chairman, President & Chief Executive Officer · decision-maker
Joe Parkinson · Co-Founder & former Chief Executive Officer · founder
Ward Parkinson · Co-Founder · founder
Careers mailbox is known
Verified live · 6 hours ago Visa sponsor 2 days ago Hiring now · 70%

Member of Technical Staff, Agentic AI Architect

≈ $170k – $347k per year (Estimated) • Staff+ • 8+ years exp • In office (Boise, United States) • Bachelor's Degree • Full-Time • Architect
Rust
TypeScript
AI/ML
Model Context Protocol
Function Calling
AI Agents
LangSmith
PyTorch
LLM
A2A
LLM Evaluation
Multi-Agent Systems
Tool Use
LangGraph
LangChain
vLLM
Embeddings
Scikit-learn
Prompt Engineering
Computer Vision
Chain-of-Thought
TensorRT
TensorRT-LLM
TensorFlow
CrewAI
RAG
Machine Learning
DevOps
OpenTelemetry
CI/CD
Kubernetes
+21
Apply

Thrive Managed Services

thrivenextgen.com
thrivenextgen.com • HQ: Foxborough, United States • Information Technology • Cloud Consulting & Migration • Managed Security • Managed IT Services (MSP) • 201-500 employees • Est. 2000 • Trust A • Hiring 32, 11 new
HQ: Foxborough, United States • Information Technology • Cloud Consulting & Migration • Managed Security • Managed IT Services (MSP) • 201-500 employees • Est. 2000 • Trust A • Hiring 32, 11 new
Thrive is a Massachusetts managed services provider that delivers cybersecurity, cloud and IT support. It serves mid-market clients across the United States and United Kingdom. The company has expanded through many regional acquisitions.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 2 days ago Hiring now · 90%

AI/Automation Analyst

≈ $77k – $172k per year (Estimated) • Remote (United States) • Full-Time
Python
JavaScript
SQL
AI/ML
AI Agents
LLM
LLM Guardrails
Embeddings
Function Calling
RAG
Structured Outputs
LLM Evaluation
Analytics
ETL/ELT
Management
n8n
Zapier
+6
Apply

Sherwin-Williams Company

sherwin-williams.com
sherwin-williams.com • HQ: Cleveland, United States • Tools & DIY Supplies • Chemical Manufacturing • 5000+ employees • Est. 1866 • NYSE: SHW • Trust A • Hiring 1231, 289 new
HQ: Cleveland, United States • Tools & DIY Supplies • Chemical Manufacturing • 5000+ employees • Est. 1866 • NYSE: SHW • Trust A • Hiring 1231, 289 new
Headquartered in Cleveland, Ohio, The Sherwin-Williams Company is a global enterprise specializing in the development, manufacture, distribution, and sale of paints, coatings, stains, and related supplies. Operating through three core business segments - the Paint Stores Group, Consumer Brands Group, and Performance Coatings Group - the company serves professional painting contractors, industrial manufacturers, commercial maintenance operators, and retail consumers. Supported by a network of over 5,000 company-operated stores and branches alongside wholesale and retail distribution channels across 120+ countries, it provides architectural finishes, protective and marine coatings, automotive refinishes, and custom OEM product treatments worldwide.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 2 days ago Hiring now · 89%

Principal Practice Enterprise Architect AI

≈ $109k – $202k per year (Estimated) • Lead • 18+ years exp • Cleveland • Remote (United States) • Bachelor's Degree • Confidential • Architect
AI Agents
LLM
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Machine Learning
Apply

American Express

americanexpress.com
americanexpress.com • HQ: New York, United States • Commercial & Retail Banks • Payment Processing & Gateways • Cards & Card Issuing • 5000+ employees • Est. 1850 • Trust A • Hiring 390, 102 new
HQ: New York, United States • Commercial & Retail Banks • Payment Processing & Gateways • Cards & Card Issuing • 5000+ employees • Est. 1850 • Trust A • Hiring 390, 102 new
American Express is a New York financial services company founded in 1850 as an express freight business that became a payments network and card issuer. Unlike the four-party networks it competes with, it issues most of its own cards and operates its own network, which lets it earn merchant discount revenue as well as interest and annual fees, and supports a premium rewards proposition built on travel and lounge access. Its business spans consumer and small business cards, corporate payments, merchant acquiring and travel services, and it is a component of the Dow Jones Industrial Average.
Stephen Squeri · Chairman and Chief Executive Officer · decision-maker
William Fargo · Co-founder · founder
Henry Wells · Co-founder · founder
Careers mailbox is known
Verified live · 2 hours ago 2 days ago Hiring now · 85%

Senior Agentic AI Engineer - Core Platforms

≈ $148k – $283k per year (Estimated) • Senior • 5+ years exp • In office (New York, United States) • Bachelor's Degree • Senior
Python
Java
C++
AI/ML
Hadoop
Spark
Prompt Engineering
Multimodal AI
AI Agents
Transformers
LLM
RAG
BERT
Human-in-the-Loop
LLM Evaluation
Machine Learning
DevOps
CI/CD
+8
Apply
Verified live · 2 hours ago 24 days ago Long shot · 18%

Sr AI Engineer II - Global Commercial Services Technology

≈ $130k – $248k per year (Estimated) • Senior • In office (Raleigh, United States) • Senior
Go
TypeScript
JavaScript
Databases
Apache Kafka
AI/ML
Embeddings
Function Calling
AI Agents
LLM
RAG
LLM Evaluation
LLM Guardrails
Tool Use
Vercel AI SDK
Frontend
tRPC
DevOps
gRPC
Datadog
AWS
Amazon EKS
AWS Lambda
Kubernetes
+12
Apply
Verified live · 2 hours ago 24 days ago Long shot · 18%

Sr AI Engineer I - Global Commercial Services

≈ $130k – $248k per year (Estimated) • Senior • In office (Raleigh, United States) • Senior
Go
TypeScript
JavaScript
Databases
Apache Kafka
AI/ML
Embeddings
Function Calling
AI Agents
LLM
RAG
LLM Evaluation
LLM Guardrails
Tool Use
Vercel AI SDK
Frontend
tRPC
DevOps
gRPC
Datadog
AWS
Amazon EKS
AWS Lambda
Kubernetes
+12
Apply
jnj.com • HQ: New Brunswick, United States • Orthopedic & Spine Implants • Surgical Instruments & Devices • Prescription Drugs • 5000+ employees • Est. 1886 • Hiring 348, 262 new
HQ: New Brunswick, United States • Orthopedic & Spine Implants • Surgical Instruments & Devices • Prescription Drugs • 5000+ employees • Est. 1886 • Hiring 348, 262 new
Johnson & Johnson is a global healthcare company headquartered in New Brunswick, New Jersey, working across Innovative Medicine, its pharmaceutical business, and MedTech, which covers orthopaedics, surgery, cardiovascular, vision and robotics. Founded in 1886 and listed on the NYSE, it operates research, manufacturing and commercial sites worldwide, including Raritan, West Chester, Cork, Leiden, Zug, Norderstedt, Madrid and Shanghai, and the Ottava soft-tissue surgical robotics program in Cincinnati. Its openings span production operators, supply chain and transport leads, quality, tax and HR managers, data transformation, digital product and scientific roles.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 3 days ago Hiring now · 90%

Manager, GenAI AWS Platform Engineering

≈ $128k – $248k per year (Estimated) • Senior • 8+ years exp • Hybrid (Raritan, United States) • Bachelor's Degree • Full-Time • Staff
DynamoDB
AI/ML
Model Context Protocol
AI Agents
AWS Bedrock
Ray
AWS Bedrock AgentCore
LLM Evaluation
LLM Guardrails
Machine Learning
DevOps
Terraform
AWS CDK
Azure
CI/CD
AWS
Blue-Green Deployment
Platform Engineering
Amazon EKS
AWS Lambda
Amazon S3
IAM
Amazon ECS
Amazon CloudWatch
AWS Step Functions
API Gateway
GitOps
Kubernetes
FinOps
Cybersecurity
Least Privilege
Analytics
AWS Glue
+21
Apply

HCLTech

hcltech.com
hcltech.com • HQ: Noida, India • Systems Integrators • IT Consulting & Digital Transformation • IT Outsourcing & Dedicated Teams • 5000+ employees • Est. 1976 • Hiring 2302, 847 new
HQ: Noida, India • Systems Integrators • IT Consulting & Digital Transformation • IT Outsourcing & Dedicated Teams • 5000+ employees • Est. 1976 • Hiring 2302, 847 new
HCLTech is a major Indian multinational information technology (IT) services and consulting company headquartered in Noida, Uttar Pradesh. Spun off from the original HCL Group in 1991, it ranks as one of India's largest technology companies alongside firms like TCS, Infosys, and Wipro.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 3 days ago Hiring now · 99%

Senior Data Scientist

≈ $21k – $43k per year (Estimated) • Senior • In office (Pune, India) • Senior
Python
AI/ML
Function Calling
AI Agents
Arize Phoenix
Langfuse
LangSmith
LLM
RAG
LLM Evaluation
Multi-Agent Systems
Tool Use
DevOps
OpenTelemetry
Prometheus
CI/CD
Grafana
+7
Apply
Verified live · 2 hours ago 8 days ago Hiring now · 92%

AI Solution Architect I

≈ $28k – $49k per year (Estimated) • Staff+ • 5+ years exp • In office (Noida, India) • Bachelor's Degree • Architect
Copilot
Cursor
AutoGen
Weights & Biases
LangChain
LlamaIndex
LoRA
MLFlow
Fine-tuning
RLHF
Prompt Engineering
Multimodal AI
Function Calling
Chain-of-Thought
AI Agents
PEFT
Semantic Kernel
CrewAI
LLM
RAG
OpenAI
LLMOps
Google AI Studio
Human-in-the-Loop
Knowledge Graph
LLM Evaluation
LLM Guardrails
Edge AI
EU AI Act
NIST AI RMF
Agentic Workflows
Multi-Agent Systems
Tool Use
Transformers
DevOps
Azure
Cybersecurity
GDPR
+28
Apply
Verified live · 2 hours ago 16 days ago Likely open · 59%

Technical lead - JavaScript, React.js, Java

Lead • In office • Staff
Python
Java
Node JS
JavaScript
Databases
Apache Kafka
AI/ML
Claude Code
Model Context Protocol
AI Agents
LLM
Human-in-the-Loop
Context Engineering
LLM Evaluation
LLM Guardrails
Prompt Caching
Agentic Workflows
Frontend
React.js
GraphQL
DevOps
Rest API
New Relic
CI/CD
AWS
IAM
gRPC
QA
Playwright
Pact
+17
Apply

Nike

nike.com
nike.com • HQ: Beaverton, United States • Sporting Goods • Footwear • Sportswear & Activewear • 5000+ employees • Est. 1964 • NYSE: NKE • Trust A • Hiring 433, 107 new
HQ: Beaverton, United States • Sporting Goods • Footwear • Sportswear & Activewear • 5000+ employees • Est. 1964 • NYSE: NKE • Trust A • Hiring 433, 107 new
Nike is an American sportswear company founded in 1964 as Blue Ribbon Sports by Phil Knight and Bill Bowerman that designs and markets athletic footwear, apparel, equipment and accessories. Its brands include Nike, Jordan and Converse, sold through its own stores and apps, wholesale partners and factory outlets in Europe, North America and Asia, with manufacturing outsourced to contract factories. The company is headquartered in Beaverton, Oregon, United States.
No named decision-maker yet.
Careers mailbox is known
Verified live · 6 hours ago Visa sponsor 3 days ago Hiring now · 87%

Machine Learning Engineer I

≈ $103k – $238k per year (Estimated) • Junior • 1+ year exp • Beaverton • Remote (United States) • Bachelor's Degree • Full-Time • Junior
Python
Python
FastAPI
Databases
Databricks
AI/ML
Spark
Function Calling
TensorFlow
PyTorch
LLM
RAG
Amazon SageMaker
LLM Evaluation
Machine Learning
DevOps
CI/CD
AWS
Docker
Kubernetes
Analytics
A/B Testing
Management
Agile
+10
Apply

QXO

qxo.com
qxo.com • HQ: Greenwich, United States • Building Materials • Wholesale • 5000+ employees • Hiring 199, 199 new
HQ: Greenwich, United States • Building Materials • Wholesale • 5000+ employees • Hiring 199, 199 new
QXO is a publicly traded distributor and installer of building products headquartered in Greenwich, Connecticut, supplying roofing, siding, waterproofing, insulation, lumber and other building materials to contractors and homebuilders. Led by chairman and CEO Brad Jacobs, it has grown through acquisitions to about 28,000 employees and 1,150 locations across all 50 US states and Canadian provinces, and describes itself as the largest distributor and installer of insulation in North America. It hires CDL drivers, warehouse associates, branch and assistant branch managers, dispatchers, software and security engineers, and branch operations interns.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 2 hours ago 3 days ago Hiring now · 90%

Senior Software Engineer

$138k – $235k per year • Senior • 5+ years exp • In office (Seattle, United States) • Bachelor's Degree • Senior
Computer Vision
AI Agents
LLM
LLM Evaluation
LLM Guardrails
Machine Learning
Time Series Forecasting
Apply
Top 25% payVerified live · 2 hours ago 3 days ago Hiring now · 90%

Staff Software Engineer

$160k – $288k per year • Staff+ • 8+ years exp • In office (Seattle, United States) • Bachelor's Degree • Staff
Computer Vision
AI Agents
LLM
LLM Evaluation
LLM Guardrails
Machine Learning
Time Series Forecasting
Apply

MetLife Legal Plans

legalplans.com
legalplans.com • HQ: Cleveland, United States • Health Insurance & Benefits • Legal Services • 5000+ employees • Est. 1977 • Hiring 4, 2 new
HQ: Cleveland, United States • Health Insurance & Benefits • Legal Services • 5000+ employees • Est. 1977 • Hiring 4, 2 new
MetLife Legal Plans is a provider of legal voluntary benefits that gives plan members access to a network of more than 18,000 attorneys through their employers. It serves nearly 7 million families and more than 200 Fortune 500 companies and hires attorney network managers, legal operations leaders, data analytics engineers and IT support engineers. The company is headquartered in Cleveland, Ohio, United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 3 days ago Hiring now · 90%

Senior Software Engineer

$130k – $160k per year • Senior • 5+ years exp • Remote (United States) • Bachelor's Degree • Full-Time • Senior
Python
JavaScript
Python
Django
Databases
PostgreSQL
AI/ML
Copilot
Model Context Protocol
LLM Evaluation
Frontend
React.js
Material UI
Sass
DevOps
AWS
Docker
Linux
Management
Agile
Scrum
+7
Apply

LatentBridge

latentbridge.com
latentbridge.com • HQ: Pune, India • AI Consulting & Integration • Hiring 24, 9 new
HQ: Pune, India • AI Consulting & Integration • Hiring 24, 9 new
LatentBridge is a full-stack global AI innovation partner. We build and deploy production-ready, governance-first AI for enterprises operating in complex, regulated and high-stakes environments across banking, financial services, manufacturing and beyond.
No named decision-maker yet.
Careers mailbox is known
3 days ago Hiring now · 90%

Senior AI Engineer - ( MCP & LLM Integration)

≈ $109k – $242k per year (Estimated) • Senior • 6+ years exp • Remote (likely United States) • Full-Time • Senior
Python
Python
FastAPI
Asyncio
Pydantic
AI/ML
Claude
Model Context Protocol
Prompt Engineering
Function Calling
AI Agents
LangSmith
LLM
OpenAI
Anthropic
LLM Evaluation
Prompt Caching
Agentic Workflows
Tool Use
LangGraph
AutoGen
LangChain
Semantic Kernel
DevOps
OpenTelemetry
Azure
CI/CD
Cybersecurity
Zero Trust
QA
Pytest
+18
Apply

Embrace Software Inc.

embracesoftwareinc.com
embracesoftwareinc.com • HQ: Tampa, United States • 51-200 employees • Est. 2020 • Startup • Hiring 15, 15 new
HQ: Tampa, United States • 51-200 employees • Est. 2020 • Startup • Hiring 15, 15 new
We Buy & Build World-Class Software Businesses 17 Acquisitions 10 Verticals Served Contact Us Who We Are SOME OF OUR BUSINESSES Our Operations Span Across Various Industry Sectors.
Hj Zhu · Executive Officer · decision-maker
Mohan Plakkot · Executive Officer, Director · decision-maker
Singh Manpreet · Director
Savneet Singh · Director
No careers mailbox known
Verified live · 1 hour ago 3 days ago Hiring now · 90%

Senior QA Engineer

≈ $69k – $166k per year (Estimated) • Senior • 5+ years exp • Remote (likely United States) • Bachelor's Degree • Full-Time • Senior
Python
JavaScript
TypeScript
AI/ML
Copilot
Cursor
Claude Code
Model Context Protocol
AI Agents
DeepEval
Langfuse
LangSmith
Promptfoo
Ragas
LLM
Hallucination
LLM Evaluation
LLM Guardrails
DevOps
CI/CD
Git
Self-Healing
Cybersecurity
OWASP ZAP
OWASP Top 10
HIPAA
Management
Agile
QA
Selenium
JMeter
Cypress
Playwright
Pact
k6
Locust
+23
Apply

Grafana Labs

grafana.com
grafana.com • HQ: New York, United States • Log Management & Analytics • BI & Dashboard Software • Observability & APM • 1001-5000 employees • Est. 2014 • Trust A • Hiring 106, 10 new
HQ: New York, United States • Log Management & Analytics • BI & Dashboard Software • Observability & APM • 1001-5000 employees • Est. 2014 • Trust A • Hiring 106, 10 new
Grafana Labs is the company behind Grafana, the open source dashboard and visualisation tool that has become the default front end for infrastructure and application monitoring. Founded in 2014 around a project originally forked from Kibana, it has built a full observability stack alongside the dashboards, including Loki for logs, Tempo for traces, Mimir for long-term metrics storage and Pyroscope for continuous profiling, all released under open source licences. Revenue comes from a hosted cloud service and from enterprise subscriptions, and the company operates as a remote-first organisation with staff spread across dozens of countries.
Anthony Woods · Co-founder · decision-maker
Raj Dutt · Co-founder and Chief Executive Officer · decision-maker
Torkel Odegaard · Co-founder and Chief Technology Officer · decision-maker
Wailun Chan · Executive Officer · decision-maker
Careers mailbox is known
Verified live · 2 hours ago 3 days ago Hiring now · 90%

Senior Backend Engineer - Databases Tempo | US | Remote

≈ $176k – $306k per year (Estimated) • Equity • Senior • United States • Remote (United States) • Senior
Go
Rust
C++
SQL
AI/ML
LLM
OpenAI
Anthropic
LLM Guardrails
LLM Evaluation
DevOps
Grafana
Loki
OpenTelemetry
Prometheus
Kubernetes
+6
Apply
Verified live · 2 hours ago 3 days ago Hiring now · 90%

Senior Backend Engineer - Databases Tempo | Canada | Remote

≈ $106k – $192k per year (Estimated) • Equity • Senior • Canada • Remote (Canada) • Senior
Go
Rust
C++
SQL
AI/ML
LLM
OpenAI
Anthropic
LLM Guardrails
LLM Evaluation
DevOps
Grafana
Loki
OpenTelemetry
Prometheus
Kubernetes
+6
Apply

Roche

roche.com
roche.com • HQ: Basel, Switzerland • Biologics & Biosimilars • Oncology Therapeutics • Diagnostic Tests & IVD • Prescription Drugs • 5000+ employees • Est. 1896 • Trust A • Hiring 1032, 99 new
HQ: Basel, Switzerland • Biologics & Biosimilars • Oncology Therapeutics • Diagnostic Tests & IVD • Prescription Drugs • 5000+ employees • Est. 1896 • Trust A • Hiring 1032, 99 new
Roche is a Swiss healthcare group founded in Basel in 1896 and is unusual in operating two large divisions of comparable importance: prescription medicines and in vitro diagnostics. The pharmaceutical business is built on oncology, neurology, immunology, ophthalmology and haemophilia, with products such as Ocrevus, Hemlibra, Perjeta and Vabysmo, while the diagnostics division supplies laboratory analysers, molecular tests and sequencing systems to hospitals worldwide. The group owns the American biotechnology company Genentech outright and the Japanese firm Chugai in majority, is controlled by a family shareholder pool, and spends among the largest research budgets in the industry.
Teresa Graham · Chief Executive Officer, Roche Pharmaceuticals · decision-maker
Thomas Schinecker · Chief Executive Officer · decision-maker
Fritz Hoffmann-La Roche · Founder · founder
Careers mailbox is known
Verified live · 6 hours ago 3 days ago Likely open · 60%

AI Engineer

≈ $94k – $219k per year (Estimated) • In office (Basel, Switzerland) • Relocation • Bachelor's Degree • Full-Time
Python
SQL
AI/ML
LangGraph
LangChain
Embeddings
Prompt Engineering
Multimodal AI
Function Calling
Computer Vision
AI Agents
LLM
RAG
Hallucination
Time Series Forecasting
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
Machine Learning
DevOps
CI/CD
AWS
Docker
Platform Engineering
+16
Apply
Verified live · 6 hours ago 25 days ago Long shot · 21%

Senior Data Scientist - Generative AI & Agentic Systems

≈ $38k – $97k per year (Estimated) • Senior • 7+ years exp • In office (San José, Costa Rica) • Relocation • Bachelor's Degree • Full-Time • Senior
Python
SQL
JavaScript
TypeScript
AI/ML
LangGraph
LangChain
LlamaIndex
Model Context Protocol
Multimodal AI
AI Agents
RAG
Reranking
LLMOps
AWS Bedrock AgentCore
A2A
LLM Evaluation
Agentic Workflows
Frontend
Angular
React.js
DevOps
CI/CD
AWS
Design
Figma
+14
Apply
Verified live · 6 hours ago 1 month ago Long shot · 9%

Data Scientist

≈ $58k – $103k per year (Estimated) • Hybrid (Warsaw, Poland) • Full-Time
Python
AI/ML
Fine-tuning
Embeddings
AI Agents
NLP
LLM
RAG
Hallucination
LLMOps
LLM Evaluation
LLM Guardrails
Agentic Workflows
DevOps
Azure
CI/CD
AWS
+7
Apply

Bagel Labs

bagel.com
bagel.com • Food & Beverages • AI Research Labs • Bakery & Pastry • Hiring 2, 2 new
Food & Beverages • AI Research Labs • Bakery & Pastry • Hiring 2, 2 new
Bagel Labs is a physical AI research lab developing world models and world action models for robot learning and control.
No named decision-maker yet.
No careers mailbox known
≈ $177k – $361k per year (Estimated) • Staff+ • In office (United States, Canada, Mexico) • Staff
Diffusion Models
LLM Evaluation
World Models
Physical AI
Apply

SaaS Labs

saaslabs.co
saaslabs.co • Bengaluru • Noida • Consumer & Utility Software • Custom Software Development • 51-200 employees • Est. 2016 • Hiring 19, 18 new
Bengaluru • Noida • Consumer & Utility Software • Custom Software Development • 51-200 employees • Est. 2016 • Hiring 19, 18 new
SaaS Labs builds, acquires and invests in products that revolve around business process automation & productivity. Products include a call tracking software, phone system for sales/support and a marketing tool.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 3 days ago Hiring now · 90%

Staff/Principal Engineer

≈ $25k – $58k per year (Estimated) • Lead • In office (Bengaluru, India) • Full-Time • Principal
JavaScript
PHP
Databases
MySQL
AI/ML
Function Calling
Speech Recognition
LLM
RAG
Hallucination
Text-to-Speech
LLM Evaluation
LLM Guardrails
Voice Agents
Tool Use
DevOps
CI/CD
+6
Apply

Apple

apple.com
apple.com • HQ: Cupertino, United States • Smartwatches & Fitness Trackers • Operating Systems • Tablets • Laptops • Smartphones • 5000+ employees • Est. 1976 • Trust B • Hiring 3246, 311 new
HQ: Cupertino, United States • Smartwatches & Fitness Trackers • Operating Systems • Tablets • Laptops • Smartphones • 5000+ employees • Est. 1976 • Trust B • Hiring 3246, 311 new
Apple is an American multinational technology company founded in 1976 by Steve Jobs, Steve Wozniak and Ronald Wayne, and headquartered in Cupertino, California. It designs and sells consumer hardware including the iPhone, Mac, iPad, Apple Watch, AirPods and Vision Pro, together with the operating systems and silicon that run them. A growing services division built around the App Store, iCloud, Apple Music, Apple TV+ and Apple Pay now contributes a large share of profit, making Apple one of the most valuable companies in the world.
Sabih Khan · Chief Operating Officer · decision-maker
Kevan Parekh · Chief Financial Officer · decision-maker
Tim Cook · Chief Executive Officer · decision-maker
Steve Wozniak · Co-Founder · founder
No careers mailbox known
Verified live · 3 hours ago Visa sponsor 3 days ago Hiring now · 70%

Security Platform Automation Engineer

≈ $204k – $395k per year (Estimated) • Senior • 8+ years exp • In office (Seattle, United States) • Bachelor's Degree • Staff
Python
Go
Java
AI/ML
AI Agents
LLM
LLM Evaluation
Agentic Workflows
Human-in-the-Loop
DevOps
AWS
AWS Lambda
Amazon EC2
Amazon S3
AWS Step Functions
Cybersecurity
Threat Modeling
SBOM
+7
Apply
Verified live · 3 hours ago Visa sponsor 3 days ago Hiring now · 70%

Senior Software Engineer - Security

≈ $232k – $424k per year (Estimated) • Senior • 10+ years exp • In office (Seattle, United States) • Bachelor's Degree • Senior
Python
Java
Bash
AI/ML
Prompt Engineering
AI Agents
LLM
LLM Evaluation
LLM Guardrails
DevOps
CI/CD
Linux
gRPC
Cybersecurity
Threat Modeling
+4
Apply
Verified live · 3 hours ago Visa sponsor 4 days ago Hiring now · 70%

Forward Deployed Engineer

≈ $213k – $419k per year (Estimated) • Senior • 8+ years exp • In office (Cupertino, United States) • Bachelor's Degree • Staff
Python
JavaScript
SQL
Node JS
Node JS
Express
Databases
PostgreSQL
Snowflake
AI/ML
Claude Code
LLM
AI Agents
Langfuse
LLM Evaluation
Frontend
GraphQL
React.js
DevOps
Rest API
PagerDuty
Docker
Kubernetes
+10
Apply
Machines can read this selection · checked 07:33 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.