LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

BASF

basf.com
basf.com • HQ: Ludwigshafen, Germany • Advanced Materials • Crop Protection • Chemical Manufacturing • 1001-5000 employees • Est. 1865 • Hiring 354, 95 new
HQ: Ludwigshafen, Germany • Advanced Materials • Crop Protection • Chemical Manufacturing • 1001-5000 employees • Est. 1865 • Hiring 354, 95 new
BASF is a German chemical company headquartered in Ludwigshafen, producing chemicals, materials, industrial solutions, nutrition and care ingredients, and agricultural products such as crop protection and vegetable seeds. Founded in 1865 as Badische Anilin- und Soda-Fabrik, it is the largest chemical producer in the world; the site for this record resolves to BASF in the Netherlands, which has about 1,000 employees and its Benelux head office in Arnhem. Its global board lists SAP consultants and developers, AI platform and data engineers, finance and order-to-cash analysts, procurement and customs specialists, chemists, and interns in digitalisation and EHS.
No named decision-maker yet.
No careers mailbox known
Verified live · 9 hours ago 12 days ago Fading · 27%

AI Platform Engineer (m/f/d)

Middle • 4+ years exp • In office (Madrid, Spain) • Relocation • Bachelor's Degree • Middle
Python
TypeScript
Python
FastAPI
Pydantic
Databases
PostgreSQL
Databricks
RabbitMQ
AI/ML
Copilot
LangGraph
Model Context Protocol
AI Agents
Mistral
LLM
RAG
Hallucination
OpenAI
Anthropic
LLMOps
A2A
Human-in-the-Loop
Structured Outputs
Context Engineering
Knowledge Graph
LLM Evaluation
LLM Guardrails
EU AI Act
Multi-Agent Systems
LangChain
MLFlow
DevOps
Terraform
GitHub Actions
OpenTelemetry
Azure
CI/CD
Git
Docker
Kubernetes
Grafana
Azure AKS
FinOps
Cybersecurity
Microsoft Entra ID
OWASP
Management
Agile
+35
Apply

Freterium

freterium.ai
freterium.ai • HQ: Casablanca, Morocco • Road Transport • Supply Chain & Logistics Software • 11-50 employees • Est. 2019 • Startup • Hiring 1
HQ: Casablanca, Morocco • Road Transport • Supply Chain & Logistics Software • 11-50 employees • Est. 2019 • Startup • Hiring 1
Freterium is a Moroccan logistics technology company founded in 2019 and headquartered in Casablanca. Its platform plans and tracks road freight operations. The software is used by shippers and carriers across Africa.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 13 days ago Long shot · 19%

Senior Backend Engineer (Remote)

≈ $88k – $260k per year (Estimated) • Senior • 5+ years exp • Casablanca • Remote (Morocco) • Senior
PHP
SQL
PHP
Symfony
Doctrine
Databases
MySQL
AI/ML
LLM Evaluation
Apply
Report

Atlassian

atlassian.com
atlassian.com • HQ: Sydney, Australia • IT Service & Asset Management • Intranet & Knowledge Management • Developer Tools • Project & Work Management Software • 1001-5000 employees • Est. 2002 • NASDAQ: TEAM • Trust A • Hiring 333, 42 new
HQ: Sydney, Australia • IT Service & Asset Management • Intranet & Knowledge Management • Developer Tools • Project & Work Management Software • 1001-5000 employees • Est. 2002 • NASDAQ: TEAM • Trust A • Hiring 333, 42 new
Atlassian is an Australian software company founded in Sydney in 2002 by Mike Cannon-Brookes and Scott Farquhar, who funded it on credit cards and grew it for years without a traditional sales force. Its products became the default coordination layer for software teams: Jira for issue and project tracking, Confluence for documentation, Bitbucket for source control and Jira Service Management for IT support. Listed on Nasdaq since 2015, the company has expanded into video messaging with Loom and agentic AI through Rovo, and derives almost all of its revenue from cloud subscriptions after retiring its self-hosted server products.
Scott Farquhar · Co-Founder · decision-maker
Mike Cannon-Brookes · Co-Founder & Chief Executive Officer · decision-maker
Joe Binz · Chief Financial Officer · decision-maker
Careers mailbox is known
Verified live · 2 hours ago 13 days ago Fading · 34%

Senior Principal Technical Program Manager - Agent Infrastructure

≈ $194k – $341k per year (Estimated) • Lead • 12+ years exp • Seattle • Remote (United States) • Principal
Embeddings
AI Agents
LLM
RAG
LLM Guardrails
Model Context Protocol
LLM Evaluation
EU AI Act
Frontend
GraphQL
DevOps
Rest API
gRPC
GCP
Azure
AWS
Cybersecurity
GDPR
FedRAMP
+8
Apply
Verified live · 2 hours ago 13 days ago Fading · 27%

Senior Machine Learning System Engineer

≈ $168k – $304k per year (Estimated) • Senior • Seattle • San Francisco • Austin • New York • Remote (United States) • Senior
AI Agents
PyTorch
RAG
Reranking
Semantic Search
Triton
Semantic Search
LLM Evaluation
Machine Learning
DevOps
Platform Engineering
FinOps
SLI/SLO/SLA
Management
Confluence
Jira
+6
Apply

Chamelio

chamelio.ai
chamelio.ai • HQ: Tel Aviv, Israel • Legal Software • Legal AI • 51-200 employees • Startup • Hiring 7, 1 new
HQ: Tel Aviv, Israel • Legal Software • Legal AI • 51-200 employees • Startup • Hiring 7, 1 new
AI-powered Legal Intelligence platform for in-house teams. Automate contract review, negotiation, and workflows. Reduce review time by 89%.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 13 days ago Hiring now · 83%

Head of Product

≈ $122k – $297k per year (Estimated) • Head+ • 8+ years exp • In office (Tel Aviv, Israel) • Full-Time • Architect
Cursor
Claude
Claude Code
RAG
LLM Evaluation
Agentic Workflows
Mobile
AppsFlyer SDK
Apply

Payroll Integrations

payrollintegrations.com
payrollintegrations.com • Carlsbad • Payroll Services • HR & Payroll Software • Est. 2016 • Hiring 2
Carlsbad • Payroll Services • HR & Payroll Software • Est. 2016 • Hiring 2
Discover Payroll Integrations: Streamlining payroll and benefits management with our innovative, secure API integration platform.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 13 days ago Likely open · 67%

Staff Software Engineer (AI Native Development)

$180k per year • Staff+ • 10+ years exp • Marietta • Remote (United States, ET hours) • Staff
TypeScript
Node JS
JavaScript
Databases
PostgreSQL
AI/ML
Function Calling
AI Agents
Context Engineering
LLM Guardrails
Agentic Workflows
Tool Use
Model Context Protocol
LLM Evaluation
Frontend
Angular
Mobile
Clean Architecture
DevOps
CI/CD
AWS
Management
Confluence
Jira
+10
Apply

Peraton

peraton.com
peraton.com • HQ: Reston, United States • Systems Integrators • Information Security • Homeland Security • National Security • 1001-5000 employees • Est. 2017 • Trust A • Hiring 939, 117 new
HQ: Reston, United States • Systems Integrators • Information Security • Homeland Security • National Security • 1001-5000 employees • Est. 2017 • Trust A • Hiring 939, 117 new
Peraton is an American national security and technology company that provides systems engineering, IT modernisation, cyber, space and communications services to defense, intelligence, homeland security, civil and health agencies of the US government. Formed in 2017 by Veritas Capital and enlarged in 2021 through the acquisitions of the federal IT and mission support business of Northrop Grumman and of Perspecta, it employs tens of thousands of people across the United States. The company is headquartered in Reston, Virginia, United States.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 1 hour ago 14 days ago Fading · 38%

Senior Full Stack Engineer — Agentic & External Integrations

$146k – $234k per year • Senior • 8+ years exp • In office (Reston, United States) • High School Diploma • Senior
Python
Python
FastAPI
Celery
Databases
PostgreSQL
MinIO
AI/ML
Prefect
Function Calling
AI Agents
AWS Bedrock
LLM
RAG
OpenAI
Anthropic
Human-in-the-Loop
Knowledge Graph
Tool Use
LangGraph
AutoGen
LangChain
LlamaIndex
Prompt Engineering
CrewAI
Reranking
OpenAI Agents SDK
LLM Evaluation
LLM Guardrails
Frontend
GraphQL
DevOps
Rest API
AWS
Docker
Jaeger
OpenTelemetry
Prometheus
Kubernetes
Grafana
Amazon S3
Cybersecurity
FedRAMP
+29
Apply
uniqa.at • HQ: Vienna, Austria • Life Insurance & Annuities • Property & Casualty Insurance • Health Insurance & Benefits • 201-500 employees • Hiring 19
HQ: Vienna, Austria • Life Insurance & Annuities • Property & Casualty Insurance • Health Insurance & Benefits • 201-500 employees • Hiring 19
UNIQA Österreich is the Austrian insurance business of the UNIQA Insurance Group, offering health, life, motor, legal protection, accident, home and travel insurance as well as leasing. Its postings cover IT, group reporting, anti-money-laundering, underwriting of cyber and technology risks and sales management roles, mostly in Vienna. The insurer is headquartered in Vienna, Austria.
No named decision-maker yet.
Careers mailbox is known
14 days ago Likely open · 69%

Lead Developer (f/m/d) - Agentic AI Platform

$90k per year • Lead • Vienna • Remote (likely Austria) • Full-Time • Staff
Python
AI/ML
LangGraph
AutoGen
LangChain
LlamaIndex
Model Context Protocol
Function Calling
AI Agents
Semantic Kernel
CrewAI
LLM
RAG
Knowledge Graph
LLM Evaluation
Tool Use
DevOps
CI/CD
+8
Apply

Allianz

allianz.com
allianz.com • HQ: Munich, Germany • Life Insurance & Annuities • Asset Management & Funds • Property & Casualty Insurance • 1001-5000 employees • Est. 1890 • Trust A • Hiring 726, 89 new
HQ: Munich, Germany • Life Insurance & Annuities • Asset Management & Funds • Property & Casualty Insurance • 1001-5000 employees • Est. 1890 • Trust A • Hiring 726, 89 new
Allianz is a German multinational insurance and asset management group headquartered in Munich, operating as Allianz SE. Founded in 1890, it runs property, casualty, life and health insurance, reinsurance, assistance through Allianz Partners, insurtech units such as simplesurance and shared services entities across Europe, Asia and the Americas. Its global careers board lists roles in underwriting, pricing, claims and engineering surveying, finance and accounting, AI and ML engineering, cyber defence, HR and procurement, together with internships and working student positions.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 15 days ago Fading · 43%

AI Tech Lead (Data Engineering)_D3006

≈ $27k – $74k per year (Estimated) • Lead • 8+ years exp • In office (Pune, India) • Full-Time • Staff
Python
Databases
Apache Kafka
AI/ML
LangGraph
LangChain
Vertex AI
Prompt Engineering
Chain-of-Thought
AI Agents
Semantic Kernel
AWS Bedrock
LLM
RAG
GPT-4
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Multi-Agent Systems
Tool Use
MLFlow
OCR
DevOps
GCP
Azure
CI/CD
AWS
Terraform
Bicep
FinOps
Cybersecurity
Zero Trust
Chips/EDA
PoC Library
+21
Apply
Verified live · 1 hour ago 27 days ago Long shot · 21%

AI Transformation Engineer (m/f/d)

≈ $18k – $47k per year (Estimated) • Senior • 8+ years exp • Hybrid (Bangkok, Thailand) • Bachelor's Degree • Full-Time • Staff
Copilot
Claude
Claude Code
NLP
LLM Evaluation
LLM Guardrails
Machine Learning
DevOps
CI/CD
AIOps
+1
Apply

SpaceNexus

spacenexus.us
spacenexus.us • HQ: Uppsala, Sweden • Digital Media • Financial Data & Market Intelligence • 1-10 employees • Est. 2026 • Trust A • Hiring 1744, 2 new
HQ: Uppsala, Sweden • Digital Media • Financial Data & Market Intelligence • 1-10 employees • Est. 2026 • Trust A • Hiring 1744, 2 new
SpaceNexus is a space industry intelligence platform run by SpaceNexus LLC that tracks launches, satellites, space stocks, funding rounds, contract awards and news for investors, engineers and analysts. The service, launched in 2026, offers profiles of more than 370 space companies, newsletters, an API, embeddable widgets and a space jobs section that aggregates openings from firms such as Planet and Varda Space Industries. Its job feed therefore lists third-party roles in spacecraft engineering, manufacturing, software, legal and operations rather than positions at SpaceNexus itself.
No named decision-maker yet.
No careers mailbox known
Verified live · 8 hours ago 15 days ago Fading · 41%

Staff Software Engineer, IR Data Products

$216k – $239k per year • Equity • Staff+ • 8+ years exp • In office (Denver, United States) • Bachelor's Degree • Staff
Prefect
Flyte
LLM Evaluation
Weights & Biases
CUDA Toolkit
MLFlow
JAX
CUDA
Feature Store
DevOps
AWS
IAM
Terraform
+4
Apply

Muon Space

muonspace.com
muonspace.com • HQ: Mountain View, United States • Space Services • Earth Observation • Satellite Manufacturing • 501-1000 employees • Est. 2021 • Startup • Trust A • Hiring 129, 10 new
HQ: Mountain View, United States • Space Services • Earth Observation • Satellite Manufacturing • 501-1000 employees • Est. 2021 • Startup • Trust A • Hiring 129, 10 new
Muon Space is an American company founded in 2021 that designs, builds and operates satellite constellations as a service for customers who need specific Earth measurements but do not want to become space companies. Rather than selling spacecraft or generic imagery it takes on the whole mission, choosing sensors, building the satellites, launching and operating them and delivering the resulting data, for customers in climate science, defence and wildfire detection. Headquartered in Mountain View and backed by venture investors, it also operates the FireSat constellation developed with Google and the Earth Fire Alliance.
Daniel McCleese · Executive Officer, Director · decision-maker
Jonathan Dyer · Executive Officer, Director · decision-maker
Paul Day · Executive Officer, Director · decision-maker
Rob Toews · Director
Careers mailbox is known
Verified live · 3 hours ago Visa sponsor 15 days ago Likely open · 63%

Staff Software Engineer, IR Data Products

$216k – $239k per year • Equity • Staff+ • 8+ years exp • Hybrid (Denver, United States) • Bachelor's Degree • Staff
Prefect
Flyte
LLM Evaluation
CUDA Toolkit
MLFlow
JAX
CUDA
Feature Store
DevOps
AWS
IAM
Terraform
+3
Apply

Beacon AI

beaconai.com
beaconai.com • HQ: San Francisco, United States • Commercial Aviation • Defense AI • Avionics & Flight Control • Est. 2021 • Likely startup • Hiring 17, 1 new
HQ: San Francisco, United States • Commercial Aviation • Defense AI • Avionics & Flight Control • Est. 2021 • Likely startup • Hiring 17, 1 new
Beacon AI is an aviation technology company that builds AI-powered pilot assistance systems and flight safety software for commercial, private, and defense aviation. Often described as an "R2-D2 for pilots", the platform acts as an intelligent onboard teammate - integrating directly with cockpit infrastructure to assist aviators with real-time checklists, route optimization, fleet monitoring, and situational awareness to reduce human error and workload.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 30 min ago 15 days ago Fading · 41%

Staff Software Engineer, Cloud Infrastructure

$224k – $260k per year • Staff+ • 9+ years exp • Hybrid (San Carlos, United States) • Full-Time • Staff
Python
Databases
PostgreSQL
Redis
pgvector
Pinecone
DynamoDB
OpenSearch
Amazon Aurora
AI/ML
LLM
LangChain
Triton Inference Server
Embeddings
Quantization
Function Calling
TensorRT
TensorRT-LLM
AWS Bedrock
RAG
Time Series Forecasting
Amazon SageMaker
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
DevOps
AWS
Terraform
GitHub Actions
OpenTelemetry
AWS CDK
CI/CD
Kubernetes
Amazon EKS
AWS Lambda
Amazon S3
IAM
Amazon ECS
Amazon CloudWatch
Amazon EventBridge
AWS Step Functions
Cybersecurity
Least Privilege
Analytics
A/B Testing
+32
Apply
Top 25% payVerified live · 30 min ago 15 days ago Fading · 40%

Senior Software Engineer, Cloud Infrastructure

$173k – $225k per year • Senior • 4+ years exp • Hybrid (San Carlos, United States) • Full-Time • Senior
Python
Databases
PostgreSQL
Redis
pgvector
Pinecone
DynamoDB
OpenSearch
Amazon Aurora
AI/ML
LLM
LangChain
Triton Inference Server
Embeddings
Quantization
Function Calling
TensorRT
TensorRT-LLM
AWS Bedrock
RAG
Time Series Forecasting
Amazon SageMaker
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
DevOps
AWS
Terraform
GitHub Actions
OpenTelemetry
AWS CDK
CI/CD
Kubernetes
Amazon EKS
AWS Lambda
Amazon S3
IAM
Amazon ECS
Amazon CloudWatch
Amazon EventBridge
AWS Step Functions
Cybersecurity
Least Privilege
Analytics
A/B Testing
+32
Apply

Syllo

syllo.ai
syllo.ai • HQ: New York, United States • AI Agents • Legal Software • 51-200 employees • Est. 2019 • Startup • Hiring 7
HQ: New York, United States • AI Agents • Legal Software • 51-200 employees • Est. 2019 • Startup • Hiring 7
The first unified Litigation AI platform for case management, eDiscovery, analysis, and drafting. Built by litigators for litigators. Trusted by the Fortune100 and Amlaw 200 firms on their highest-stakes matters.
Theodore Rostow · Executive Officer · decision-maker
Jeffrey Chivers · Executive Officer · decision-maker
Careers mailbox is known
Top 25% pay 15 days ago Likely open · 69%

Senior Software Engineer, Internal Tools

$160k – $200k per year • Senior • 5+ years exp • Remote (United States) • Full-Time • Senior
Python
JavaScript
AI/ML
LLM
LLM Evaluation
Frontend
React.js
Management
Slack
Agile
Apply

Appen

appen.io
appen.io • HQ: San Francisco, United States • AI Training Data & Annotation • Hiring 16, 1 new
HQ: San Francisco, United States • AI Training Data & Annotation • Hiring 16, 1 new
Appen provides AI training data services, delivering the annotation, evaluation and data collection work that shapes how frontier models perform. Its generative AI project delivery team hires project specialists, strategic project leads for healthcare, legal and finance, account executives and client partners. The company is headquartered in San Francisco, California, United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 15 days ago Hiring now · 75%

Applied AI Research Engineer

≈ $20k – $45k per year (Estimated) • Middle • 3+ years exp • India • Remote (India) • Bachelor's Degree • Full-Time • Middle
Fine-tuning
Reinforcement Learning
AI Agents
LLM
LLM Evaluation
Machine Learning
Synthetic Data
Apply

Goldstone Partners

goldstonepartners.com
goldstonepartners.com • Boulder • Denver • Recruiting & Staffing • Executive Search • Hiring 5
Boulder • Denver • Recruiting & Staffing • Executive Search • Hiring 5
Goldstone Partners is a woman-owned search and talent advisory firm that connects companies with professionals through flexible recruiting solutions. Its postings cover business development, AI architecture, project management and construction estimating roles for clients, many of them remote. The company is based in Colorado, United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 15 days ago Likely open · 67%

AI Architect – US Remote

$150k – $200k per year • Staff+ • 10+ years exp • Oak Brook • Remote (United States) • Bachelor's Degree • Full-Time • Senior • English
C#
C#
.NET
Databases
Databricks
AI/ML
Copilot
Fine-tuning
LLM
RAG
OpenAI
Anthropic
LLM Evaluation
LLM Guardrails
DevOps
Azure
CI/CD
Cybersecurity
HIPAA
+6
Apply

ZoomInfo

zoominfo.com
zoominfo.com • HQ: Vancouver, United States • Data & Analytics • Sales & Marketing • Professional Services • Cybersecurity • Artificial Intelligence • Market Research • Lead Generation • Sales Enablement • B2B Company & Contact Data • Est. 2007 • Trust B • Hiring 100, 11 new
HQ: Vancouver, United States • Data & Analytics • Sales & Marketing • Professional Services • Cybersecurity • Artificial Intelligence • Market Research • Lead Generation • Sales Enablement • B2B Company & Contact Data • Est. 2007 • Trust B • Hiring 100, 11 new
Headquartered in Vancouver, Washington, United States, ZoomInfo (ZoomInfo Technologies Inc.) is a go-to-market (GTM) intelligence and revenue operations platform specializing in B2B data, sales automation, and buyer intent analytics. Founded in 2007 (originally as DiscoverOrg before acquiring and rebranding under the ZoomInfo banner), the company provides an integrated software suite that combines extensive global contact and firmographic databases with real-time intent signals, automated CRM data enrichment, conversation intelligence, and digital workflow orchestration.
Ali Dasdan · Executive Officer · decision-maker
Chris Hays · Executive Officer · decision-maker
Peter Hyzer · Executive Officer · decision-maker
Raymond Desabato Jr. · Executive Officer, Director · decision-maker
No careers mailbox known
Top 25% payVerified live · 1 hour ago 15 days ago Likely open · 57%

Principal Applied AI Engineer - Entity Agents

$172k – $270k per year • Lead • 5+ years exp • Remote (United States) • Principal
Python
TypeScript
AI/ML
Claude
Function Calling
AI Agents
LLM
Structured Outputs
LLM Evaluation
Tool Use
+1
Apply
Verified live · 1 hour ago 1 month ago Fading · 41%

Principal Product Manager, Person Data and AI Evaluations

$152k – $239k per year • Lead • 8+ years exp • Remote (United States) • Principal
Python
SQL
AI/ML
Claude
AI Agents
LLM
Human-in-the-Loop
LLM Evaluation
Cybersecurity
GDPR
Analytics
A/B Testing
+1
Apply
Verified live · 1 hour ago 3 months ago Long shot · 11%

Principal Product Manager, AI Evaluation and Data Policy

$152k – $239k per year • Lead • 8+ years exp • Hybrid (Waltham, United States) • Principal
Claude
LLM
Human-in-the-Loop
LLM Evaluation
Cybersecurity
GDPR
Apply

Babylist

babylist.com
babylist.com • HQ: Oakland, United States • Baby Products • E-commerce Platforms • 201-500 employees • Est. 2011 • Trust A • Hiring 36, 3 new
HQ: Oakland, United States • Baby Products • E-commerce Platforms • 201-500 employees • Est. 2011 • Trust A • Hiring 36, 3 new
Babylist is an online baby registry and e-commerce company that lets expecting parents combine items from any store, along with cash funds and favors, into a single shareable registry. Founded in 2011 by Natalie Gordon, it also sells baby products through its own shop, publishes product guides and runs a showroom in Beverly Hills, with a fulfillment operation in Columbus, Ohio. The company is headquartered in Oakland, California, United States.
Natalie Gordon · Director, Executive Officer · decision-maker
Michelle Newbery · Executive Officer · decision-maker
Sonya Brown · Director
Cheryl Law · Director
No careers mailbox known
Verified live · 2 hours ago 15 days ago Hiring now · 87%

Staff Machine Learning Engineer

≈ $94k – $199k per year (Estimated) • Staff+ • Canada • Remote (United States, Canada) • Staff
Python
Kotlin
TypeScript
Swift
Ruby
Ruby
Sidekiq
Databases
MySQL
Snowflake
Weaviate
AI/ML
LangChain
Claude Code
MLFlow
dbt
AI Agents
AWS Bedrock
Reranking
Amazon SageMaker
AWS Bedrock AgentCore
Devin
LLM Evaluation
Machine Learning
DevOps
Terraform
GitHub Actions
Datadog
AWS
Kubernetes
Analytics
A/B Testing
+19
Apply
Verified live · 2 hours ago 2 months ago Fading · 38%

Senior Software Engineer

≈ $87k – $158k per year (Estimated) • Senior • Canada • Remote (United States, Canada) • Senior
Kotlin
TypeScript
Swift
JavaScript
Ruby
Ruby
Sidekiq
Databases
MySQL
Snowflake
Weaviate
AI/ML
LangChain
Claude Code
MLFlow
dbt
AI Agents
AWS Bedrock
Amazon SageMaker
AWS Bedrock AgentCore
Devin
LLM Evaluation
Machine Learning
Frontend
React.js
DevOps
Terraform
GitHub Actions
Datadog
AWS
Kubernetes
+18
Apply

DVT

dvt.co.za
dvt.co.za • HQ: Johannesburg, South Africa • IT Consulting & Digital Transformation • Software Testing & QA • Custom Software Development • 201-500 employees • Est. 1999 • IT services • Trust A • Hiring 20
HQ: Johannesburg, South Africa • IT Consulting & Digital Transformation • Software Testing & QA • Custom Software Development • 201-500 employees • Est. 1999 • IT services • Trust A • Hiring 20
DVT is a South African software company founded in 1999 and headquartered in Johannesburg. It provides software development, testing and agile consulting. The company works with enterprise clients across the country.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 15 days ago Hiring now · 90%

Principal Java Engineer: AI Augmentation and Engineering Systems

≈ $36k – $108k per year (Estimated) • Lead • 10+ years exp • In office (Cape Town, South Africa) • Principal
Java
C#
C#
.NET
AI/ML
Function Calling
RAG
Context Engineering
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
DevOps
CI/CD
AWS
+4
Apply

DataZymes

datazymes.com
datazymes.com • Bengaluru • Analytics & BI Consulting • Est. 2016 • Hiring 7
Bengaluru • Analytics & BI Consulting • Est. 2016 • Hiring 7
DataZymes is a Data Science company driving digital-led innovation specializing in Marketing Analytics, Sales Analytics, Payer Analytics, Provider Analytics, Access Analytics, Patient Analytics, etc.
No named decision-maker yet.
Careers mailbox is known
15 days ago Likely open · 62%

Lead AI Engineer

≈ $24k – $63k per year (Estimated) • Lead • In office (Bengaluru, India) • Staff
Python
AI/ML
LangGraph
AutoGen
AI Agents
Helicone
LangSmith
CrewAI
RAG
Hybrid Search
LLM Evaluation
LLM Guardrails
Machine Learning
LangChain
DevOps
Rest API
CI/CD
Docker
Kubernetes
Cybersecurity
HIPAA
+10
Apply

Terac

terac.com
terac.com • HQ: San Francisco, United States • AI Training Data & Annotation • Market Research • 51-200 employees • Est. 2025 • Startup • Trust B • Hiring 40, 4 new
HQ: San Francisco, United States • AI Training Data & Annotation • Market Research • 51-200 employees • Est. 2025 • Startup • Trust B • Hiring 40, 4 new
Terac is an AI-powered market research and human data platform headquartered in the United States. Founded by Zachary Baker and Jack Blair, the enterprise operates an infrastructure layer connecting AI agents with verified human domain experts and research participants. Operating on a B2B SaaS and usage-based API business model, Terac automates qualitative research by using conversational voice and text AI agents to recruit participants, moderate interviews, collect feedback, and synthesize structured data insights in real time for product, marketing, and frontier AI research teams.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 15 days ago Hiring now · 77%

Software Engineers: Paid Code Review for AI Agent Evaluation

≈ $131k – $275k per year (Estimated) • Remote (United States) • Contractor
LLM Evaluation
Machine Learning
Apply
Verified live · 2 hours ago 16 days ago Hiring now · 77%

South Asian Software Engineers: Coding Tasks for AI Evaluation

Remote (Asia) • Contractor
AI Agents
LLM Evaluation
Apply
Verified live · 2 hours ago 16 days ago Hiring now · 77%

LATAM Software Engineers: Coding Tasks for AI Evaluation

Remote (LATAM) • Contractor
AI Agents
LLM Evaluation
Apply

Remitly

remitly.com
remitly.com • HQ: Seattle, United States • Payment Processing & Gateways • Money Transfer & Remittances • 1001-5000 employees • Est. 2011 • Trust A • Hiring 144, 7 new
HQ: Seattle, United States • Payment Processing & Gateways • Money Transfer & Remittances • 1001-5000 employees • Est. 2011 • Trust A • Hiring 144, 7 new
Remitly is an American company founded in Seattle in 2011 that specialises in cross-border remittances sent by migrants to family in their home countries, a market long dominated by cash agent networks charging high fees. Its mobile-first service pays out to bank accounts, mobile wallets and cash pickup locations across more than one hundred and seventy countries, and it competes on transparent pricing, delivery speed and the reliability of the last mile rather than on branch coverage. Headquartered in Seattle and listed on Nasdaq, it has expanded into multi-currency accounts and financial products aimed at the same customers.
Matt Oppenheimer · Co-founder and Chief Executive Officer · decision-maker
Hemanth Munipalli · Executive Officer · decision-maker
Saema Somalya · Executive Officer · decision-maker
Hilton Hewitt · Executive Officer · decision-maker
No careers mailbox known
Verified live · 6 hours ago 15 days ago Likely open · 54%

Analytics Engineer II

≈ $14k – $32k per year (Estimated) • Equity • Middle • 5+ years exp • In office (Manila, Philippines) • Full-Time • Middle
Python
Java
SQL
Scala
Databases
Snowflake
Amazon Redshift
Trino
AI/ML
Spark
AI Agents
LLM Evaluation
Machine Learning
DevOps
CI/CD
AWS
Analytics
ETL/ELT
Dimensional Modeling
+7
Apply
Machines can read this selection · checked 13:45 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.