LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Chakra

chakra.dev
chakra.dev • HQ: New York, United States • AI Agents • AI Training Data & Annotation • 1-10 employees • Startup • Hiring 3
HQ: New York, United States • AI Agents • AI Training Data & Annotation • 1-10 employees • Startup • Hiring 3
Deterministic RL environments and trajectory datasets for CUA training. Pixel-perfect multi-layer clones, temporal integrity, automated verifiable task generation.
No named decision-maker yet.
Careers mailbox is known
Open 528 daysVerified live · 2 hours ago 1 year ago Long shot · 9%

Member of Technical Staff, Applied Research

≈ $173k – $353k per year (Estimated) • Staff+ • In office (New York, United States) • Master's Degree • Full-Time • Staff
Python
Python
FastAPI
AI/ML
Fine-tuning
Reinforcement Learning
Function Calling
PyTorch
LLM
SFT
GRPO
Post-training
FSDP
LLM Evaluation
Tool Use
Reward Modeling
Machine Learning
DevOps
AWS
Management
Airtable
Stripe
+10
Apply

Skillable

skillable.com
skillable.com • HQ: New Port Richey, United States • IT Training & Certification • Learning Management Systems • 51-200 employees • Est. 2004 • Hiring 3
HQ: New Port Richey, United States • IT Training & Certification • Learning Management Systems • 51-200 employees • Est. 2004 • Hiring 3
Skillable provides cloud lab and virtual environments for hands-on IT and technical skills training.
No named decision-maker yet.
No careers mailbox known
Open 625 daysVerified live · 29 min ago 1 year ago Long shot · 5%

Senior Software Engineer

$130k – $170k per year • Senior • 8+ years exp • Remote (United States) • Bachelor's Degree • Full-Time • Senior
JavaScript
TypeScript
C#
Node JS
C#
Entity Framework Core
Node JS
Express
Databases
MS SQL
AI/ML
Copilot
Claude
Model Context Protocol
AI Agents
LLM Evaluation
Frontend
Next.js
React.js
Management
Agile
+7
Apply

Mactores

mactores.com
mactores.com • HQ: Seattle, United States • Cloud Consulting & Migration • Data Engineering & Migration Services • 201-500 employees • Est. 2008 • Trust D • Hiring 31
HQ: Seattle, United States • Cloud Consulting & Migration • Data Engineering & Migration Services • 201-500 employees • Est. 2008 • Trust D • Hiring 31
Mactores is a data and cloud consulting firm that helps businesses build and modernise data platforms, with services covering data strategy assessments, data lake and warehouse migration, analytics, machine learning and process automation, largely on Amazon Web Services. Founded in 2008, it serves enterprise clients in the United States and runs a large delivery team in Mumbai, India. The company is headquartered in Seattle, Washington, United States.
No named decision-maker yet.
No careers mailbox known
Likely inactiveVerified live · 1 hour ago 2 years ago Long shot · 4%

Generative AI Forward Deployed Engineer

≈ $20k – $43k per year (Estimated) • Middle • 3+ years exp • Mumbai • Remote (India) • Full-Time • Middle • English
Python
TypeScript
Java
Rust
C#
C++
C#
.NET
Databases
DynamoDB
Amazon Redshift
Amazon Aurora
Apache Kafka
AI/ML
LangGraph
LoRA
Fine-tuning
RLHF
Prompt Engineering
Function Calling
AI Agents
QLoRA
AWS Bedrock
CrewAI
RAG
Reranking
Amazon SageMaker
DPO
AWS Strands Agents
LLM Evaluation
Multi-Agent Systems
Tool Use
LangChain
PEFT
Knowledge Graph
Machine Learning
DevOps
CI/CD
AWS
AWS Lambda
Amazon Kinesis
API Gateway
Cybersecurity
PCI DSS
HIPAA
SOC 2
+33
Apply

Bronco AI

bronco.ai
bronco.ai • HQ: San Francisco, United States • Custom Software Development • 1-10 employees • Est. 2022 • Startup • Trust B • Hiring 3
HQ: San Francisco, United States • Custom Software Development • 1-10 employees • Est. 2022 • Startup • Trust B • Hiring 3
AI for chip design and verification. Bronco debugs simulations, brings up testbenches, generates RTL, and closes coverage to win the race to tape-out.
No named decision-maker yet.
No careers mailbox known
Open 801 daysVerified live · 3 hours ago 2 years ago Long shot · 4%

Founding AI Engineer

≈ $167k – $367k per year (Estimated) • Equity • In office (San Francisco, United States) • Full-Time
Python
AI/ML
RLHF
Reinforcement Learning
Function Calling
AI Agents
PyTorch
LLM
DPO
Post-training
LLM Evaluation
Tool Use
RLAIF
Reward Modeling
+5
Apply
Machines can read this selection · checked 23:19 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.