LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Anthropic

anthropic.com
anthropic.com • HQ: San Francisco, United States • Code Intelligence • AI Research Labs • AI Safety & Alignment • Foundation Models • LLM & Generative AI • 1001-5000 employees • Est. 2021 • Trust B • Hiring 648, 40 new
HQ: San Francisco, United States • Code Intelligence • AI Research Labs • AI Safety & Alignment • Foundation Models • LLM & Generative AI • 1001-5000 employees • Est. 2021 • Trust B • Hiring 648, 40 new
Anthropic is an American artificial intelligence safety and research company founded in 2021 by former OpenAI researchers, among them the siblings Dario and Daniela Amodei. It develops the Claude family of large language models and ships them through a consumer assistant, an enterprise developer platform and the Claude Code agentic coding tool, alongside open standards such as the Model Context Protocol. Incorporated as a public benefit corporation and headquartered in San Francisco, the company concentrates on interpretability, alignment and reliability research and counts Google and Amazon among its largest investors.
Jared Kaplan · Co-Founder & Chief Science Officer · decision-maker
Daniela Amodei · Co-Founder & President · decision-maker
Dario Amodei · Co-Founder & Chief Executive Officer · decision-maker
Tom Brown · Co-Founder · founder
No careers mailbox known
Top 25% payVerified live · 1 hour ago 3 months ago Long shot · 9%

Machine Learning Infrastructure Engineer, Safeguards Research

$350k – $500k per year • Hybrid (San Francisco, United States) • Bachelor's Degree
Python
AI/ML
Anthropic
Machine Learning
Multimodal AI
LLM Evaluation
Interpretability
Apply
Top 25% payVerified live · 1 hour ago 4 months ago Long shot · 5%

Research Engineer, Code RL (Reinforcement Learning)

$500k per year • Hybrid (San Francisco, United States) • Bachelor's Degree
Python
AI/ML
Claude
CUDA Toolkit
Fine-tuning
RLHF
Reinforcement Learning
Multimodal AI
AI Agents
PyTorch
LLM
CUDA
Anthropic
Post-training
TPU
Red Teaming
LLM Evaluation
Interpretability
+9
Apply
Verified live · 1 hour ago 4 months ago Long shot · 10%

Research Scientist, Life Sciences

≈ $236k – $450k per year (Estimated) • Senior • 5+ years exp • Hybrid (San Francisco, United States) • Bachelor's Degree • Senior
Python
AI/ML
Claude
Fine-tuning
AI Agents
Anthropic
Post-training
LLM Evaluation
Agentic Workflows
Machine Learning
RLHF
Multimodal AI
LLM
SFT
Interpretability
Tool Use
+7
Apply

Dyna Robotics

dynarobotics.com
dynarobotics.com • HQ: Redwood City, United States • Industrial Robotics • Foundation Models • Robotics AI • Robotic Software & Control Systems • 201-500 employees • Est. 2024 • Startup • Trust A • Hiring 22, 1 new
HQ: Redwood City, United States • Industrial Robotics • Foundation Models • Robotics AI • Robotic Software & Control Systems • 201-500 employees • Est. 2024 • Startup • Trust A • Hiring 22, 1 new
Dyna Robotics is a robotics foundation model company headquartered in Redwood City, California, and founded in 2024. The company trains general purpose manipulation models that let a single robot arm learn commercial tasks such as folding, packing, and handling from demonstration rather than explicit programming. It targets repetitive physical work in laundries, restaurants, and light manufacturing, and publishes model progress through its DYNA series of releases.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago Visa sponsor 3 months ago Long shot · 22%

Applied Researcher - Deployment Intelligence

≈ $189k – $413k per year (Estimated) • In office (Redwood City, United States) • Bachelor's Degree • Full-Time
Python
AI/ML
Fine-tuning
Reinforcement Learning
Multimodal AI
Anomaly Detection
LLM Evaluation
Embodied AI
Reward Modeling
JAX
PyTorch
Human-in-the-Loop
DevOps
SLURM
Robotics
Reinforcement Learning
Analytics
A/B Testing
+6
Apply

Quince

quince.com
quince.com • HQ: San Francisco, United States • Home Decor • Apparel & Fashion Brands • 501-1000 employees • Est. 2018 • Startup • Trust B • Hiring 146, 3 new
HQ: San Francisco, United States • Home Decor • Apparel & Fashion Brands • 501-1000 employees • Est. 2018 • Startup • Trust B • Hiring 146, 3 new
Quince is an e-commerce retail company headquartered in San Francisco, California, and founded in 2018. The company operates a direct-to-consumer marketplace that offers luxury-quality apparel, home goods, jewelry, and accessories by sourcing directly from manufacturers. It utilizes a manufacturer-to-consumer model to eliminate middleman costs and serves customers primarily in the United States and Canada through its online platform.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 1 hour ago Visa sponsor 3 months ago Fading · 26%

Senior Data Scientist, Planning and Forecasting

$187k – $242k per year • Senior • 5+ years exp • In office (Palo Alto, United States) • Senior
AI Agents
LLM
Feature Store
LLM Evaluation
QA
Rest-Assured
Apply

Esign

esign.cn
esign.cn • HQ: Hangzhou, China • Document Management • Digital Signature • Startup • Trust B • Hiring 21
HQ: Hangzhou, China • Document Management • Digital Signature • Startup • Trust B • Hiring 21
Esign is a Chinese electronic signature and contract management platform. Its postings cover customer service and technical support managers, sales directors, AI product managers and operations engineers, with several roles based in Nanchang. The company is headquartered in Hangzhou, China.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 3 months ago Long shot · 10%

Agent 基础设施工程师(J10433)

Middle • 3+ years exp • In office (Hangzhou, China) • Middle
Python
Java
Databases
MySQL
PostgreSQL
Redis
AI/ML
Model Context Protocol
LLM
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Prompt Caching
DevOps
Rest API
gRPC
+5
Apply

In4Ge

in4ge.com
in4ge.com • HQ: Warsaw, Poland • IT Staffing & Staff Augmentation • Recruiting & Staffing • Est. 2010 • Trust A • Hiring 238, 5 new
HQ: Warsaw, Poland • IT Staffing & Staff Augmentation • Recruiting & Staffing • Est. 2010 • Trust A • Hiring 238, 5 new
In4Ge is a Polish recruitment and IT staffing company that provides IT specialist outsourcing, permanent recruitment and executive search for employers in banking, technology and other sectors. It is part of the in4mates group and places manual testers, data governance consultants, enterprise architects, developers and bank accounting specialists, mainly in Warsaw, Kraków and Wrocław. The company is headquartered in Warsaw, Poland.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 3 months ago Likely open · 57%

Senior Python AI Engineer

≈ $64k – $107k per year (Estimated) • Senior • In office (Poland) • Senior • Polish: C1
Python
Python
FastAPI
Asyncio
Pydantic
Databases
Redis
AI/ML
LangGraph
Claude
Model Context Protocol
Function Calling
AI Agents
LLM
OpenAI Agents SDK
A2A
Human-in-the-Loop
Structured Outputs
Agentic Workflows
Tool Use
LangChain
Langfuse
LLM Evaluation
DevOps
Rest API
Azure
OpenTelemetry
Datadog
QA
Pytest
+17
Apply

Gritt

gritt.ai
gritt.ai • HQ: San Francisco, United States • Construction • Solar Energy • Robotics AI • Construction Robotics • 51-200 employees • Est. 2022 • Startup • Trust A • Hiring 17
HQ: San Francisco, United States • Construction • Solar Energy • Robotics AI • Construction Robotics • 51-200 employees • Est. 2022 • Startup • Trust A • Hiring 17
Gritt is an AI and robotics technology company headquartered in San Francisco and founded in 2022. The company develops an intelligent system that retrofits standard construction machinery with AI-powered robotic arms to automate labor-intensive tasks such as solar panel installation, rebar tying, and material transport. It operates primarily in the renewable energy and large-scale infrastructure sectors, partnering with major engineering and construction firms to accelerate project timelines and address labor shortages.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 3 months ago Fading · 30%

Robotics Perception Engineer Intern

≈ $102k – $289k per year (Estimated) • Intern • In office (South San Francisco, United States) • Master's Degree • Internship • Intern
Python
AI/ML
Multimodal AI
Computer Vision
PyTorch
LLM Evaluation
CUDA Toolkit
CUDA
Robotics
Localization
Perception
Sensor Fusion
+2
Apply

Centific

centific.com
centific.com • HQ: Redmond, United States • AI Consulting & Integration • AI Evaluation & Observability • AI Training Data & Annotation • Translation Services • 1001-5000 employees • Est. 2020 • IT services • Trust C • Hiring 95, 4 new
HQ: Redmond, United States • AI Consulting & Integration • AI Evaluation & Observability • AI Training Data & Annotation • Translation Services • 1001-5000 employees • Est. 2020 • IT services • Trust C • Hiring 95, 4 new
Centific is an American company spun out of the localisation group Pactera EDGE that supplies the data, evaluation and engineering services artificial intelligence systems need in production. Its work covers multilingual training data collection and annotation, human evaluation of model outputs, red teaming, and the engineering to deploy models into enterprise and retail environments, drawing on a contributor network spanning many languages and markets. Headquartered in Redmond, Washington, it works with large technology companies and enterprises, and its heritage in localisation is what gave it the global human capacity this work requires.
No named decision-maker yet.
Careers mailbox is known
Verified live · 8 hours ago 3 months ago Long shot · 6%

AI Research Engineer- Speech 1

$150k – $160k per year • Junior • 2+ years exp • Hybrid (Redmond, United States) • Master's Degree • Full-Time • Junior
Python
Python
FastAPI
AI/ML
LoRA
Fine-tuning
Multimodal AI
Chain-of-Thought
Transformers
PyTorch
LLM
RAG
Tokenization
Edge AI
Weights & Biases
Qwen
DeepSpeed
CUDA Toolkit
Quantization
ONNX
TensorRT
PEFT
Gemini
Whisper
Hallucination
CUDA
Hugging Face
FSDP
NVIDIA NeMo
LLM Evaluation
DevOps
gRPC
+21
Apply

Mondia Group

mondiagroup.com
mondiagroup.com • HQ: Hamburg, Germany • Digital Marketing • Payment Processing & Gateways • Digital Media • Hiring 11, 1 new
HQ: Hamburg, Germany • Digital Marketing • Payment Processing & Gateways • Digital Media • Hiring 11, 1 new
Mondia Group is a global digital tech company that specializes in content distribution, digital marketing, and mobile payment solutions. The company connects mobile operators, content providers, and consumers through customized platforms for entertainment, gaming, health, and lifestyle services. Operating across dozens of markets worldwide, it enables businesses to monetize digital content and deliver personalized experiences to end-users.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 3 months ago Long shot · 19%

Agentic AI Engineer

In office (Cairo, Egypt) • Full-Time
Python
Databases
PostgreSQL
pgvector
AI/ML
Claude Code
Embeddings
Function Calling
AI Agents
LLM
RAG
LLM Evaluation
LLM Guardrails
Tool Use
DevOps
CI/CD
Git
+6
Apply

KDCI

kdci.co
kdci.co • HQ: Pasig, Philippines • Virtual Assistant Services • Business Process Outsourcing (BPO) • 51-200 employees • Est. 2011 • Staffing · EOR • Trust B • Hiring 35, 1 new
HQ: Pasig, Philippines • Virtual Assistant Services • Business Process Outsourcing (BPO) • 51-200 employees • Est. 2011 • Staffing · EOR • Trust B • Hiring 35, 1 new
KDCI, or Key Discovery Consulting, is an offshore staffing and outsourcing company that builds dedicated full-time remote teams in the Philippines for overseas clients, with its delivery center in Pasig and a US office in Carson, California. Founded in 2011 by executives with long outsourcing experience, it supplies staff for accounting, customer support, legal operations, creative production, engineering and AI work. Its openings, all based in Pasig, include accounting and accounts payable specialists, SaaS and customer support specialists, power systems engineers, CAD drafters, graphic and AI image designers, social media specialists and AI and automation engineers.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 3 months ago Long shot · 12%

LLM Engineer

Middle • 3+ years exp • Pasig • Remote (Philippines) • Middle
Python
AI/ML
Fine-tuning
Prompt Engineering
NLP
TensorFlow
PyTorch
LLM
RAG
BERT
LLM Evaluation
Quantization
+3
Apply

Stand Insurance

standinsurance.com
standinsurance.com • HQ: San Francisco, United States • Financial AI • Property & Casualty Insurance • InsurTech • 51-200 employees • Est. 2024 • Startup • Trust B • Hiring 10
HQ: San Francisco, United States • Financial AI • Property & Casualty Insurance • InsurTech • 51-200 employees • Est. 2024 • Startup • Trust B • Hiring 10
Stand Insurance is a property insurance company that uses physics-based modelling and artificial intelligence to assess the wildfire, hurricane and other catastrophe risk of individual homes. It recommends specific mitigation steps that make high-risk properties insurable and writes coverage for homeowners in catastrophe-exposed markets. The company is headquartered in San Francisco, California, United States.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 25 min ago 3 months ago Long shot · 10%

Machine Learning Engineer - Multimodal Modeling

$250k – $295k per year • Equity • Hybrid (San Francisco, United States) • Full-Time
Multimodal AI
AI Agents
VLM
LLM
Post-training
LLM Evaluation
World Models
Machine Learning
Embodied AI
Robotics
Digital Twin
+2
Apply

Dialpad

dialpad.com
dialpad.com • HQ: San Ramon, United States • Conversational AI • Video Conferencing & Webinars • Contact Center Software • Unified Communications • 501-1000 employees • Est. 2011 • Trust B • Hiring 54
HQ: San Ramon, United States • Conversational AI • Video Conferencing & Webinars • Contact Center Software • Unified Communications • 501-1000 employees • Est. 2011 • Trust B • Hiring 54
Dialpad is an American cloud communications company that provides an AI-powered platform combining business phone calling, messaging, video meetings and contact center software. Founded in 2011, it uses its own speech recognition and conversational AI to transcribe calls, coach agents and automate customer interactions, and it serves businesses from small teams to large enterprises worldwide. The company is headquartered in San Ramon, California, United States.
Lily Toy · Executive Officer · decision-maker
Craig Walker · Executive Officer, Director · decision-maker
Jen Grant · Director
Will Griffith · Director
Careers mailbox is known
Top 25% payVerified live · 2 hours ago Visa sponsor 3 months ago Long shot · 17%

Lead Product Manager

$211k – $266k per year • Lead • 2+ years exp • In office (San Ramon, United States) • Staff
Quantization
AI Agents
Speech Recognition
Voice Agents
Text-to-Speech
LLM Evaluation
Edge AI
Apply
Open 194 daysVerified live · 2 hours ago 6 months ago Long shot · 12%

Sr. SDET

≈ $68k – $123k per year (Estimated) • Senior • 6+ years exp • In office (Vancouver, Kitchener, Canada) • Senior • English
Python
Go
JavaScript
AI/ML
AI Agents
LLM Evaluation
Edge AI
Frontend
Vue.js
DevOps
Rest API
GCP
Kubernetes
Google GKE
Google Cloud Run
GitHub
Management
Jira
QA
Selenium
Rest-Assured
Pytest
+9
Apply

Obvious

obvious.ai
obvious.ai • HQ: Alexandria, United States • Machine Learning • AI Agents • 1-10 employees • Est. 2019 • Startup • Hiring 1
HQ: Alexandria, United States • Machine Learning • AI Agents • 1-10 employees • Est. 2019 • Startup • Hiring 1
Obvious is the AI agent that builds with you, not just for you. Documents, sheets, slides, dashboards, and apps, all in one workspace.
No named decision-maker yet.
No careers mailbox known
Open 93 daysVerified live · 1 hour ago 3 months ago Long shot · 10%

Member of Technical Staff

$200k – $250k per year • Staff+ • Remote (United States) • Full-Time • Staff
TypeScript
JavaScript
AI/ML
LLM
LLM Evaluation
Multi-Agent Systems
Frontend
React.js
DevOps
Datadog
Management
Dropbox
Apply
Report

ShiftKey

shiftkey.com
shiftkey.com • HQ: Dallas, United States • Healthcare Staffing • 201-500 employees • Est. 2016 • Trust B • Hiring 10
HQ: Dallas, United States • Healthcare Staffing • 201-500 employees • Est. 2016 • Trust B • Hiring 10
ShiftKey is a Dallas company founded in 2016 that runs a marketplace for healthcare shifts. Licensed professionals bid on open shifts at facilities without an agency in between. The platform serves long-term care and hospital operators nationwide.
No named decision-maker yet.
No careers mailbox known
Open 93 daysVerified live · 1 hour ago 3 months ago Long shot · 22%

Staff AI Engineer - AI Infrastructure & Agentic Platform

≈ $168k – $311k per year (Estimated) • Staff+ • 7+ years exp • Remote (United States) • Full-Time • Staff
Python
Go
TypeScript
AI/ML
AI Agents
AWS Bedrock
LLM
RAG
LLM Evaluation
LLM Guardrails
Function Calling
Hybrid Search
Tool Use
DevOps
Terraform
Azure
AWS
Cybersecurity
HIPAA
+8
Apply

Madhive

madhive.com
madhive.com • HQ: New York, United States • Advertising • 51-200 employees • Est. 2016 • Startup • Hiring 10
HQ: New York, United States • Advertising • 51-200 employees • Est. 2016 • Startup • Hiring 10
Our mission is to empower our clients to create enduring relationships with consumers through maximum-fidelity, TV-first technology that elevates media, embodies relentless innovation, and ensures unrivaled revenue acceleration.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago Visa sponsor 3 months ago Long shot · 23%

AI Code Engineering Lead

$200k – $225k per year • Lead • 10+ years exp • Hybrid (New York, United States) • Full-Time • Staff
AI Agents
LLM Evaluation
LLM Guardrails
DevOps
CI/CD
Apply

Microsoft Bing

bing.com
bing.com • HQ: Redmond, United States • AI Search • Search Engines • Est. 2009 • Trust B • Hiring 24, 3 new
HQ: Redmond, United States • AI Search • Search Engines • Est. 2009 • Trust B • Hiring 24, 3 new
Microsoft Bing is the web search engine operated by Microsoft, launched in 2009 as the successor to Live Search. It indexes web pages, images, video, news and maps, supplies search results to partner services such as Yahoo and DuckDuckGo, and adds generative AI answers through Microsoft Copilot. Bing also provides search and search advertising inside Microsoft products including Windows and the Edge browser. The company is headquartered in Redmond, Washington, United States.
No named decision-maker yet.
No careers mailbox known
Open 94 daysVerified live · 3 hours ago 3 months ago Long shot · 7%

Madrid - AI Engineer

≈ $44k – $103k per year (Estimated) • In office (Madrid, Spain) • High School Diploma
Python
Java
SQL
C++
AI/ML
LLM
LLM Evaluation
Edge AI
Speculative Decoding
Agentic Workflows
Machine Learning
DevOps
Azure
AWS
+4
Apply

Deeplab

deeplab.ai
deeplab.ai • AI Consulting & Integration • MLOps • Machine Learning • Hiring 1
AI Consulting & Integration • MLOps • Machine Learning • Hiring 1
Empower your business with deep intelligenceto make better decisions.. We design and develop scalable ML infrastructure solutions employing cutting-edge technology.
No named decision-maker yet.
Careers mailbox is known
Open 95 daysVerified live · 5 hours ago 3 months ago Long shot · 8%

R&D Machine Learning Engineer

Athens • Remote (Greece) • English
Python
AI/ML
Computer Vision
AI Agents
LLM
RAG
LLM Evaluation
Machine Learning
Weights & Biases
LoRA
MLFlow
Fine-tuning
JAX
NLP
PEFT
TensorFlow
PyTorch
Time Series Forecasting
DevOps
CI/CD
Git
Docker
HPC
Linux
+14
Apply
Report

Visa

visa.com
visa.com • HQ: San Francisco, United States • Payment Processing & Gateways • Cards & Card Issuing • 5000+ employees • Est. 1958 • Trust A • Hiring 757, 77 new
HQ: San Francisco, United States • Payment Processing & Gateways • Cards & Card Issuing • 5000+ employees • Est. 1958 • Trust A • Hiring 757, 77 new
Visa is an American payments technology company whose network traces back to the BankAmericard programme launched in 1958 and which became an independent public company in 2008. It does not issue cards or lend money; instead it operates VisaNet, the switching infrastructure that authorises, clears and settles hundreds of billions of transactions a year between issuing banks, acquirers and merchants in more than two hundred countries. Headquartered in San Francisco, the company earns fees on payment volume and processed transactions, and has expanded into account-to-account transfers, tokenisation, fraud scoring and open banking through Visa Direct and its value-added services division.
Chris Suh · Chief Financial Officer · decision-maker
Ryan McInerney · Chief Executive Officer · decision-maker
Dee Hock · Founder of the Visa Network · founder
Alfred Kelly · former Chief Executive Officer
No careers mailbox known
Open 95 daysVerified live · 6 hours ago 3 months ago Long shot · 7%

Data Engineer

≈ $49k – $101k per year (Estimated) • Middle • 3+ years exp • Hybrid (Singapore) • Bachelor's Degree • Full-Time • Middle
Python
SQL
Python
pySpark
AI/ML
MLFlow
Prompt Engineering
Great Expectations
RAG
Hallucination
LLM Evaluation
LLM Guardrails
LangChain
Hadoop
Spark
Machine Learning
DevOps
Azure DevOps
GitHub Actions
Azure
CI/CD
Git
GitHub
Splunk
Analytics
Tableau
Power BI
SSAS
ETL/ELT
+17
Apply

Walden Robotics

waldenrobotics.com
waldenrobotics.com • HQ: Cambridge, United States • Robotics AI • Humanoid Robots • 501-1000 employees • Est. 2025 • Startup • Trust A • Hiring 39, 3 new
HQ: Cambridge, United States • Robotics AI • Humanoid Robots • 501-1000 employees • Est. 2025 • Startup • Trust A • Hiring 39, 3 new
Walden Robotics is a robotics company building general-purpose humanoid robots for the home, the workplace, factories and farms. It hires robotics, reinforcement learning, test and release engineers and a prototyping lab manager. The company is headquartered in Cambridge, Massachusetts, United States.
David Johnson · Executive Officer · decision-maker
Benjamin Burchfiel · Executive Officer, Director · decision-maker
Adrien Gaidon · Executive Officer · decision-maker
Kerri Fetzer-Borelli · Executive Officer · decision-maker
Careers mailbox is known
Verified live · 2 hours ago Visa sponsor 3 months ago Fading · 30%

AI Engineer

≈ $162k – $354k per year (Estimated) • In office (San Francisco, United States) • Full-Time
Python
AI/ML
Cursor
Weights & Biases
Claude Code
AI Agents
Langfuse
LLM
OpenAI
Anthropic
OpenAI Codex
OpenAI Agents SDK
LLM Evaluation
Agentic Workflows
+5
Apply

Console

console.com
console.com • HQ: San Francisco, United States • IT Help Desk & Service Desk • AI Agents • IT Service & Asset Management • 11-50 employees • Startup • Trust D • Hiring 15
HQ: San Francisco, United States • IT Help Desk & Service Desk • AI Agents • IT Service & Asset Management • 11-50 employees • Startup • Trust D • Hiring 15
Console is an American software company that builds an AI-native IT service management platform. Its AI agents handle employee IT requests such as access provisioning, password resets and troubleshooting inside chat tools like Slack, and help IT teams automate support workflows instead of working tickets by hand. The company is headquartered in San Francisco, California, United States.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveTop 25% pay 3 months ago Long shot · 6%

Research Engineer

$200k – $350k per year • In office (San Francisco, United States) • Full-Time
Databricks
AI/ML
Cursor
DSPy
LoRA
Fine-tuning
Reinforcement Learning
Knowledge Distillation
AI Agents
PEFT
QLoRA
OpenAI
DPO
SFT
GRPO
Post-training
LLM Evaluation
Model Distillation
Reward Modeling
Machine Learning
DevOps
GitHub
Design
Figma
Management
Slack
Stripe
+15
Apply

Oh So

oh-so.com
oh-so.com • HQ: Hamburg, Germany • Creative Agencies • Digital Marketing • 1-10 employees • Est. 2024 • Trust B • Hiring 3
HQ: Hamburg, Germany • Creative Agencies • Digital Marketing • 1-10 employees • Est. 2024 • Trust B • Hiring 3
OH-SO is the AI-native digital agency for iconic brands — building experiences that move people and systems that move business. Powered by WPP.
No named decision-maker yet.
No careers mailbox known
Open 95 daysVerified live · 1 day ago 3 months ago Long shot · 9%

Agentic Engineer (f/m/d)

≈ $77k – $158k per year (Estimated) • Senior • 5+ years exp • Germany • Remote (Germany) • Full-Time • Senior
Python
TypeScript
JavaScript
AI/ML
Copilot
Cursor
Claude Code
Model Context Protocol
Prompt Engineering
AI Agents
LLM
RAG
LLM Evaluation
LLM Guardrails
Multi-Agent Systems
Frontend
Next.js
React.js
DevOps
Terraform
CI/CD
AWS
Docker
Kubernetes
+13
Apply
Machines can read this selection · checked 13:20 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.