LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Zscaler

zscaler.com
zscaler.com • HQ: San Jose, United States • Network Security • Cloud Security • 5000+ employees • Est. 2007 • Trust B • Hiring 313, 23 new
HQ: San Jose, United States • Network Security • Cloud Security • 5000+ employees • Est. 2007 • Trust B • Hiring 313, 23 new
Zscaler is an American cloud security company founded in 2007 that routes an organisation's internet and application traffic through its own global network of data centres for inspection. This replaces the appliances that traditionally sat at an office perimeter and underpins its two main products: a secure web gateway that inspects outbound traffic, and a zero trust access service that connects users to individual internal applications without putting them on the corporate network. Headquartered in San Jose and listed on Nasdaq, it also sells cloud posture management, data protection and a security operations product built on the traffic it already inspects.
Jay Chaudhry · Founder, Chairman and Chief Executive Officer · decision-maker
Jayant Lall · Geschäftsführer · decision-maker
Chris Potts · Geschäftsführer · decision-maker
Yogeswar Chandiramani · Geschäftsführer · decision-maker
No careers mailbox known
Open 157 daysTop 25% pay Visa sponsor 5 months ago Long shot · 11%

Security Architect / Security Engineer

$165k – $235k per year • Staff+ • 10+ years exp • Hybrid (United States) • Full-Time • Architect
Python
TypeScript
AI/ML
Function Calling
AI Agents
RAG
Structured Outputs
LLM
LLM Evaluation
NIST AI RMF
DevOps
GCP
Azure
AWS
Kubernetes
IAM
Cybersecurity
Zscaler
Zero Trust
SIEM
OWASP
Management
Agile
+11
Apply

Magnet Forensics

magnetforensics.com
magnetforensics.com • HQ: Atlanta, United States • National Security • Incident Response • Homeland Security • 201-500 employees • Est. 2009 • Trust A • Hiring 35, 1 new
HQ: Atlanta, United States • National Security • Incident Response • Homeland Security • 201-500 employees • Est. 2009 • Trust A • Hiring 35, 1 new
Magnet Forensics is a company that specializes in providing digital forensics and incident response tools. Their solutions, such as Magnet AXIOM and Magnet GrayKey, are used by law enforcement, military, intelligence, and enterprise organizations to recover, analyze, and manage digital evidence. They offer a wide range of tools to support digital investigations, including data extraction from mobile devices, video recovery, and workflow automation.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 5 months ago Long shot · 17%

Senior AI/ML Engineer (Magnet-Griffeye)

≈ $68k – $175k per year (Estimated) • Senior • 5+ years exp • Hybrid (Gothenburg, Sweden) • Bachelor's Degree • Full-Time • Senior
Python
AI/ML
AI Agents
Haystack
PyTorch
LLM
RAG
LLM Evaluation
Agentic Workflows
Machine Learning
Copilot
Claude
Computer Vision
NLP
DevOps
Azure
CI/CD
AWS
+8
Apply

Inflection AI

inflection.ai
inflection.ai • HQ: Palo Alto, United States • Conversational AI • LLM & Generative AI • 51-200 employees • Est. 2022 • Startup • Trust B • Hiring 6
HQ: Palo Alto, United States • Conversational AI • LLM & Generative AI • 51-200 employees • Est. 2022 • Startup • Trust B • Hiring 6
Inflection AI built the personal artificial intelligence assistant Pi together with its own Inflection model family, trained on one of the largest compute clusters of its era. Most of its founding team and researchers joined Microsoft in 2024 in an unusual arrangement that left the company operating independently. The business now focuses on enterprise deployments of empathetic conversational models rather than frontier scale pretraining; its earlier work on conversational tone and memory shaped several consumer assistant products.
Mustafa Suleyman · Executive Officer, Director · decision-maker
Karen Simonyan · Executive Officer, Director · decision-maker
Reid Hoffman · Director
No careers mailbox known
Open 157 daysTop 25% pay Visa sponsor 5 months ago Long shot · 10%

Staff Engineer, Agentic

$350k – $500k per year • Equity • Staff+ • 10+ years exp • In office (Palo Alto, United States) • Bachelor's Degree • Staff
Python
Databases
PostgreSQL
Redis
AI/ML
Function Calling
AI Agents
LLM
RAG
LLM Evaluation
Agentic Workflows
Tool Use
LangGraph
LangChain
LlamaIndex
LangSmith
Braintrust
OpenAI
Anthropic
DevOps
GCP
Azure
CI/CD
AWS
Kubernetes
+14
Apply

United Tech AI

unitedtech.ai
unitedtech.ai • HQ: Kyiv, Ukraine • Custom Software Development • AI Consulting & Integration • 201-500 employees • Trust B • Hiring 26, 3 new
HQ: Kyiv, Ukraine • Custom Software Development • AI Consulting & Integration • 201-500 employees • Trust B • Hiring 26, 3 new
United Tech AI is a technology company specializing in artificial intelligence solutions, enterprise software development, and digital transformation services. The organization focuses on leveraging machine learning, cloud infrastructure, and advanced automation to help businesses streamline operations and drive innovation. By delivering tailored AI-driven platforms, it enables clients across various industries to make data-driven decisions and enhance their competitive edge.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveVerified live · 1 hour ago 5 months ago Long shot · 8%

AI Engineer

≈ $35k – $89k per year (Estimated) • Senior • 5+ years exp • Kyiv • Remote (Ukraine) • Full-Time • Senior • English: B2
Python
SQL
Databases
pgvector
Pinecone
PostgreSQL
AI/ML
Claude
Embeddings
Prompt Engineering
Function Calling
AI Agents
LangSmith
Promptfoo
Ragas
AWS Bedrock
LLM
RAG
Hybrid Search
OpenAI
Anthropic
Structured Outputs
LLM Evaluation
DevOps
CI/CD
Git
AWS
AWS Lambda
GitHub
GitLab
Amazon S3
IAM
Rest API
Docker
Management
Slack
Confluence
Jira
n8n
Google Drive
+28
Apply

KOS

kos.ai
kos.ai • HQ: San Francisco, United States • AI Agents • Construction Management Software • Startup • Trust B • Hiring 5
HQ: San Francisco, United States • AI Agents • Construction Management Software • Startup • Trust B • Hiring 5
Kos reads the pay app, ties out the contract, and cuts the check. A virtual financial operations employee for companies that build the physical world.
No named decision-maker yet.
No careers mailbox known
Open 162 daysVerified live · 3 hours ago Visa sponsorship 5 months ago Long shot · 3%

Software Engineer Intern

Intern • In office (San Francisco, United States) • Relocation • Master's Degree • Internship • Intern
Python
TypeScript
AI/ML
Computer Vision
OpenAI
LLM Evaluation
Computer Use
DevOps
Azure
Apply
Open 162 daysTop 25% pay Visa sponsorship 5 months ago Long shot · 5%

Founding AI Engineer

$170k – $250k per year • Junior • 2+ years exp • Hybrid (San Francisco, United States) • Bachelor's Degree • Full-Time • Junior
Fine-tuning
Function Calling
Computer Vision
AI Agents
LLM
OpenAI
LLM Evaluation
Computer Use
Tool Use
DevOps
Azure
+2
Apply

Articul8

articul8.ai
articul8.ai • HQ: Dublin, United States • Foundation Models • LLM & Generative AI • 201-500 employees • Est. 2024 • Startup • Trust D • Hiring 20
HQ: Dublin, United States • Foundation Models • LLM & Generative AI • 201-500 employees • Est. 2024 • Startup • Trust D • Hiring 20
Building For ABetter Tomorrow We are researchers at heart, dedicated to developing exceptional products that delight our customers. View Current Openings Our Founding Story Articul8 was born from a simple belief: GenAI should work for the enterprise, not the other way around.
No named decision-maker yet.
No careers mailbox known
Likely inactiveVerified live · 1 hour ago Visa sponsor 5 months ago Long shot · 7%

Principal Applied AI Researcher - Domain- Specific Models (Dublin, CA)

≈ $151k – $309k per year (Estimated) • Lead • 10+ years exp • In office (Dublin, United States) • Master's Degree • Full-Time • Principal
Python
AI/ML
DeepSpeed
Fine-tuning
AI Agents
NLP
PyTorch
LLM
SFT
Post-training
Pre-training
Megatron-LM
FSDP
LLM Evaluation
Reward Modeling
Machine Learning
RLHF
Multimodal AI
DPO
+10
Apply
Likely inactiveVerified live · 1 hour ago 5 months ago Long shot · 7%

Principal Applied AI Researcher - Domain- Specific Models (India)

≈ $26k – $68k per year (Estimated) • Lead • 10+ years exp • Hybrid (Bengaluru, India) • Master's Degree • Full-Time • Principal
Python
AI/ML
DeepSpeed
Fine-tuning
AI Agents
NLP
PyTorch
LLM
SFT
Post-training
Pre-training
Megatron-LM
FSDP
LLM Evaluation
Reward Modeling
Machine Learning
RLHF
Multimodal AI
DPO
+10
Apply
Likely inactiveVerified live · 1 hour ago 5 months ago Long shot · 7%

Principal Applied AI Researcher - Domain- Specific Models (Brazil)

≈ $72k – $173k per year (Estimated) • Lead • 10+ years exp • Hybrid (Brazil) • Master's Degree • Full-Time • Principal
Python
AI/ML
DeepSpeed
Fine-tuning
AI Agents
NLP
PyTorch
LLM
SFT
Post-training
Pre-training
Megatron-LM
FSDP
LLM Evaluation
Reward Modeling
Machine Learning
RLHF
Multimodal AI
DPO
+10
Apply

Norbert Health

norberthealth.com
norberthealth.com • HQ: Brooklyn, United States • AI Agents • Care Coordination & Population Health • 51-200 employees • Est. 2019 • Startup • Trust D • Hiring 12
HQ: Brooklyn, United States • AI Agents • Care Coordination & Population Health • 51-200 employees • Est. 2019 • Startup • Trust D • Hiring 12
Norbert is an autonomous care manager that rounds, senses, documents, and escalates to close care loops.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveVerified live · 1 hour ago 5 months ago Long shot · 6%

Applied AI Engineer

≈ $125k – $236k per year (Estimated) • Middle • 4+ years exp • In office (Brooklyn, United States) • Bachelor's Degree • Full-Time • Middle
Python
C++
AI/ML
llama.cpp
LoRA
vLLM
Vertex AI
Embeddings
Quantization
Computer Vision
Speech Recognition
ONNX
TensorRT
PEFT
RAG
Amazon SageMaker
SFT
Text-to-Speech
LLM Evaluation
Voice Agents
Weights & Biases
MLFlow
Multimodal AI
Transformers
LLM
Human-in-the-Loop
Edge AI
DevOps
GCP
Azure
AWS
+21
Apply

Foresite Labs

foresitelabs.com
foresitelabs.com • San Francisco • Boston • San Diego • Venture Capital • Angel Networks & Startup Accelerators • Hiring 2
San Francisco • Boston • San Diego • Venture Capital • Angel Networks & Startup Accelerators • Hiring 2
Mission Statement Foresite Labs is a center for entrepreneurial innovation. We support the next generation of entrepreneurs who are building transformative companies utilizing AI and data science.
No named decision-maker yet.
Careers mailbox is known
Open 168 daysTop 25% pay Visa sponsor 5 months ago Long shot · 7%

Software Engineer, AI Agents

$200k – $240k per year • Senior • 5+ years exp • San Francisco • Remote (United States) • Senior
Python
Go
Java
TypeScript
AI/ML
LangChain
Claude Code
Function Calling
AI Agents
Pydantic AI
LLM
RAG
LLM Guardrails
Tool Use
Machine Learning
LangSmith
LLM Evaluation
Multi-Agent Systems
Frontend
Tailwind CSS
DevOps
Terraform
GCP
Pulumi
Azure
CI/CD
AWS
Docker
Unix
+18
Apply

Sekai

sekai.ai
sekai.ai • HQ: San Francisco, United States • Consumer & Utility Software • Mobile Games • 51-200 employees • Est. 2024 • Startup • Trust B • Hiring 4
HQ: San Francisco, United States • Consumer & Utility Software • Mobile Games • 51-200 employees • Est. 2024 • Startup • Trust B • Hiring 4
Sekai is a platform to play, create, and remix interactive mini-apps instantly. Explore an infinite feed of games and experiences, try one, or build your own and share it with anyone.
No named decision-maker yet.
No careers mailbox known
Open 169 daysVerified live · 12 min ago 6 months ago Long shot · 6%

AI Agent Engineer (Coding Agent)

≈ $157k – $345k per year (Estimated) • In office (San Francisco, United States) • Full-Time
Python
TypeScript
AI/ML
LangGraph
Function Calling
AI Agents
Pydantic AI
Google ADK
LLM Evaluation
Agentic Workflows
Tool Use
Vercel AI SDK
LangChain
Model Context Protocol
Fine-tuning
LLM
+7
Apply

Procede Software

procedesoftware.com
procedesoftware.com • Solana Beach • Automotive Manufacturing • Custom Software Development • 501-1000 employees • Est. 2001 • Hiring 3, 1 new
Solana Beach • Automotive Manufacturing • Custom Software Development • 501-1000 employees • Est. 2001 • Hiring 3, 1 new
Procede Software delivers integrated DMS solutions that streamline operations, boost profitability, and help dealerships achieve long-term success.
No named decision-maker yet.
Careers mailbox is known
Open 171 daysTop 25% pay 6 months ago Long shot · 10%

Software Developer

$120k – $180k per year • Senior • 6+ years exp • Hybrid (Solana Beach, United States) • Bachelor's Degree • Full-Time • Senior
SQL
AI/ML
AI Agents
LLM Evaluation
LLM Guardrails
Agentic Workflows
DevOps
CI/CD
Windows
Web3
Solana
Management
Agile
+1
Apply

Sonatype

sonatype.com
sonatype.com • HQ: Fulton, United States • Developer Tools • Application Security • DevSecOps • 201-500 employees • Est. 2008 • Trust B • Hiring 15, 1 new
HQ: Fulton, United States • Developer Tools • Application Security • DevSecOps • 201-500 employees • Est. 2008 • Trust B • Hiring 15, 1 new
Sonatype is a leader in software composition analysis (SCA) and software supply chain management. The company provides solutions to automate software supply chain security, build centralized components, control open source risks, and simplify software bill of materials (SBOM) compliance. Sonatype offers tools such as Nexus Repository, Repository Firewall, Lifecycle, and SBOM Manager, which help developers deliver quality code securely and manage vulnerability risks.
David Miller · Executive Officer · decision-maker
Wayne Jackson · Executive Officer, Director · decision-maker
Ashwin Gupta · Director
Letitia Long · Director
No careers mailbox known
Open 172 daysVerified live · 2 hours ago 6 months ago Long shot · 17%

Staff Software Engineer - Agentic First

≈ $153k – $278k per year (Estimated) • Staff+ • 7+ years exp • Atlanta • Remote (United States) • Full-Time • Staff
Java
AI/ML
Copilot
Cursor
LangGraph
Claude Code
Model Context Protocol
AI Agents
OpenAI Codex
LLM Evaluation
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
LangChain
DevOps
GCP
Azure
AWS
Nexus Repository
Cybersecurity
SBOM
SLSA
Sonatype Nexus IQ
Sigstore
Cosign
+14
Apply

Midi Health

joinmidi.com
joinmidi.com • HQ: Menlo Park, United States • Women’s Health & Maternity • Telemedicine & Virtual Care • 51-200 employees • Est. 2021 • Startup • Trust C • Hiring 39
HQ: Menlo Park, United States • Women’s Health & Maternity • Telemedicine & Virtual Care • 51-200 employees • Est. 2021 • Startup • Trust C • Hiring 39
Midi Health is a virtual care company headquartered in Menlo Park, California, and founded in 2021. The company provides telehealth visits with clinicians trained in perimenopause and menopause, covering hormone therapy, sleep, weight, bone health, and mental health for women in midlife. It bills through insurance in all fifty United States states and partners with health systems and employers that lack in-house menopause specialists.
Sharon Meers · Executive Officer, Director · decision-maker
Joanna Stober · Executive Officer, Director · decision-maker
Allison Gates · Director
Careers mailbox is known
Top 25% payVerified live · 1 hour ago 6 months ago Long shot · 23%

Senior Software Engineer, AI Engineer

$170k – $210k per year • Senior • 6+ years exp • Hybrid (San Francisco, United States) • Full-Time • Senior
Python
AI/ML
Copilot
Cursor
Claude Code
Function Calling
LLM
LLM Evaluation
Tool Use
AI Agents
NLP
RAG
+3
Apply

Architect AI

architect.ai
architect.ai • HQ: Palo Alto, United States • Semiconductor IP & Chip Design Services • EDA Software • Likely startup • Trust A • Hiring 11
HQ: Palo Alto, United States • Semiconductor IP & Chip Design Services • EDA Software • Likely startup • Trust A • Hiring 11
Architect AI is a startup applying machine learning to semiconductor and chip design. Its technical staff work on AI for chip design, physical design, formal methods and machine learning research, building tools that automate parts of the integrated circuit design flow. The company runs engineering teams in Palo Alto and Bengaluru, India. The company is headquartered in Palo Alto, California, United States.
No named decision-maker yet.
No careers mailbox known
Open 176 daysVerified live · 1 hour ago 6 months ago Long shot · 7%

Member of Technical Staff - AI for Chip Design

≈ $195k – $398k per year (Estimated) • Equity • Staff+ • In office (Palo Alto, United States) • Master's Degree • Full-Time • Staff
Python
TypeScript
AI/ML
Function Calling
AI Agents
LLM
Post-training
LLM Evaluation
Edge AI
Tool Use
Physical AI
+2
Apply

Voyfai

voyfai.com
voyfai.com • HQ: Berlin, Germany • Freight Forwarding • 51-200 employees • Est. 2023 • Startup • Trust B • Hiring 5
HQ: Berlin, Germany • Freight Forwarding • 51-200 employees • Est. 2023 • Startup • Trust B • Hiring 5
A European group of independent freight forwarders, operating autonomously at local level while sharing scale, technology, and partnerships.
No named decision-maker yet.
Careers mailbox is known
Open 176 daysVerified live · 2 hours ago 6 months ago Long shot · 9%

Senior AI Product Engineer (m/f/d)

≈ $66k – $116k per year (Estimated) • Equity • Senior • 3+ years exp • Hybrid (Berlin, Germany) • Full-Time • Senior
Python
TypeScript
Node JS
JavaScript
Databases
PostgreSQL
AI/ML
Claude
Gemini
LLM
Structured Outputs
LLM Evaluation
DevOps
CI/CD
+3
Apply
ff.com • HQ: El Segundo, United States • Humanoid Robots • Automotive Manufacturing • 501-1000 employees • Est. 2014 • Trust C • Hiring 66, 4 new
HQ: El Segundo, United States • Humanoid Robots • Automotive Manufacturing • 501-1000 employees • Est. 2014 • Trust C • Hiring 66, 4 new
Faraday Future is an American electric vehicle and embodied AI company headquartered in El Segundo, near Los Angeles, that designs intelligent connected cars and, since early 2026, humanoid, bionic and quadruped robots. Founded in 2014 and listed on Nasdaq, it runs two vehicle brands, the ultra-luxury FF line led by the FF 91 and the mainstream Faraday X line built around the FX Super One multi-purpose vehicle, and also operates a crypto business called AIXC. It hires robotics engineers and data operators, AI and backend software engineers, network and infrastructure specialists, finance and legal staff, product marketing managers and purchasing specialists.
No named decision-maker yet.
No careers mailbox known
Likely inactiveVerified live · 1 hour ago Visa sponsor 6 months ago Long shot · 7%

Tech Lead, Robotic AI Model

$150k – $180k per year • Lead • 3+ years exp • In office (El Segundo, United States) • Master's Degree • Staff
Python
AI/ML
DeepSpeed
LoRA
Fine-tuning
Reinforcement Learning
Quantization
Multimodal AI
QLoRA
PyTorch
Tokenization
Data Augmentation
SFT
PPO
GRPO
Post-training
FSDP
Human-in-the-Loop
LLM Evaluation
Vision-Language-Action
World Models
Embodied AI
Machine Learning
RLHF
TensorRT
PEFT
DPO
Edge AI
ONNX Runtime
Robotics
ROS
ROS2
PyBullet
Isaac Sim
MuJoCo
Teleoperation
Sim-to-Real
Imitation Learning
Reinforcement Learning
OpenVLA
LeRobot
Analytics
A/B Testing
+32
Apply

Reflection AI

reflection.ai
reflection.ai • HQ: New York, United States • AI Research Labs • Foundation Models • 501-1000 employees • Est. 2024 • Startup • Trust A • Hiring 43, 1 new
HQ: New York, United States • AI Research Labs • Foundation Models • 501-1000 employees • Est. 2024 • Startup • Trust A • Hiring 43, 1 new
Reflection AI is a company founded in 2024 by former Google DeepMind researchers who worked on AlphaGo and large language models. It builds autonomous coding agents and has committed to releasing frontier open-weight models as an American counterweight to Chinese open model releases. The company raised a very large round in 2025 to fund training at frontier scale.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago Visa sponsorship 6 months ago Long shot · 18%

Forward Deployed Engineer - LLM Post-training

≈ $166k – $313k per year (Estimated) • Equity • Middle • 3+ years exp • In office (San Francisco, New York, United States) • Full-Time • Middle
Python
AI/ML
Fine-tuning
RLHF
DPO
SFT
LLM Evaluation
Apply
Likely inactiveVerified live · 2 hours ago Visa sponsorship 12 months ago Long shot · 8%

Forward Deployed Engineer, Lead - LLM Post-training

≈ $177k – $363k per year (Estimated) • Equity • Lead • 6+ years exp • In office (New York, San Francisco, United States) • Full-Time • Staff
Reinforcement Learning
LLM
Synthetic Data
Post-training
LLM Evaluation
Reward Modeling
Apply

Sarvam AI

sarvam.ai
sarvam.ai • HQ: Bengaluru, India • LLM & Generative AI • Speech & Audio AI • Foundation Models • Natural Language Processing • 501-1000 employees • Est. 2023 • Startup • Trust A • Hiring 40, 1 new
HQ: Bengaluru, India • LLM & Generative AI • Speech & Audio AI • Foundation Models • Natural Language Processing • 501-1000 employees • Est. 2023 • Startup • Trust A • Hiring 40, 1 new
Sarvam AI is a leading Indian artificial intelligence company focused on building full-stack sovereign generative AI infrastructure, foundational large language models (LLMs), and speech technologies tailored for India’s diverse languages and enterprise requirements.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 6 months ago Long shot · 18%

Data Scientist - Evaluations, Chanakya

≈ $17k – $41k per year (Estimated) • Middle • 3+ years exp • In office (Bengaluru, India) • Full-Time • Middle
Python
AI/ML
Fine-tuning
RLHF
Prompt Engineering
LangSmith
NumPy
Hugging Face
LLM Evaluation
Apply

Forever New

forevernew.com.au
forevernew.com.au • HQ: Melbourne, Australia • Apparel & Fashion Brands • 1001-5000 employees • Est. 2006 • Trust A • Hiring 108, 10 new
HQ: Melbourne, Australia • Apparel & Fashion Brands • 1001-5000 employees • Est. 2006 • Trust A • Hiring 108, 10 new
Forever New is an Australian womenswear fashion brand founded in Melbourne in 2006, selling dresses, clothing and accessories through its own stores, department store concessions and online shops. Designed in Australia, the brand has grown to sell in more than 25 countries, with regional sites for New Zealand, the United Kingdom, Canada, India and South Africa among others. Its openings in Australia are mainly retail roles such as seasonal and part-time sales assistants and assistant store managers in shopping centres across the country, plus some head office positions in Melbourne.
No named decision-maker yet.
No careers mailbox known
Open 182 daysVerified live · 3 hours ago 6 months ago Long shot · 11%

Senior AI Automation Engineer – Digital

≈ $88k – $226k per year (Estimated) • Senior • 3+ years exp • In office (Australia) • Full-Time • Senior
Python
TypeScript
SQL
Databases
Databricks
AI/ML
Model Context Protocol
Embeddings
Function Calling
AI Agents
AgentOps
LLM
RAG
LLMOps
Human-in-the-Loop
Context Engineering
LLM Evaluation
LLM Guardrails
Machine Learning
DevOps
CI/CD
Cybersecurity
Least Privilege
Management
BPMN
+12
Apply

Infinity Constellation

infinityconstellation.com
infinityconstellation.com • HQ: Melbourne, Australia • LLM & Generative AI • Angel Networks & Startup Accelerators • Trust D • Hiring 17
HQ: Melbourne, Australia • LLM & Generative AI • Angel Networks & Startup Accelerators • Trust D • Hiring 17
Infinity Constellation is a venture studio and holding company headquartered in Melbourne, Australia. The group builds and operates a portfolio of software ventures under its own brands, including applied AI products, rather than investing passively in outside companies. It staffs each venture with dedicated engineering, design, and product teams while sharing finance, infrastructure, and hiring functions across the constellation.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveVerified live · 3 hours ago 6 months ago Long shot · 8%

Engineering Manager (AI) - Supernal

≈ $190k – $320k per year (Estimated) • Lead • 5+ years exp • Remote (United States) • Full-Time • Staff • English
PostgreSQL
Supabase
AI/ML
AI Agents
LLM
Human-in-the-Loop
LLM Evaluation
Agentic Workflows
Apply
Likely inactiveVerified live · 3 hours ago 6 months ago Long shot · 6%

Senior AI Engineer (Core) - Supernal

≈ $143k – $258k per year (Estimated) • Senior • Remote (United States, US time zones hours) • Full-Time • Senior
Python
Python
Django
Databases
PostgreSQL
Weaviate
Chroma
pgvector
Pinecone
Qdrant
AI/ML
LangGraph
AutoGen
LangChain
LlamaIndex
Embeddings
Function Calling
AI Agents
CrewAI
LLM
RAG
Text-to-Speech
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Voice Agents
Agentic Workflows
Tool Use
DevOps
OpenTelemetry
WebRTC
Datadog
Kubernetes
Platform Engineering
+22
Apply

Labelbox

labelbox.com
labelbox.com • HQ: San Francisco, United States • AI Training Data & Annotation • 201-500 employees • Est. 2018 • Startup • Trust A • Hiring 7
HQ: San Francisco, United States • AI Training Data & Annotation • 201-500 employees • Est. 2018 • Startup • Trust A • Hiring 7
Labelbox is a San Francisco company founded in 2018 that provides a data engine for training and evaluating machine learning models. Its platform combines annotation tooling, model-assisted labelling and quality analytics, and it operates an expert workforce marketplace for tasks that require domain knowledge. Customers range from computer vision teams to frontier labs sourcing human preference data.
No named decision-maker yet.
No careers mailbox known
Open 186 daysTop 25% pay Visa sponsor 6 months ago Long shot · 4%

Forward Deployed Research Scientist

$200k – $300k per year • Equity • In office (San Francisco, United States) • Master's Degree
Databricks
AI/ML
Qwen
Fine-tuning
RLHF
Reinforcement Learning
NLP
Llama
Mistral
LLM
DPO
SFT
LLM Evaluation
Reward Modeling
Machine Learning
+6
Apply
Machines can read this selection · checked 21:24 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.