LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Software
Data
Security
DevOps & Cloud
Leadership
Product
Design
Hardware & Chips
Defense
Aerospace
Biotech
Energy
Robotics
MedTech

Shiboleth

shiboleth.ai
shiboleth.ai • HQ: San Francisco, United States • RegTech, AML & Compliance • 11-50 employees • Startup • Hiring 1
HQ: San Francisco, United States • RegTech, AML & Compliance • 11-50 employees • Startup • Hiring 1
Shiboleth is a start-up that treats bank compliance as an engineering problem, using agents and pipelines to reperform a bank’s compliance programme on all of a fintech’s files instead of a five percent sample. It combines deterministic rules with LLM-as-judge evaluation, and its job ads seek a founding full stack engineer. The company is headquartered in San Francisco, United States.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 2 hours ago 2 months ago Long shot · 18%

Founding Full Stack Software Engineer

$170k – $220k per year • Equity 1–2.8% • Middle • 3+ years exp • In office (San Francisco, United States) • Full-Time • Middle
SQL
Python
Python
Django
AI/ML
Context Engineering
LLM Evaluation
Agentic Workflows
RAG
LLM
AI Agents
+1
Apply
Report

Dropzone AI

dropzone.ai
dropzone.ai • HQ: Seattle, United States • Incident Response • Cybersecurity AI • Security Operations • 51-200 employees • Est. 2023 • Startup • Hiring 12, 3 new
HQ: Seattle, United States • Incident Response • Cybersecurity AI • Security Operations • 51-200 employees • Est. 2023 • Startup • Hiring 12, 3 new
Dropzone AI is a security automation company headquartered in Seattle, Washington, and founded in 2023. The company builds an autonomous AI analyst that investigates security alerts end to end, gathering context from the customer environment and writing up a conclusion the way a tier one analyst would. It sells to security operations centres and managed security providers dealing with alert volumes that outpace their staffing.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 2 hours ago Visa sponsor 2 months ago Likely open · 62%

AI Research Engineer

$200k – $250k per year • Senior • 5+ years exp • Hybrid • Senior
Python
AI/ML
LangGraph
AutoGen
Function Calling
Hallucination
Synthetic Data
Human-in-the-Loop
Structured Outputs
LLM Evaluation
LLM Guardrails
Claude Code
RAG
AI Agents
LangChain
+6
Apply

Pelico

pelico.ai
pelico.ai • HQ: Paris, France • Manufacturing & Industrial Software • 11-50 employees • Est. 2019 • Startup • Hiring 19, 1 new
HQ: Paris, France • Manufacturing & Industrial Software • 11-50 employees • Est. 2019 • Startup • Hiring 19, 1 new
Pelico builds an operations management platform that gives factories a live view of which shortages will block which orders. Its engine connects ERP, MES and supplier data to show the real impact of every disruption. The company is headquartered in Paris and works with aerospace, automotive and industrial manufacturers.
Tarik Benabdallah · Président de SAS · decision-maker
Mamoun Alaoui · Directeur Général · decision-maker
Careers mailbox is known
Verified live · 1 hour ago 2 months ago Long shot · 16%

Tech Lead - Platform

≈ $60k – $114k per year (Estimated) • Lead • Hybrid (Paris, France) • Full-Time • Staff
Kotlin
TypeScript
Java
AI/ML
Model Context Protocol
Copilot
AI Agents
LLM Evaluation
Agentic Workflows
DevOps
Kubernetes
+1
Apply
Verified live · 1 hour ago 2 months ago Long shot · 13%

Fullstack Software Engineer, ADK

≈ $127k – $271k per year (Estimated) • Hybrid (Boston, United States) • Full-Time
Python
JavaScript
AI/ML
Human-in-the-Loop
LLM Evaluation
Model Context Protocol
LLM
AI Agents
Frontend
React.js
DevOps
OpenTelemetry
+1
Apply

Minfy Technologies

minfytech.com
minfytech.com • HQ: Hyderabad, India • AI Consulting & Integration • Data Engineering & Migration Services • Managed IT Services (MSP) • Cloud Consulting & Migration • 201-500 employees • Est. 2016 • IT services • Trust B • Hiring 87
HQ: Hyderabad, India • AI Consulting & Integration • Data Engineering & Migration Services • Managed IT Services (MSP) • Cloud Consulting & Migration • 201-500 employees • Est. 2016 • IT services • Trust B • Hiring 87
Minfy Technologies is an Indian cloud and artificial intelligence services company founded in 2016 that works almost entirely within the Amazon Web Services ecosystem as a premier partner. Its work covers cloud migration and modernisation, data platform engineering, applied machine learning and managed cloud operations, sold to enterprises and public sector organisations across India, the Middle East, Southeast Asia and the United States. Headquartered in Hyderabad, it competes against the very large Indian systems integrators by concentrating on a single cloud platform in depth rather than trying to cover all of them shallowly.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 2 months ago Fading · 26%

AI Engineer

$21k – $32k per year • Staff+ • 10+ years exp • In office (Hyderabad, India) • Bachelor's Degree • Full-Time • Staff
SQL
Python
AI/ML
Embeddings
Function Calling
AWS Bedrock
LLMOps
Context Engineering
LLM Evaluation
LLM Guardrails
TensorFlow
Spark
PyTorch
RAG
LLM
Machine Learning
AI Agents
DevOps
AWS
+9
Apply

AZX

azx.io
azx.io • HQ: Bellevue, United States • AI Agents • Custom Software Development • AI Consulting & Integration • 51-200 employees • Startup • Hiring 7, 1 new
HQ: Bellevue, United States • AI Agents • Custom Software Development • AI Consulting & Integration • 51-200 employees • Startup • Hiring 7, 1 new
AZX is an artificial intelligence engineering enterprise and Public Benefit Corporation specializing in AI transformation and custom software solutions for critical infrastructure sectors. Headquartered in Bellevue, Washington, the company designs, builds, and deploys production-grade AI systems, agentic workflows, and custom inference platforms tailored for asset-heavy industries - including energy, power utilities, commercial real estate, and supply chain logistics.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 2 hours ago 2 months ago Likely open · 61%

Senior ML Engineer (Energy & Utilities)

$140k – $230k per year • Senior • Seattle • Remote (United States) • Bachelor's Degree • Full-Time • Senior
Rust
SQL
Python
Rust
PyO3
Databases
TimescaleDB
PostgreSQL
AI/ML
Scikit-learn
NumPy
Statsmodels
Time Series
LLM Evaluation
+3
Apply
Top 25% payVerified live · 2 hours ago 2 months ago Likely open · 61%

Senior Backend Engineer (AI Platform)

$140k – $230k per year • Senior • 5+ years exp • Remote (United States) • Full-Time • Senior
Lua
Python
Python
SQLAlchemy
FastAPI
Celery
Pydantic
Databases
pgvector
Redis
PostgreSQL
AI/ML
Reranking
Hybrid Search
Anthropic
LLM Evaluation
LLM Guardrails
Model Context Protocol
OpenAI
RAG
LLM
DevOps
OpenTelemetry
+11
Apply
Top 25% payVerified live · 2 hours ago 2 months ago Likely open · 57%

Forward Deployed AI Engineer (Senior)

$140k – $230k per year • Senior • Hybrid (United States) • Bachelor's Degree • Full-Time • Senior
TypeScript
Python
Python
FastAPI
Pydantic
Databases
pgvector
Redis
PostgreSQL
AI/ML
Fine-tuning
Knowledge Distillation
Function Calling
NLP
Speech Recognition
Reranking
OCR
Human-in-the-Loop
Structured Outputs
LLM Evaluation
LLM Guardrails
Agentic Workflows
Model Distillation
LLM
AI Agents
LangGraph
AutoGen
CrewAI
LangChain
RAG
DevOps
Bicep
Terraform
Docker
Azure
AWS
Robotics
Digital Twin
Management
SharePoint
+26
Apply

MyConnect.ai

myconnect.ai
myconnect.ai • Hiring 1
Hiring 1
MyConnect.ai provides a robust skills & relationship management platform with data insights and purpose-driven connections.
No named decision-maker yet.
Careers mailbox is known
2 months ago Long shot · 10%

AI Engineer (AI Agent & RAG)

$13k – $19k per year (gross) • Senior • 5+ years exp • Jakarta • Remote (likely Indonesia) • Full-Time • Senior
Node JS
TypeScript
Python
JavaScript
Python
FastAPI
Databases
Weaviate
pgvector
Pinecone
Qdrant
PostgreSQL
AI/ML
LangGraph
LlamaIndex
Embeddings
Function Calling
LangSmith
CrewAI
Reranking
Structured Outputs
LLM Evaluation
LangChain
Prompt Engineering
RAG
LLM
AI Agents
Management
n8n
+17
Apply
Report
mymvw.com • HQ: Orlando, United States • Hotels & Resorts • Vacation Rentals • 1001-5000 employees • Est. 2011 • Trust B • Hiring 404, 64 new
HQ: Orlando, United States • Hotels & Resorts • Vacation Rentals • 1001-5000 employees • Est. 2011 • Trust B • Hiring 404, 64 new
Marriott Vacations Worldwide is an American vacation ownership company spun off from Marriott International in 2011 that develops, sells and manages timeshare resorts under the Marriott Vacation Club, Sheraton Vacation Club, Westin Vacation Club and Hyatt Vacation Club brands. It also runs the Interval International exchange network and points-based programmes that let owners stay at resorts across North America, the Caribbean, Europe and Asia. It hires vacation sales staff, housekeepers, maintenance technicians and engineers for resorts in Hawaii, Florida, Thailand and elsewhere. The company is headquartered in Orlando, Florida, United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 2 months ago Long shot · 12%

Sr Cloud Engineer

≈ $111k – $212k per year (Estimated) • Senior • 7+ years exp • In office (United States) • Bachelor's Degree • Full-Time • Senior
Python
Apex
Apex
MuleSoft
Databases
Microsoft Fabric
Apache Kafka
AI/ML
Function Calling
AWS Bedrock
Anthropic
Structured Outputs
LLM Evaluation
Claude Code
Claude
Copilot
LLM
AI Agents
DevOps
Red Hat
OpenShift
Helm
Kustomize
GitOps
ArgoCD
Configuration Management
Bitbucket
Progressive Delivery
FinOps
Platform Engineering
Ansible
GitHub
Terraform
Kubernetes
Azure
AWS
Windows Server
Tekton
Backstage
AIOps
VMWare
Azure DevOps
SLI/SLO/SLA
Rest API
Windows
CI/CD
Cybersecurity
Zero Trust
+35
Apply

Pavago

pavago.co
pavago.co • HQ: Dubai, United Arab Emirates • Employer of Record & PEO • Recruiting & Staffing • Staffing · EOR • Trust B • Hiring 877, 137 new
HQ: Dubai, United Arab Emirates • Employer of Record & PEO • Recruiting & Staffing • Staffing · EOR • Trust B • Hiring 877, 137 new
Pavago is a remote staffing company that recruits and places full-time offshore employees with small and mid-sized businesses in the United States, Canada and the United Kingdom. It sources candidates from Latin America, South Asia, Africa and the Philippines for roles in customer support, sales development, bookkeeping, virtual assistance, marketing, recruiting and back-office operations, handling screening, contracting and payroll on the client's behalf. The company operates as a distributed organisation, bills a recurring fee per placed employee rather than a one-off placement fee, and posts a continuous stream of remote vacancies for its client base.
No named decision-maker yet.
Careers mailbox is known
Verified live · 8 hours ago 2 months ago Long shot · 16%

Developer

≈ $42k – $116k per year (Estimated) • Remote (South Africa, EST hours)
TypeScript
SQL
JavaScript
Databases
PostgreSQL
Supabase
AI/ML
AI Agents
LLM Evaluation
Multi-Agent Systems
Claude Code
RAG
Frontend
Next.js
React.js
Tailwind CSS
Mobile
Twilio
DevOps
Vercel
GitHub
CI/CD
Management
Zapier
QA
Playwright
Vitest
k6
+13
Apply

Zeitview

zeitview.com
zeitview.com • HQ: Los Angeles, United States • Robotics • Drones & UAVs • Artificial Intelligence • Energy & Utilities • 51-200 employees • Startup • Hiring 23, 6 new
HQ: Los Angeles, United States • Robotics • Drones & UAVs • Artificial Intelligence • Energy & Utilities • 51-200 employees • Startup • Hiring 23, 6 new
For global customers in energy and infrastructure, Zeitview builds advanced inspection software that delivers fast, accurate insights, lowers costs, and improves asset performance and longevity. We are second to none at partnering with our customers to achieve flexible, long-term solutions across their multiple asset classes. Headquartered in Santa Monica, CA, Zeitview serves customers in the solar, wind, insurance, construction, roofing, real estate, and critical infrastructure industries.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 2 months ago Fading · 27%

Senior MLOps Engineer I

$170k – $180k per year • Equity • Senior • 4+ years exp • Boston • Remote (United States) • Bachelor's Degree • Full-Time • Senior
Python
Databases
PostgreSQL
AI/ML
LLM
Machine Learning
LLM Evaluation
Computer Vision
AI Agents
Frontend
GraphQL
DevOps
Platform Engineering
GitHub Actions
Terraform
Docker
Kubernetes
CI/CD
AWS
+7
Apply

SF Tensor

sf-tensor.com
sf-tensor.com • HQ: San Francisco, United States • Cloud Platforms (IaaS & PaaS) • AI Compute & Inference • Startup • Hiring 7
HQ: San Francisco, United States • Cloud Platforms (IaaS & PaaS) • AI Compute & Inference • Startup • Hiring 7
Train the models only you can build. SF Tensor provides one optimized, cross-vendor training stack for enterprise post-training and frontier pre-training.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 3 hours ago 2 months ago Fading · 27%

Member of Technical Staff, Post-Training & Applied Research

$275k – $315k per year • Staff+ • In office (San Francisco, United States) • Relocation • Full-Time • Staff
JAX
Knowledge Distillation
Synthetic Data
DPO
SFT
PPO
GRPO
Post-training
TPU
AWS Trainium
LLM Evaluation
Model Distillation
PyTorch
Quantization
Function Calling
Speculative Decoding
+8
Apply

Town

town.com
town.com • HQ: San Francisco, United States • Artificial Intelligence • AI Agents • 11-50 employees • Startup • Hiring 12
HQ: San Francisco, United States • Artificial Intelligence • AI Agents • 11-50 employees • Startup • Hiring 12
Meet Town, the personal AI assistant that manages your inbox, schedules your meetings, and handles the busywork — working quietly in the background for you.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 1 hour ago Visa sponsor 2 months ago Fading · 28%

AI Engineer, Evals & Agent Quality

$250k – $300k per year • In office (San Francisco, United States) • Full-Time
LLM Evaluation
Apply

Onshore

onshore.com
onshore.com • HQ: New York, United States • Accounting & Tax Software • Tax Advisory & Preparation • Startup • Hiring 8
HQ: New York, United States • Accounting & Tax Software • Tax Advisory & Preparation • Startup • Hiring 8
Onshore is a financial technology company that provides an artificial intelligence platform designed to automate corporate tax credits and incentives, such as research and development tax credits. The platform combines automated data processing with expert human verification to streamline tax filings and deliver audit-ready documentation. Headquartered in New York, New York, the firm helps businesses efficiently optimize their tax strategies across various industries.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 2 hours ago 2 months ago Long shot · 16%

Staff Software Engineer

$270k per year • Equity • Staff+ • 8+ years exp • In office (New York, United States) • Full-Time • Staff
LLM Evaluation
LLM
Apply
Top 25% payVerified live · 2 hours ago 2 months ago Long shot · 13%

Senior Software Engineer

$225k per year • Equity • Senior • 5+ years exp • In office (New York, United States) • PhD • Full-Time • Senior
TypeScript
AI/ML
LLM Evaluation
LLM
DevOps
AWS
Apply

Rho

rho.co
rho.co • HQ: New York, United States • Cards & Card Issuing • Digital Banks & Neobanks • 501-1000 employees • Est. 2018 • Startup • Trust B • Hiring 42
HQ: New York, United States • Cards & Card Issuing • Digital Banks & Neobanks • 501-1000 employees • Est. 2018 • Startup • Trust B • Hiring 42
Rho is a New York financial technology company that offers startups and growth-stage businesses a single platform for business banking, corporate cards, bill pay, invoicing, treasury and expense management. Founded in 2018 as Under Technologies, Inc., it has raised more than $200 million from investors such as DFJ Growth, Dragoneer and M13, and provides accounts through partner banks rather than holding a bank charter itself. Recent openings concentrate on startup banking sales and advisors in San Francisco, Austin and Los Angeles, partnerships, financial crime and treasury roles, talent partners and IT support, plus backend engineers working in Python, Go and GraphQL.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 2 months ago Fading · 42%

Senior Data Scientist/ML

≈ $55k – $142k per year (Estimated) • Senior • 6+ years exp • Hybrid (Belgrade, Serbia) • Full-Time • Senior
SQL
Python
Databases
Snowflake
PostgreSQL
AI/ML
Feature Store
OCR
LLM Evaluation
RAG
Machine Learning
AI Agents
Dagster
MLFlow
Vertex AI
Prefect
Amazon SageMaker
DevOps
GCP
Kubernetes
Prometheus
Terraform
AWS
Analytics
A/B Testing
Power BI
+14
Apply

Vouch

vouch.us
vouch.us • HQ: San Francisco, United States • InsurTech • Property & Casualty Insurance • Insurance Brokers & Agencies • 51-200 employees • Est. 2018 • Hiring 4
HQ: San Francisco, United States • InsurTech • Property & Casualty Insurance • Insurance Brokers & Agencies • 51-200 employees • Est. 2018 • Hiring 4
Vouch is an insurance technology company that provides business insurance for startups and growing technology companies. It offers coverage such as directors and officers, cyber, general liability and employment practices liability, combining an online buying process with its own brokerage and insurance programs. The company was founded in 2018 and is headquartered in San Francisco, California, United States.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 2 hours ago Visa sponsor 2 months ago Fading · 27%

Senior Software Engineer

$180k – $200k per year • Equity • Senior • 3+ years exp • Hybrid (Chicago, United States) • PhD • Full-Time • Senior
Apex
Databases
Snowflake
PostgreSQL
AI/ML
LangGraph
Function Calling
Anthropic SDK
LLM Evaluation
Cursor
LangChain
Model Context Protocol
Claude
LLM
AI Agents
DevOps
Amazon S3
AWS
Analytics
ETL/ELT
+8
Apply

Eaton

eaton.com
eaton.com • HQ: Dublin, Ireland • Energy Management • Automotive Components • Aerospace Manufacturing • Power Supplies & Power Electronics • Electrical Equipment & Cables • 5000+ employees • Est. 1911 • Trust A • Hiring 1726, 82 new
HQ: Dublin, Ireland • Energy Management • Automotive Components • Aerospace Manufacturing • Power Supplies & Power Electronics • Electrical Equipment & Cables • 5000+ employees • Est. 1911 • Trust A • Hiring 1726, 82 new
Eaton is a power management company founded in 1911 as a truck axle maker and now incorporated in Dublin with operational headquarters in Beachwood, Ohio. Its largest business by far is electrical, supplying circuit breakers, switchgear, uninterruptible power supplies and distribution equipment, a portfolio that has become unusually valuable as data centre construction and grid electrification accelerate demand for power infrastructure. The group also builds aerospace hydraulic and fuel systems, electric vehicle powertrain components and vehicle drivetrain products, and sells the Brightlayer software suite that monitors and optimises the equipment it manufactures.
Olivier Leonetti · Chief Financial Officer · decision-maker
Craig Arnold · Executive Chairman · decision-maker
Paulo Ruiz · Chief Executive Officer · decision-maker
Joseph Eaton · Co-Founder · founder
No careers mailbox known
Top 25% payVerified live · 2 hours ago 2 months ago Fading · 31%

IT AI Senior Specialist

$130k – $190k per year • Senior • 10+ years exp • Hybrid (Raleigh, United States) • Relocation • Bachelor's Degree • Senior
Apex
TypeScript
JavaScript
SQL
Python
Apex
MuleSoft
Databases
Snowflake
AI/ML
AgentOps
Hallucination
Agentforce
Copilot Studio
Copilot
RAG
LLM
LangGraph
AutoGen
Semantic Kernel
Anthropic
LLM Evaluation
LLM Guardrails
LangChain
Model Context Protocol
Prompt Engineering
OpenAI
Claude
Machine Learning
Frontend
GraphQL
DevOps
FinOps
SLI/SLO/SLA
CI/CD
OpenTelemetry
Bicep
Azure AKS
Terraform
Docker
GCP
Kubernetes
Azure
AWS
Cybersecurity
OWASP
Analytics
Azure Data Factory
Management
Power Automate
ServiceNow
+35
Apply

Altura

altura.io
altura.io • HQ: Amsterdam, Netherlands • Retail & Pricing Analytics • Marketing & Sales AI • 11-50 employees • Est. 2020 • Startup • Hiring 4
HQ: Amsterdam, Netherlands • Retail & Pricing Analytics • Marketing & Sales AI • 11-50 employees • Est. 2020 • Startup • Hiring 4
Altura uses artificial intelligence to help companies decide which public tenders are worth bidding for. Its platform scores opportunities against a bidder's track record and drafts parts of the response. The company is headquartered in Amsterdam.
No named decision-maker yet.
No careers mailbox known
Verified live · 29 min ago 2 months ago Long shot · 22%

Senior AI Engineer

$129k – $146k per year • Senior • Hybrid (Amsterdam, Netherlands) • Full-Time • Senior
C#
JavaScript
Python
C#
ASP.NET Core
AI/ML
Embeddings
LLMOps
Structured Outputs
Context Engineering
LLM Guardrails
Agentic Workflows
Cursor
Claude Code
Copilot
LLM
AI Agents
Quantization
LLM Evaluation
Frontend
Vue.js
Nuxt.js
DevOps
Azure
CI/CD
GitHub
+14
Apply

Relling

rellingsystems.com
rellingsystems.com • HQ: San Francisco, United States • Industrial Automation • Industrial Robotics • 51-200 employees • Est. 2025 • Startup • Hiring 7
HQ: San Francisco, United States • Industrial Automation • Industrial Robotics • 51-200 employees • Est. 2025 • Startup • Hiring 7
Relling is a San Francisco startup that automates American manufacturing with AI robot workcells qualified off-site and installed on the customer floor within weeks. It was founded by SpaceX and NASA alumni to address the manufacturing labor shortage and hires a robot learning engineer along with growth, partnerships and business operations staff. The company is headquartered in San Francisco, California, United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 2 months ago Long shot · 14%

Software Engineer Intern

Intern • In office (San Francisco, United States) • Internship • Intern
C++
Python
AI/ML
DINOv2
LLM Evaluation
PyTorch
DevOps
Linux
Robotics
Imitation Learning
ROS
ROS2
Diffusion Policy
OpenVLA
+3
Apply

Caseware

caseware.com
caseware.com • HQ: Toronto, Canada • Accounting & Tax Software • Est. 1988 • Trust A • Hiring 44, 3 new
HQ: Toronto, Canada • Accounting & Tax Software • Est. 1988 • Trust A • Hiring 44, 3 new
Caseware is a software company that develops audit, accounting and financial reporting tools for accounting firms, corporations and government bodies. Its products include Caseware Working Papers for engagement files and the Caseware Cloud platform for audit, data analytics and reporting, sold in many countries through subsidiaries and regional distributors. Founded in 1988, the company is headquartered in Toronto, Ontario, Canada.
Alexandra Enescu · Geschäftsführer · decision-maker
David Marquis · Geschäftsführer · decision-maker
Careers mailbox is known
Verified live · 4 min ago 2 months ago Likely open · 48%

Senior Software Developer III

≈ $37k – $111k per year (Estimated) • Senior • 8+ years exp • Bogotá • Medellín • Remote (Colombia) • PhD • Full-Time • Senior
TypeScript
Python
Databases
DynamoDB
AI/ML
LLMOps
Human-in-the-Loop
LLM Guardrails
ISO 42001
Agentic Workflows
Multi-Agent Systems
LLM
AI Agents
Hybrid Search
LLM Evaluation
NIST AI RMF
RAG
Frontend
GraphQL
DevOps
CloudFormation
Terraform
Rest API
CI/CD
AWS
New Relic
OpenTelemetry
Amazon EKS
AWS Lambda
Amazon CloudWatch
Amazon S3
Incident Management
Prometheus
GitHub Actions
IAM
GitHub
Docker
Kubernetes
Management
Confluence
Jira
+28
Apply

Andromeda Robotics

andromedarobotics.ai
andromedarobotics.ai • HQ: Melbourne, Australia • Service & Hospitality Robotics • Senior Living & Assisted Living • 51-200 employees • Est. 2025 • Startup • Hiring 5, 1 new
HQ: Melbourne, Australia • Service & Hospitality Robotics • Senior Living & Assisted Living • 51-200 employees • Est. 2025 • Startup • Hiring 5, 1 new
Andromeda Robotics builds personalised robot companions for aged care and assisted living, bringing conversation, companionship and engagement to residents. Its first robot, Abi, is deployed in aged care and healthcare, and the company hires autonomy, embedded Linux and robot behavior engineers and robotics technicians. The company is headquartered in Melbourne, Australia.
Grace Brown · Executive Officer, Director · decision-maker
Yanqiu Chen · Executive Officer, Director · decision-maker
Eurie Kim · Director
Derek Gerrard · Director
No careers mailbox known
Top 25% payVerified live · 8 hours ago Visa sponsor 2 months ago Long shot · 24%

Lead Engineer, Robot Behavior and Decision-Making

$200k – $240k per year • Lead • In office (San Francisco, United States) • Full-Time • Staff
Rust
C++
Python
AI/ML
LLM Evaluation
Voice Agents
Vision-Language-Action
World Models
Function Calling
LLM
Robotics
ROS
Nav2
Gazebo
Isaac Sim
MuJoCo
Obstacle Avoidance
ROS2
Motion Planning
+9
Apply

OpenCall

opencall.ai
opencall.ai • HQ: San Francisco, United States • Contact Center Software • Speech & Audio AI • Conversational AI • 11-50 employees • Startup • Hiring 1
HQ: San Francisco, United States • Contact Center Software • Speech & Audio AI • Conversational AI • 11-50 employees • Startup • Hiring 1
OpenCall is a San Francisco startup that builds AI voice agents which conduct telephone conversations on behalf of businesses. Its platform automates inbound and outbound calls such as lead qualification, appointment setting and customer support, and hands complex cases over to human staff. The company is headquartered in San Francisco, California, United States.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 2 months ago Long shot · 10%

AI Prompt & Agent Developer

$90k – $145k per year • Equity 0.1–0.3% • Junior • 1+ year exp • In office (San Francisco, United States) • Bachelor's Degree • Full-Time • Junior
TypeScript
Python
AI/ML
NLP
Text-to-Speech
Human-in-the-Loop
LLM Evaluation
Voice Agents
Prompt Engineering
OpenAI
AI Agents
DSPy
Fine-tuning
Speech Recognition
Mobile
Twilio
+6
Apply
Report
Machines can read this selection · checked 04:28 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.