LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Software
Data
Security
DevOps & Cloud
Leadership
Product
Design
Hardware & Chips
Defense
Aerospace
Biotech
Energy
Robotics
MedTech

Rivian

rivian.com
rivian.com • HQ: Irvine, United States • Automotive Manufacturing • 1001-5000 employees • Est. 2009 • Trust A • Hiring 727, 207 new
HQ: Irvine, United States • Automotive Manufacturing • 1001-5000 employees • Est. 2009 • Trust A • Hiring 727, 207 new
Headquartered in Irvine, California, Rivian is an American electric vehicle manufacturer and automotive technology company. The enterprise designs and builds all-electric pickup trucks, sport utility vehicles, and commercial delivery vans tailored for both consumer adventure and commercial fleet operations. Through continuous innovation in battery technology and software-defined vehicle platforms, the business aims to accelerate the global transition to sustainable transportation.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 1 month ago Fading · 36%

Staff Software Engineer, AI Developer Productivity, Autonomy

$207k – $258k per year • Equity • Staff+ • 6+ years exp • In office (Palo Alto, United States) • Staff
Rust
Go
TypeScript
C++
Python
Databases
Databricks
AI/ML
Function Calling
Human-in-the-Loop
Multi-Agent Systems
LLM
LLM Evaluation
Model Context Protocol
DevOps
GitLab
Kubernetes
AWS
CI/CD
Analytics
A/B Testing
+9
Apply

WSP

wsp.com
wsp.com • HQ: Montreal, Canada • Civil & Structural Engineering • Engineering Services • Transport Infrastructure • 5000+ employees • Est. 1959 • Trust B • Hiring 2547, 197 new
HQ: Montreal, Canada • Civil & Structural Engineering • Engineering Services • Transport Infrastructure • 5000+ employees • Est. 1959 • Trust B • Hiring 2547, 197 new
WSP is a Canadian engineering and professional services consulting firm headquartered in Montreal that provides technical and advisory services across the full lifecycle of built and natural environment projects. Listed on the Toronto Stock Exchange with annual revenues above C$16 billion, it operates in North America, the UK, Australia, New Zealand, the Middle East and India, and its US arm is the former Parsons Brinckerhoff. It hires bridge, structural, geotechnical, electrical and substation engineers, transport planners, acoustics specialists, environmental consultants, inspectors, BIM technicians and graduates.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 1 month ago Long shot · 24%

Senior AI Engineer

≈ $25k – $50k per year (Estimated) • Senior • 3+ years exp • In office (Bengaluru, India) • Senior
Python
AI/ML
LangGraph
XGBoost
Embeddings
Scikit-learn
LightGBM
Semantic Kernel
NumPy
Hallucination
LLMOps
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Multi-Agent Systems
TensorFlow
LangChain
OpenAI
PyTorch
RAG
LLM
Machine Learning
AI Agents
Multimodal AI
Copilot Studio
DevOps
Docker
Azure
CI/CD
+19
Apply
berkley.com • HQ: Greenwich, United States • Insurance Brokers & Agencies • Property & Casualty Insurance • 1001-5000 employees • Est. 1967 • Trust A • Hiring 149, 26 new
HQ: Greenwich, United States • Insurance Brokers & Agencies • Property & Casualty Insurance • 1001-5000 employees • Est. 1967 • Trust A • Hiring 149, 26 new
W. R. Berkley Corporation is an American commercial lines property and casualty insurance holding company based in Greenwich, Connecticut, operating through roughly 60 specialised businesses focused on particular industries, products, regions or distribution channels. Founded in 1967 as a small investment management firm, it grew into one of the largest commercial lines insurers in the United States, is listed on the New York Stock Exchange and has offices in Urbandale, Wilmington, New York, Scottsdale, Hartford and Irving. It hires underwriters and underwriting managers, claims specialists, insurance rating supervisors, customer service representatives, financial analysts and product leads.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 29 min ago 1 month ago Long shot · 16%

Principal Data Scientist

$200k – $300k per year • Lead • 10+ years exp • In office (Glen Allen, United States) • Bachelor's Degree • Principal
SQL
Python
Databases
Databricks
AI/ML
LlamaIndex
MLFlow
SHAP
Vertex AI
dbt
Fine-tuning
Scikit-learn
Multimodal AI
LIME
Pandas
NumPy
Time Series
Hugging Face
Amazon SageMaker
Feature Store
LLM Evaluation
Interpretability
Agentic Workflows
TensorFlow
LangChain
Prompt Engineering
Spark
PyTorch
RAG
LLM
Machine Learning
AI Agents
DevOps
Git
Docker
GCP
Kubernetes
Azure
CI/CD
AWS
Analytics
A/B Testing
Management
Agile
+31
Apply

Next Lane

nextlane.com
nextlane.com • HQ: Tilst, Denmark • Automotive Software • 201-500 employees • Est. 2024 • Trust A • Hiring 17
HQ: Tilst, Denmark • Automotive Software • 201-500 employees • Est. 2024 • Trust A • Hiring 17
Leader in Europe, Nextlane develop digital solutions for the automotive industry connecting car manufacturers and dealers’ systems.
Kim Jeppesen · CEO & Founder · founder
No careers mailbox known
Verified live · 2 hours ago 1 month ago Hiring now · 80%

VP Software Engineering

≈ $66k – $151k per year (Estimated) • Head+ • Hybrid (Sintra, Portugal) • Full-Time • Architect • Portuguese • French • Spanish • German • English: C1
Hallucination
Human-in-the-Loop
LLM Evaluation
Claude Code
AI Agents
Apply

Coffeebeans Consulting

coffeebeans.io
coffeebeans.io • HQ: Bengaluru, India • Data Engineering & Migration Services • IT Consulting & Digital Transformation • Hiring 16, 2 new
HQ: Bengaluru, India • Data Engineering & Migration Services • IT Consulting & Digital Transformation • Hiring 16, 2 new
Empower your business with CoffeeBeans's top-notch consulting services across India and the USA. Experience our expertise in technology, product, and process consulting.
No named decision-maker yet.
Careers mailbox is known
1 month ago Fading · 26%

Senior Generative AI Engineer

≈ $21k – $48k per year (Estimated) • Senior • 6+ years exp • Bengaluru • Remote (likely India) • Senior
Python
AI/ML
LangGraph
LlamaIndex
MLFlow
Embeddings
LangSmith
Gemini
Anthropic
LLM Evaluation
LLM Guardrails
LangChain
Prompt Engineering
OpenAI
RAG
LLM
Hallucination
ChatGPT
Model Context Protocol
AI Agents
DevOps
Azure
Docker
Kubernetes
+14
Apply

MKS Vision

mksvision.com
mksvision.com • HQ: Louisville, United States • Artificial Intelligence • Information Technology • Hiring 1
HQ: Louisville, United States • Artificial Intelligence • Information Technology • Hiring 1
About Us MKS Vision is a full spectrum of Information Technology and engineering service provider. We exist to provide increased efficiencies and flexibility that accelerate business performance by adapting the latest cutting-edge technologies for our customers.
No named decision-maker yet.
Careers mailbox is known
1 month ago Long shot · 17%

Senior AI Engineer/Tech Lead

≈ $25k – $66k per year (Estimated) • Lead • 8+ years exp • In office (Bengaluru, India) • Staff
Go
Node JS
TypeScript
Python
JavaScript
AI/ML
LangGraph
AutoGen
Function Calling
AWS Bedrock
CrewAI
Hybrid Search
LLM Evaluation
LLM Guardrails
Multi-Agent Systems
Cursor
Model Context Protocol
Claude Code
RAG
LLM
Machine Learning
AI Agents
LangChain
DevOps
AWS CDK
Amazon EKS
Amazon ECS
Azure DevOps
IAM
Terraform
CI/CD
AWS
Kubernetes
Azure
Management
Monday.com
Kanban
Jira
Scrum
Agile
+29
Apply
Report

Teamtag

teamtag.com
teamtag.com • New York • Chicago • 1001-5000 employees • Hiring 43
New York • Chicago • 1001-5000 employees • Hiring 43
No named decision-maker yet.
No careers mailbox known
Verified live · 1 day ago 1 month ago Fading · 29%

AI Platform Engineer

$111k – $135k per year • Middle • 3+ years exp • Hybrid (Chicago, United States) • Relocation • Bachelor's Degree • Full-Time • Middle
Go
TypeScript
JavaScript
Python
Databases
Google BigQuery
AI/ML
Vertex AI
Embeddings
Function Calling
Gemini
Anthropic
LLMOps
LLM Evaluation
LLM Guardrails
Model Context Protocol
Claude
RAG
LLM
LlamaIndex
Google ADK
Vertex AI Agent Builder
LangChain
Copilot
DevOps
Platform Engineering
Terraform
Docker
GCP
Kubernetes
Azure
CI/CD
AWS
Grafana
Management
Confluence
Jira
QA
Sentry
+26
Apply

Rocket Companies

rocket.com
rocket.com • HQ: Detroit, United States • Personal Finance Apps & Education • Real Estate Brokerage • Mortgage Lending & Brokers • 1001-5000 employees • Est. 1985 • Hiring 226, 24 new
HQ: Detroit, United States • Personal Finance Apps & Education • Real Estate Brokerage • Mortgage Lending & Brokers • 1001-5000 employees • Est. 1985 • Hiring 226, 24 new
Rocket Companies is a Detroit-based fintech and homeownership company whose businesses provide mortgage lending, real estate brokerage, home search and personal finance services to US consumers. Its flagship business, Rocket Mortgage, was founded in 1985, the group is publicly traded, and its subsidiaries include the personal finance app Rocket Money and the online real estate brokerage Redfin. It hires executive loan officers, real estate agents, software engineers, product managers and designers, data and analytics leaders, marketing managers and financial analysts, with many roles in Detroit and across the United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 26 min ago 1 month ago Fading · 33%

Staff Software Engineer (Core Servicing Platform)

≈ $92k – $170k per year (Estimated) • Staff+ • 8+ years exp • In office (Detroit, United States) • Bachelor's Degree • Full-Time • Staff
Context Engineering
Claude Code
Copilot
AI Agents
LLM Evaluation
Cursor
RAG
LLM
DevOps
CI/CD
+1
Apply

A2Z Sync

a2zsync.com
a2zsync.com • HQ: Denver, United States • Automotive Components • Hiring 4
HQ: Denver, United States • Automotive Components • Hiring 4
Dealership Desking Tools, F&I and Menu software for automotive dealerships. A2Z Sync is the software progressive dealers choose.
No named decision-maker yet.
Careers mailbox is known
Verified live · 8 hours ago 1 month ago Fading · 36%

Staff Engineer

≈ $148k – $274k per year (Estimated) • Staff+ • Hybrid (Denver, United States) • Full-Time • Staff
PHP
TypeScript
Java
Python
JavaScript
Java
Spring Boot
PHP
Laravel
Databases
DynamoDB
Amazon Aurora
AI/ML
LangGraph
AWS Bedrock
Anomaly Detection
AWS Bedrock AgentCore
LLM Evaluation
LangChain
Model Context Protocol
LLM
AI Agents
Frontend
Next.js
React.js
DevOps
OpenTelemetry
CircleCI
CloudFormation
Datadog
PagerDuty
AWS Fargate
AWS Lambda
Progressive Delivery
Amazon ECS
Amazon CloudWatch
Amazon EventBridge
AWS Step Functions
API Gateway
SOAP
Amazon S3
IAM
SLI/SLO/SLA
Rest API
CI/CD
AWS
Cybersecurity
Snyk
Dependabot
Auth0
Analytics
ETL/ELT
QA
Playwright
+37
Apply
Verified live · 8 hours ago 2 months ago Long shot · 13%

Senior Engineer, AI/ML

$160k – $190k per year • Senior • Remote (United States) • Full-Time • Senior
Java
Python
Java
Spring Boot
Databases
DynamoDB
Amazon Aurora
AI/ML
LangGraph
AWS Bedrock
Google ADK
OpenAI Agents SDK
AWS Bedrock AgentCore
AWS Strands Agents
LLM Evaluation
LLM Guardrails
Multi-Agent Systems
Model Context Protocol
Prompt Engineering
LLM
AI Agents
Anthropic
LangChain
DevOps
OpenTelemetry
AWS Fargate
AWS Lambda
Amazon CloudWatch
Amazon EventBridge
AWS Step Functions
SOAP
Amazon S3
Rest API
CI/CD
AWS
Amazon ECS
API Gateway
Analytics
ETL/ELT
+26
Apply
caci.com • HQ: Reston, United States • Data & Analytics • Cybersecurity • Military • National Security • IT Consulting & Digital Transformation • Intelligence • Electronic Warfare • 5000+ employees • Est. 1962 • IT services • Trust D • Hiring 1849, 106 new
HQ: Reston, United States • Data & Analytics • Cybersecurity • Military • National Security • IT Consulting & Digital Transformation • Intelligence • Electronic Warfare • 5000+ employees • Est. 1962 • IT services • Trust D • Hiring 1849, 106 new
CACI International is an American technology company founded in 1962 that works almost entirely for United States defence, intelligence and federal civilian agencies. It has moved from being a conventional IT services contractor toward supplying its own technology, with a substantial expeditionary electronic warfare and signals intelligence product line, photonics and optical communications for space, and secure network modernisation. Headquartered in Reston, Virginia, the company employs more than twenty thousand people, the majority holding security clearances, and has grown through a steady programme of acquisitions that add differentiated technology rather than headcount alone.
Jeffrey MacLauchlan · Chief Financial Officer · decision-maker
John Mengucci · President & Chief Executive Officer · decision-maker
Herbert Karr · Co-Founder · founder
No careers mailbox known
Top 25% payVerified live · 1 hour ago 1 month ago Fading · 27%

AI-Assisted Cyber Analysis Specialist

$90k – $190k per year • United States • Remote (United States) • Full-Time • Top Secret
YARA
Python
AI/ML
Hallucination
Human-in-the-Loop
Structured Outputs
LLM Evaluation
NIST AI RMF
Agentic Workflows
RAG
LLM
DevOps
Splunk
Kubernetes
Azure
CI/CD
AWS
Cybersecurity
Semgrep
YARA
CodeQL
SBOM
+11
Apply

Velsera

velsera.com
velsera.com • HQ: Pune, India • Bioinformatics • Precision Medicine • Startup • Trust A • Hiring 10, 1 new
HQ: Pune, India • Bioinformatics • Precision Medicine • Startup • Trust A • Hiring 10, 1 new
Velsera is a leading provider of omics analytics solutions, powering precision medicine and enhancing the healthcare and life sciences ecosystem through data and actionable insights. With advanced genomics interpretation platforms, Velsera modernizes patient care by generating clinically actionable reports and integrating workflows on next-generation sequencing (NGS) test menus. Their AI-driven analysis and automation tools accelerate lab delivery of 'omics results, optimize workflow automation, and ensure compliance.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 1 month ago Long shot · 14%

Principal AI Engineer

≈ $158k – $281k per year (Estimated) • Lead • Remote (United States) • Full-Time • GMP / cleanroom • Principal
TypeScript
Java
Python
AI/ML
Vertex AI
AWS Bedrock
LLMOps
LLM Evaluation
LLM Guardrails
OpenAI
RAG
LLM
AI Agents
Prompt Engineering
DevOps
IAM
SLI/SLO/SLA
GCP
Azure
AWS
Cybersecurity
SOC 2
FedRAMP
HIPAA
GDPR
Management
ITSM
MedTech
21 CFR Part 11
ISO 13485
IEC 62304
IVDR
FHIR
+20
Apply

grubel

grubel.ai
grubel.ai • HQ: Munich, Germany • Startup • Hiring 3
HQ: Munich, Germany • Startup • Hiring 3
Grubel is a research lab automating the specialization loop, so that every legal matter builds its own AI — data curation, adaptation, and evaluation in a loop that trains and improves on the matter itself. Frontier performance at lower cost, beyond the frontier on complex matters.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 1 month ago Long shot · 24%

Founding Research Engineer or Research Scientist

≈ $74k – $175k per year (Estimated) • Equity • Hybrid (Munich, Tübingen, Germany) • Master's Degree • Full-Time
Fine-tuning
Reinforcement Learning
Mistral
Synthetic Data
Post-training
Human-in-the-Loop
LLM Evaluation
Agentic Workflows
LLM
Machine Learning
AI Agents
+3
Apply

TripleTen

tripleten.com
tripleten.com • HQ: Boston, United States • IT Training & Certification • Bootcamps • Est. 2019 • Trust A • Hiring 303, 11 new
HQ: Boston, United States • IT Training & Certification • Bootcamps • Est. 2019 • Trust A • Hiring 303, 11 new
TripleTen is an online technology bootcamp founded in 2019 that trains career changers for entry-level roles in software engineering, data analysis, quality assurance, cybersecurity and business intelligence. Its programmes are part-time and remote, built around project work and human code review rather than recorded lectures, and it advertises an employment guarantee that refunds tuition if a graduate does not find work within a defined period. Headquartered in Boston, it operates in the United States and Latin America and grew out of the education business originally built inside Yandex.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 1 month ago Long shot · 17%

AI & Machine Learning Teaching Expert (Part-time)

≈ $124k – $229k per year (Estimated) • Senior • 7+ years exp • Boston • Remote (United States, ET hours, 2pm - 9pm) • Part-Time • Senior • English: C1
LoRA
Fine-tuning
CrewAI
Google ADK
Hallucination
SFT
LLM Evaluation
LLM Guardrails
LangChain
Model Context Protocol
LLM
Machine Learning
AI Agents
PEFT
Management
Notion
+7
Apply
Verified live · 1 hour ago 2 months ago Long shot · 14%

AI Systems & ML Engineering Industry Expert

≈ $46k – $118k per year (Estimated) • Senior • 8+ years exp • Mexico City • Remote (Mexico, United States) • PhD • Part-Time • Senior • English: C1
LangGraph
LoRA
Fine-tuning
PEFT
CrewAI
Google ADK
Hallucination
SFT
LLM Evaluation
LLM Guardrails
LangChain
Model Context Protocol
RAG
LLM
Machine Learning
AI Agents
Transformers
DevOps
GitHub
Terraform
Kubernetes
CI/CD
AWS
+14
Apply

Klipboard

klipboard.com
klipboard.com • HQ: Hungerford, United Kingdom • ERP & Business Management Software • 51-200 employees • Est. 1976 • Trust B • Hiring 45, 9 new
HQ: Hungerford, United Kingdom • ERP & Business Management Software • 51-200 employees • Est. 1976 • Trust B • Hiring 45, 9 new
Klipboard is a business management and ERP software company with its UK head office in Hungerford, Berkshire, supplying industry-specific systems for wholesale distribution, automotive aftermarket, rental, field service, retail, transport and manufacturing businesses. Supporting customers since 1976, it reports more than 55,000 customers in over 70 countries and has offices in the UK, South Africa, the Netherlands, Belgium, Sweden, North America and Australia. It hires project managers, implementation consultants, account and enterprise sales executives, business development staff, software and applied AI engineers, product managers and finance staff.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 1 month ago Fading · 27%

Senior Applied AI Engineer – Prompting & Evaluation

≈ $33k – $85k per year (Estimated) • Senior • Hybrid (Johannesburg, South Africa) • Full-Time • Senior
Embeddings
Llama
Context Engineering
LLM Evaluation
Agentic Workflows
Cursor
Prompt Engineering
Claude
Copilot
RAG
Fine-tuning
Function Calling
Semantic Kernel
Structured Outputs
LangChain
LLM
+8
Apply

A Services company

spectrumconsultingindia.com
spectrumconsultingindia.com • Gurgaon • Chennai • Bengaluru • Recruiting & Staffing • Hiring 10, 1 new
Gurgaon • Chennai • Bengaluru • Recruiting & Staffing • Hiring 10, 1 new
Welcome to Spectrum Consulting. Businesses require relevant talent to execute their customer commitments. Prospective Job seeker's need guidance and support to get the right jobs. We reinvent ourselves, constantly, to be able to serve the needs of our stakeholders. We Care.
No named decision-maker yet.
No careers mailbox known
1 month ago Long shot · 10%

AI Engineer

≈ $11k – $29k per year (Estimated) • Junior • 2+ years exp • In office (Chennai, India) • Junior
Go
TypeScript
C++
Java
Python
Databases
Weaviate
pgvector
Pinecone
FAISS
Qdrant
PostgreSQL
AI/ML
Embeddings
Function Calling
Hallucination
Anthropic
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Cursor
OpenAI
Claude Code
Copilot
RAG
LLM
Weights & Biases
DSPy
LlamaIndex
LoRA
MLFlow
Fine-tuning
Langfuse
LangSmith
PEFT
QLoRA
Transformers
Hugging Face
SFT
LangChain
DevOps
Git
Docker
GCP
Azure
CI/CD
AWS
Cybersecurity
Threat Modeling
+37
Apply

voize

voize.com
voize.com • HQ: Berlin, Germany • EHR & Clinical Software • Speech & Audio AI • Medical AI • Est. 2020 • Startup • Trust B • Hiring 37, 4 new
HQ: Berlin, Germany • EHR & Clinical Software • Speech & Audio AI • Medical AI • Est. 2020 • Startup • Trust B • Hiring 37, 4 new
voize is a German health technology company that develops a voice assistant for nursing care, letting nurses and carers dictate observations by smartphone while its speech AI turns them into structured documentation in the care provider's records system. Founded in 2020, it serves nursing homes, home care services and hospitals, mainly in Germany, and hires backend, fullstack and speech machine learning engineers and customer training staff. The company is headquartered in Berlin, Germany.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 1 month ago Fading · 42%

Senior Backend Engineer (m/f/d) - Agent SDK

≈ $71k – $153k per year (Estimated) • Equity • Senior • Berlin • Dortmund • Göttingen • Hanover • Munich • Remote (Germany) • Full-Time • Senior
Scala
Kotlin
Java
AI/ML
OpenAI Agents SDK
LLM Evaluation
AI Agents
Apply

LTM

ltm.com
ltm.com • HQ: Mumbai, India • Information Technology • Design & Creative • Branding • Creative Agencies • Media & Entertainment • Enterprise Apps Implementation Partners • IT Outsourcing & Dedicated Teams • IT Consulting & Digital Transformation • Est. 1996 • Trust B • Hiring 584, 21 new
HQ: Mumbai, India • Information Technology • Design & Creative • Branding • Creative Agencies • Media & Entertainment • Enterprise Apps Implementation Partners • IT Outsourcing & Dedicated Teams • IT Consulting & Digital Transformation • Est. 1996 • Trust B • Hiring 584, 21 new
LTM (formerly LTIMindtree) is a prominent global technology consulting and digital solutions enterprise that delivers comprehensive IT, cloud, and business transformation services to multinational corporations. Headquartered in Mumbai, India, the company operates an extensive international delivery network specializing in artificial intelligence, data engineering, and enterprise systems integration. As a subsidiary of the industrial conglomerate Larsen & Toubro, it partners with leading organizations across sectors such as banking, healthcare, and manufacturing to drive operational efficiency and digital modernization.
No named decision-maker yet.
Careers mailbox is known
1 month ago Long shot · 19%

Application Architect - GenAI

≈ $30k – $73k per year (Estimated) • Staff+ • 12+ years exp • In office (India) • Staff
Node JS
Java
SQL
Python
C#
JavaScript
C#
.NET
Databases
Apache Kafka
AI/ML
Vertex AI
Embeddings
Function Calling
Chain-of-Thought
Llama
Mistral
AWS Bedrock
Gemini
Hallucination
Hybrid Search
Anthropic
GraphRAG
Human-in-the-Loop
Structured Outputs
Context Engineering
Knowledge Graph
LLM Evaluation
LLM Guardrails
Multi-Agent Systems
Model Context Protocol
Prompt Engineering
OpenAI
Claude
RAG
LLM
AI Agents
DevOps
GCP
Azure
CI/CD
AWS
+30
Apply
Verified live · 2 hours ago 4 months ago Long shot · 10%

Principal - Architecture

≈ $21k – $52k per year (Estimated) • Lead • 12+ years exp • In office (Chennai, India) • Principal
Node JS
Java
SQL
Python
C#
JavaScript
C#
.NET
Databases
Apache Kafka
AI/ML
Vertex AI
Embeddings
Function Calling
Chain-of-Thought
Llama
Mistral
AWS Bedrock
Gemini
Hallucination
Hybrid Search
Anthropic
GraphRAG
Human-in-the-Loop
Structured Outputs
Context Engineering
Knowledge Graph
LLM Evaluation
LLM Guardrails
Multi-Agent Systems
Model Context Protocol
Prompt Engineering
OpenAI
Claude
RAG
LLM
AI Agents
DevOps
GCP
Azure
CI/CD
AWS
+30
Apply

Cantina

cantina.com
cantina.com • HQ: San Francisco, United States • Social Networks • Multimodal AI • Generative Video • LLM & Generative AI • 51-200 employees • Est. 2023 • Startup • Trust A • Hiring 14
HQ: San Francisco, United States • Social Networks • Multimodal AI • Generative Video • LLM & Generative AI • 51-200 employees • Est. 2023 • Startup • Trust A • Hiring 14
Cantina is a social artificial intelligence technology company based in San Francisco, California, and founded in 2023. The company provides a platform where users can create, interact with, and share multimodal AI characters that feature unique personalities and the ability to generate video content. It operates primarily through a mobile application and web interface, focusing on the intersection of generative AI and social media for a global audience of creators and consumers.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 1 month ago Likely open · 46%

Research Intern

Intern • In office (Singapore) • Master's Degree • Internship • Intern
Python
AI/ML
Reinforcement Learning
JAX
Multimodal AI
Knowledge Distillation
Diffusion Models
Post-training
LLM Evaluation
Model Distillation
Reward Modeling
Computer Vision
PyTorch
Machine Learning
+5
Apply
Verified live · 2 hours ago 1 month ago Likely open · 46%

Machine Learning Intern

Intern • In office (Singapore) • Bachelor's Degree • Internship • Intern
Python
C
Python
pySpark
C
FFmpeg
AI/ML
OpenCV
Multimodal AI
Ray
Post-training
LLM Evaluation
Reward Modeling
Machine Learning
Spark
DevOps
Docker
GCP
Kubernetes
Azure
AWS
+9
Apply

Verantos

verantos.com
verantos.com • HQ: Menlo Park, United States • CRO & CDMO Services • Medical AI • 51-200 employees • Est. 2015 • Hiring 5
HQ: Menlo Park, United States • CRO & CDMO Services • Medical AI • 51-200 employees • Est. 2015 • Hiring 5
By incorporating robust clinical narrative data and artificial intelligence technology, Verantos is the first company to generate high-validity evidence at scale across therapeutic areas with measured accuracy, completeness, and traceability.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 1 month ago Fading · 39%

Senior SDET

≈ $12k – $29k per year (Estimated) • Senior • In office (Pune, India) • Bachelor's Degree • Senior
Python
SQL
Databases
Snowflake
AI/ML
Langfuse
Ragas
Hallucination
LLM Evaluation
LLM
AI Agents
DevOps
GitHub Actions
Rest API
CI/CD
AWS
Amazon ECS
Amazon CloudWatch
Amazon S3
Cybersecurity
Shift-Left Security
SOC 2
HIPAA
Analytics
ETL/ELT
QA
Playwright
Pytest
JMeter
k6
+16
Apply

Dura Digital

duradigital.com
duradigital.com • Design & Creative • Professional Services • Artificial Intelligence • 51-200 employees • Staffing · EOR • Trust B • Hiring 10
Design & Creative • Professional Services • Artificial Intelligence • 51-200 employees • Staffing · EOR • Trust B • Hiring 10
Expertise in end-to-end digital transformation services. Harnessing a unique studio model and near-shore teams, we excel in planning and executing digital solutions. Achieve your digital future with us today.
No named decision-maker yet.
Careers mailbox is known
Verified live · 9 hours ago 1 month ago Fading · 35%

AI Engineer

Middle • 3+ years exp • In office • Contractor • Middle
C#
TypeScript
JavaScript
SQL
Python
Databases
pgvector
Pinecone
ElasticSearch
PostgreSQL
AI/ML
Function Calling
Hallucination
Structured Outputs
LLM Evaluation
RAG
LLM
Fine-tuning
Multimodal AI
Knowledge Distillation
Feature Store
OCR
Model Distillation
Model Context Protocol
DevOps
GCP
Azure
CI/CD
AWS
+18
Apply
Machines can read this selection · checked 04:25 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.