LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Software
Data
Security
DevOps & Cloud
Leadership
Product
Design
Fintech
Hardware & Chips
Defense
Aerospace
Biotech
Energy
Robotics
Automotive
MedTech
Science

IFS

ifs.com
ifs.com • HQ: Linköping, Sweden • Manufacturing & Industrial Software • Field Service Management Software • ERP & Business Management Software • 5000+ employees • Est. 1983 • Trust B • Hiring 239, 30 new
HQ: Linköping, Sweden • Manufacturing & Industrial Software • Field Service Management Software • ERP & Business Management Software • 5000+ employees • Est. 1983 • Trust B • Hiring 239, 30 new
IFS is a Swedish enterprise software company founded in Linkoping in 1983 that sells applications for organisations whose value depends on physical assets and field work rather than office processes. Its Cloud product combines enterprise resource planning, asset management and field service management in one model, which suits aerospace and defence, energy and utilities, manufacturing, construction and telecommunications customers who plan maintenance, parts and technicians together. Headquartered in Linkoping and majority owned by the private equity firms EQT and Hg, it has pushed hard into industrial artificial intelligence.
Matthias Heiden · Chief Financial Officer · decision-maker
Mark Moffat · Chief Executive Officer · decision-maker
Careers mailbox is known
Verified live · 3 hours ago 1 month ago Fading · 42%

Senior Software Engineer, AI Agents

≈ $64k – $139k per year (Estimated) • Senior • Hybrid (Düsseldorf, Germany) • Full-Time • Senior
Go
Java
Python
Apex
Java
Apache Camel
Apex
MuleSoft
AI/ML
Embeddings
Pydantic AI
LLM Evaluation
LLM Guardrails
LangChain
Model Context Protocol
RAG
LLM
AI Agents
DevOps
Kong
API Gateway
Docker
Kubernetes
CI/CD
Management
n8n
+13
Apply

Circana

circana.com
circana.com • HQ: Chicago, United States • Retail & Pricing Analytics • Market Research • Trust B • Hiring 72, 3 new
HQ: Chicago, United States • Retail & Pricing Analytics • Market Research • Trust B • Hiring 72, 3 new
Circana is a market research and consumer data company headquartered in Chicago that provides point-of-sale, consumer panel and retail analytics, together with software tools that help manufacturers and retailers measure demand and plan growth. It was formed by the 2022 merger of IRI and The NPD Group, whose history goes back to 1966, and serves thousands of companies across consumer goods, retail, foodservice, technology and other industries worldwide. Circana hires data and insights analysts, retail account managers, product management directors, data engineering architects, tax analysts, item coding team leads and interns.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago Visa sponsor 1 month ago Likely open · 62%

AI Staff Engineer| Hybrid: Chicago, IL or NYC, NY

$160k – $200k per year • Staff+ • Hybrid (Chicago, New York, United States) • Staff
TypeScript
SQL
Python
AI/ML
LangGraph
Vertex AI
Google ADK
OpenAI Agents SDK
Structured Outputs
LLM Evaluation
LLM Guardrails
Model Context Protocol
Claude Code
Claude
AI Agents
Anthropic
A2A
LangChain
OpenAI
DevOps
Rest API
GCP
Azure
CI/CD
+14
Apply
Top 25% payVerified live · 2 hours ago Visa sponsor 1 month ago Likely open · 62%

AI Principal Engineer| Hybrid: Chicago, IL or NYC, NY

$200k – $250k per year • Lead • 10+ years exp • Hybrid (Chicago, New York, United States) • Principal
TypeScript
Python
AI/ML
LangGraph
Google ADK
OpenAI Agents SDK
A2A
LLM Evaluation
Model Context Protocol
Claude Code
Claude
AI Agents
Vertex AI
Embeddings
Anthropic
LangChain
OpenAI
RAG
DevOps
gRPC
Kubernetes
CI/CD
Docker
GCP
Azure
+15
Apply

Constructor Labs

constructorlabs.org
constructorlabs.org • HQ: Bremen, Germany • Quantum Science & Computing • Research Institutes • Trust B • Hiring 25
HQ: Bremen, Germany • Quantum Science & Computing • Research Institutes • Trust B • Hiring 25
Constructor Labs is the research arm of Constructor Knowledge, applying computing, software and robotics research to make scientists, teachers and students more effective. Its work is organized into Knowledge Labs, Cyber Labs and Science Labs, with institutional partners that include CERN, NUS, Carnegie Mellon and Fraunhofer. The organisation is headquartered in Bremen, Germany.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 1 month ago Fading · 26%

Internship position for World Models for Software Architecture (Constructor Fabric)

≈ $36k – $64k per year (Estimated) • Intern • In office (Bremen, Germany) • Bachelor's Degree • Internship • Intern
Python
AI/ML
DGL
Scikit-learn
Time Series
LLM Evaluation
World Models
PyTorch
LLM
Machine Learning
Robotics
Digital Twin
+2
Apply
Verified live · 1 hour ago 1 month ago Fading · 25%

PhD Position: World Models for Software Architecture Synthesis (Constructor Fabric)

≈ $17k – $26k per year (Estimated) • In office (Bremen, Germany) • Bachelor's Degree • English
Python
Rust
Kotlin
C++
Java
Python
Asyncio
Dask
AI/ML
DGL
MLFlow
Ray
GNN
LLM Evaluation
World Models
PyTorch
LLM
Machine Learning
JAX
DevOps
Linux
OpenTelemetry
Prometheus
Terraform
Docker
Kubernetes
Robotics
Digital Twin
QA
Pytest
+17
Apply

Ares Management

aresmgmt.com
aresmgmt.com • HQ: Los Angeles, United States • Private Equity • Business & SME Lending • Hedge Funds & Alternative Investments • 1001-5000 employees • Est. 1997 • Trust B • Hiring 224, 15 new
HQ: Los Angeles, United States • Private Equity • Business & SME Lending • Hedge Funds & Alternative Investments • 1001-5000 employees • Est. 1997 • Trust B • Hiring 224, 15 new
Ares Management is a global alternative investment manager with a leading presence in private credit. It invests across credit, private equity, real estate, infrastructure and secondaries, providing flexible capital to companies and assets in the Americas, Europe and Asia, and is listed on the New York Stock Exchange. The firm was founded in 1997 by Antony Ressler and partners including John Kissick and Bennett Rosenthal and is headquartered in Los Angeles.
No named decision-maker yet.
No careers mailbox known
Top 25% pay 1 month ago Fading · 27%

Principal, AI Engineer

$275k – $350k per year • Lead • 8+ years exp • Hybrid (New York, United States) • Full-Time • Principal
Python
Python
FastAPI
Databases
Delta Lake
Databricks
AI/ML
LangGraph
AutoGen
MLFlow
Cohere SDK
Langfuse
LiteLLM
Hallucination
Anthropic
A2A
Multi-Agent Systems
Model Context Protocol
OpenAI
RAG
LLM
AI Agents
Weights & Biases
Function Calling
LLM Evaluation
LangChain
DevOps
FinOps
Platform Engineering
Azure
CI/CD
Cybersecurity
Microsoft Entra ID
+20
Apply

Postman

postman.com
postman.com • HQ: San Francisco, United States • Integration & API Management • Developer Tools • 201-500 employees • Est. 2014 • Hiring 27
HQ: San Francisco, United States • Integration & API Management • Developer Tools • 201-500 employees • Est. 2014 • Hiring 27
Postman is a software company headquartered in San Francisco, California, that was founded in 2014. Its platform offers a comprehensive suite of tools for the entire API lifecycle, including design, documentation, testing, and monitoring, as well as collaborative workspaces for development teams. The company operates on a global scale, supporting over 30 million developers and the majority of Fortune 500 companies through its cloud-based and desktop applications.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 7 hours ago Visa sponsor 1 month ago Hiring now · 81%

Principal Offensive Security Engineer

$275k – $300k per year • Equity • Lead • 8+ years exp • In office (San Francisco, United States) • Full-Time • Principal
Function Calling
Red Teaming
LLM Evaluation
ISO 42001
Agentic Workflows
Multi-Agent Systems
Model Context Protocol
RAG
LLM
AI Agents
Frontend
GraphQL
DevOps
gRPC
Kubernetes
CI/CD
AWS
Cybersecurity
SOC 2
FedRAMP
OWASP
ISO 27001
Okta
SentinelOne
Wiz
HIPAA
QA
Postman
+16
Apply

EnCharge AI

enchargeai.com
enchargeai.com • HQ: Bengaluru, India • AI Chips & Accelerators • Processors, MCUs & AI Chips • 51-200 employees • Est. 2022 • Startup • Trust C • Hiring 25, 1 new
HQ: Bengaluru, India • AI Chips & Accelerators • Processors, MCUs & AI Chips • 51-200 employees • Est. 2022 • Startup • Trust C • Hiring 25, 1 new
AI Compute from the Edge-to-Cloud for Every Business. Transformative technology for AI computation, breaking records in efficiency and sustainability to enable state-of-the-art models uninhibited by power, space, and cost constraints.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 1 month ago Fading · 39%

AI Software Engineer, Agent Harness

≈ $52k – $116k per year (Estimated) • Staff+ • 10+ years exp • India • Remote (India) • Staff
Rust
Go
C++
Python
AI/ML
Quantization
Function Calling
LLM Evaluation
Model Context Protocol
RAG
LLM
Mixture of Experts
+3
Apply

First American

firstam.com
firstam.com • HQ: Santa Ana, United States • Real Estate Appraisal • Property & Casualty Insurance • 1001-5000 employees • Est. 1889 • Trust B • Hiring 184, 28 new
HQ: Santa Ana, United States • Real Estate Appraisal • Property & Casualty Insurance • 1001-5000 employees • Est. 1889 • Trust B • Hiring 184, 28 new
First American Financial Corporation is an American provider of title insurance, settlement and escrow services for residential and commercial real estate transactions. Founded in 1889 in Orange County, California, it also supplies property data and title plant products, valuation services, mortgage subservicing, home warranty products and banking, trust and wealth management services, and is listed on the New York Stock Exchange. The company is headquartered in Santa Ana, California, United States.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 1 month ago Fading · 26%

Senior Software Engineer - Remote

≈ $111k – $192k per year (Estimated) • Equity • Senior • 5+ years exp • Santa Ana • Remote (United States) • Full-Time • Senior
Fine-tuning
Function Calling
Hallucination
LLM Evaluation
LLM Guardrails
Cursor
Prompt Engineering
Claude Code
Copilot
LLM
AI Agents
DevOps
CI/CD
+4
Apply

Tower Research Capital

tower-research.com
tower-research.com • HQ: New York, United States • Hedge Funds & Alternative Investments • 501-1000 employees • Est. 1998 • Trust B • Hiring 97, 5 new
HQ: New York, United States • Hedge Funds & Alternative Investments • 501-1000 employees • Est. 1998 • Trust B • Hiring 97, 5 new
Tower Research Capital is a quantitative trading firm operating automated strategies globally. It builds its own trading infrastructure, exchange connectivity and research systems. The firm supports multiple independent trading teams under one platform.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 16 min ago Visa sponsor 1 month ago Likely open · 56%

Senior Data Analyst

$230k – $250k per year • Senior • 3+ years exp • Hybrid (New York, United States) • Bachelor's Degree • Senior
Rust
C++
Java
SQL
Python
Databases
Google BigQuery
Snowflake
Databricks
Apache Kafka
AI/ML
Dagster
Fine-tuning
Scikit-learn
Knowledge Distillation
NLP
Pandas
NumPy
Anomaly Detection
Hugging Face
Human-in-the-Loop
LLM Evaluation
Agentic Workflows
Model Distillation
Spark
PyTorch
RAG
LLM
Machine Learning
AI Agents
DevOps
Amazon S3
Windows
GCP
AWS
Analytics
Dimensional Modeling
Management
Confluence
+26
Apply
Top 25% payVerified live · 16 min ago Visa sponsor 1 month ago Likely open · 55%

Data Analyst

$150k – $180k per year • Hybrid (New York, United States) • Master's Degree
SQL
Python
Databases
Google BigQuery
Snowflake
Databricks
AI/ML
Dagster
Scikit-learn
NLP
Anomaly Detection
Human-in-the-Loop
LLM Evaluation
Machine Learning
DevOps
Windows
Git
GCP
AWS
+8
Apply

The Home Depot

homedepot.com
homedepot.com • HQ: Atlanta, United States • Building Materials • Tools & DIY Supplies • Kitchens, Bathrooms & Home Improvement • 5000+ employees • Est. 1978 • NYSE: HD • Trust B • Hiring 732, 79 new
HQ: Atlanta, United States • Building Materials • Tools & DIY Supplies • Kitchens, Bathrooms & Home Improvement • 5000+ employees • Est. 1978 • NYSE: HD • Trust B • Hiring 732, 79 new
The Home Depot is an American home improvement retailer founded in 1978 whose founders set out to build warehouse-format stores stocking far more than traditional hardware shops could hold. It operates more than two thousand stores across the United States, Canada and Mexico, selling building materials, tools, appliances, garden supplies and decor to consumers while deriving a large and growing share of sales from professional contractors served through dedicated sales teams and distribution centres. Headquartered in Atlanta and a component of the Dow Jones Industrial Average, it acquired the building products distributor SRS in 2024 to deepen its position with professional customers.
Ted Decker · Chair, President and Chief Executive Officer · decision-maker
Arthur Blank · Co-founder · founder
Bernie Marcus · Co-founder · founder
No careers mailbox known
Verified live · 1 day ago 1 month ago Fading · 31%

Sr Data Scientist - AI Engineer

≈ $121k – $232k per year (Estimated) • Senior • 6+ years exp • In office (Atlanta, United States) • Bachelor's Degree • Full-Time • Senior
SQL
Python
AI/ML
Embeddings
LLMOps
AI Agents
Function Calling
Anomaly Detection
A2A
Human-in-the-Loop
Structured Outputs
LLM Evaluation
LLM Guardrails
Model Context Protocol
RAG
LLM
Machine Learning
DevOps
AIOps
Docker
GCP
Kubernetes
CI/CD
+13
Apply
Verified live · 1 day ago 1 month ago Long shot · 21%

Cybersecurity Software Engineer II | ML & AI (Remote)

$90k – $140k per year • Middle • 1+ year exp • United States • Remote (United States) • Bachelor's Degree • Full-Time • Middle
TypeScript
JavaScript
SQL
Python
Databases
Google BigQuery
AI/ML
LangGraph
Vertex AI
Embeddings
Function Calling
Gemini
Google ADK
Hallucination
LLM Evaluation
LLM Guardrails
Multi-Agent Systems
LangChain
Prompt Engineering
Model Context Protocol
RAG
LLM
AI Agents
DevOps
Google Cloud Run
Git
GCP
Azure
CI/CD
AWS
Cybersecurity
MITRE ATT&CK
Management
Agile
+21
Apply

Valarian

valarian.com
valarian.com • HQ: London, United Kingdom • AI Governance & Compliance • 51-200 employees • Est. 2020 • Startup • Trust A • Hiring 10, 4 new
HQ: London, United Kingdom • AI Governance & Compliance • 51-200 employees • Est. 2020 • Startup • Trust A • Hiring 10, 4 new
Valarian gives organisations the control architecture required for high-consequence operations and increasingly capable systems. Built in Britain by operators who have seen what breaks.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 1 month ago Likely open · 68%

AI Engineer (Harness)

Hybrid (London, United Kingdom) • Full-Time
Python
AI/ML
Function Calling
Structured Outputs
LLM Evaluation
LLM Guardrails
Prompt Engineering
LLM
Machine Learning
AI Agents
LangGraph
AutoGen
Promptfoo
Ragas
LangChain
DevOps
Kubernetes
Cybersecurity
Zero Trust
Least Privilege
+9
Apply

Nablon AI

nablon.ai
nablon.ai • HQ: Bengaluru, India • AI Agents • 51-200 employees • Est. 2025 • Likely startup • Hiring 5, 2 new
HQ: Bengaluru, India • AI Agents • 51-200 employees • Est. 2025 • Likely startup • Hiring 5, 2 new
Nablon is an AI-powered tech company that builds intelligent, autonomous agent systems that transform enterprise workflows across industries by going beyond simple task automation.
No named decision-maker yet.
Careers mailbox is known
1 month ago Long shot · 19%

AI Engineer

≈ $13k – $33k per year (Estimated) • Junior • 2+ years exp • In office (Bengaluru, India) • Junior
Python
Databases
Snowflake
Databricks
AI/ML
Function Calling
LLM Evaluation
Agentic Workflows
Multi-Agent Systems
RAG
AI Agents
DevOps
Azure
AWS
+3
Apply

Xenon Seven

xenon7.com
xenon7.com • HQ: New York, United States • AI Consulting & Integration • Likely startup • Trust B • Hiring 15, 1 new
HQ: New York, United States • AI Consulting & Integration • Likely startup • Trust B • Hiring 15, 1 new
Xenon7 is a leading brand specializing in implementing Artificial Intelligence (AI) solutions for various industries. With a team of human experts, Xenon7 offers exclusive content and services to help businesses leverage AI effectively. By subscribing to Xenon7, organizations can revolutionize data-driven decisions, optimize operations, drive innovation, uncover new opportunities, improve products, automate tasks, enhance cybersecurity, and personalize customer experiences. AI is the essential innovation backbone that businesses need to stay competitive and thrive in the ever-changing market landscape. Xenon7's capabilities span across seven hubs, catering to a wide range of industries. Partnering with Xenon7 means tapping into a wealth of knowledge and experience to navigate the dynamic business landscape successfully. For quality AI services and strategic partnerships, choose Xenon7 as your trusted advisor. Visit their website to learn more about how they can help your business succeed.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 1 month ago Fading · 25%

Forward Deployment Engineer

Hybrid (Barcelona, Valencia, Zaragoza, Girona, Sant Cugat del Vallès, Spain)
SQL
Python
Python
Flask
FastAPI
Databases
Chroma
Pinecone
FAISS
Databricks
AI/ML
LangGraph
LlamaIndex
LangSmith
Streamlit
Hallucination
LLM Evaluation
LangChain
Prompt Engineering
RAG
LLM
AI Agents
Fine-tuning
Anthropic
OpenAI
DevOps
Datadog
Cortex
Platform Engineering
Rest API
Git
GCP
Azure
CI/CD
AWS
Prometheus
Game Dev
Pure Data
Management
Oracle ERP
Life Sciences
Veeva
+27
Apply

Cognizant

cognizant.com
cognizant.com • HQ: Teaneck, United States • Cloud Consulting & Migration • Engineering Services • IT Outsourcing & Dedicated Teams • IT Consulting & Digital Transformation • Systems Integrators • 5000+ employees • Est. 1994 • IT services • Trust A • Hiring 1292, 259 new
HQ: Teaneck, United States • Cloud Consulting & Migration • Engineering Services • IT Outsourcing & Dedicated Teams • IT Consulting & Digital Transformation • Systems Integrators • 5000+ employees • Est. 1994 • IT services • Trust A • Hiring 1292, 259 new
Cognizant is an American information technology services and consulting company founded in 1994 as an in-house technology unit of Dun and Bradstreet in Chennai, India, and headquartered in Teaneck, New Jersey. It builds, integrates and operates software and infrastructure for large enterprises, with particularly deep positions in healthcare, financial services, insurance and life sciences, delivered by a global workforce of more than three hundred thousand people concentrated in India. Listed on Nasdaq, the company competes with the large Indian and global systems integrators and has reoriented its offerings around cloud migration, data platforms and AI-assisted engineering.
Jatin Dalal · Chief Financial Officer · decision-maker
Ravi Kumar · Chief Executive Officer · decision-maker
Kumar Mahadeva · Founder & former Chief Executive Officer · founder
Francisco D'Souza · Co-Founder & former Chief Executive Officer · founder
Careers mailbox is known
Verified live · 2 hours ago 1 month ago Long shot · 23%

GenAI Engineer (Architect)

≈ $24k – $50k per year (Estimated) • Staff+ • 5+ years exp • Mumbai • Remote (India) • Full-Time • Architect
TypeScript
Python
Databases
pgvector
Pinecone
OpenSearch
ElasticSearch
PostgreSQL
AI/ML
LlamaIndex
Vertex AI
AWS Bedrock
Hallucination
Reranking
LLM Evaluation
LangChain
OpenAI
Copilot
RAG
LLM
DevOps
GCP
Azure
AWS
+13
Apply

Cheiron

cheiron.bio
cheiron.bio • Seoul • Los Altos • LLM & Generative AI • Medical AI • 51-200 employees • Startup • Trust A • Hiring 9
Seoul • Los Altos • LLM & Generative AI • Medical AI • 51-200 employees • Startup • Trust A • Hiring 9
Cheiron is a domain-tuned AI engine for biomedical and pharmaceutical professionals, delivering fast, verifiable, and context-aware insights across research, clinical, medical affairs, and regulatory workflows.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 1 month ago Hiring now · 74%

Associate Product Manager, Technical (Los Altos)

≈ $86k – $175k per year (Estimated) • Junior • In office (Los Altos, United States) • Full-Time • Junior
Knowledge Graph
LLM Evaluation
Agentic Workflows
Cursor
Claude Code
LLM
AI Agents
Apply

Airwallex

airwallex.com
airwallex.com • HQ: Singapore • Cards & Card Issuing • Currency Exchange & FX Payments • Payment Processing & Gateways • 1001-5000 employees • Est. 2015 • Trust A • Hiring 493, 37 new
HQ: Singapore • Cards & Card Issuing • Currency Exchange & FX Payments • Payment Processing & Gateways • 1001-5000 employees • Est. 2015 • Trust A • Hiring 493, 37 new
Airwallex is a financial technology company founded in Melbourne in 2015 that builds cross-border payment and treasury infrastructure for businesses. It holds payment and money transfer licences in a large number of jurisdictions, which lets customers open local currency accounts, collect and pay out in dozens of currencies, issue cards and embed those capabilities through APIs rather than assembling bank relationships themselves. The company moved its headquarters to Singapore, serves marketplaces, software platforms and international ecommerce sellers, and has raised more than a billion dollars from growth investors.
Max Li · Co-founder and Chief Technology Officer · decision-maker
Jack Zhang · Co-founder and Chief Executive Officer · decision-maker
Xijing Dai · Co-founder · founder
Lucy Liu · Co-founder · founder
No careers mailbox known
Verified live · 1 hour ago 1 month ago Hiring now · 75%

Software Engineer, Quality

≈ $50k – $140k per year (Estimated) • In office (Singapore) • Full-Time
LLM Evaluation
LLM Guardrails
LLM
DevOps
Rest API
CI/CD
Management
Agile
QA
Pact
Apply

OKX

okx.com
okx.com • HQ: Singapore • Crypto Wallets • Cryptocurrencies • Crypto Exchanges • 1001-5000 employees • Est. 2017 • Trust A • Hiring 314, 13 new
HQ: Singapore • Crypto Wallets • Cryptocurrencies • Crypto Exchanges • 1001-5000 employees • Est. 2017 • Trust A • Hiring 314, 13 new
OKX is a global cryptocurrency exchange and Web3 technology company founded in 2017 and among the largest venues by trading volume. It offers spot, margin, futures, options and perpetual swap markets across hundreds of digital assets, alongside earn products, copy trading and institutional custody and prime services. The company also runs one of the most used self-custodial wallets and a decentralised exchange aggregator that connects to dozens of chains, and it operates the OKB token and the X Layer network, with major operational hubs in Singapore, Hong Kong, Dubai and San Jose.
Star Xu · Founder & Chairman · decision-maker
Roshan Robert · Chief Executive Officer, OKX United States · decision-maker
Hong Fang · President · decision-maker
No careers mailbox known
Verified live · 2 hours ago 1 month ago Hiring now · 81%

Product Director, Localisation & AI Evals

≈ $129k – $309k per year (Estimated) • Head+ • In office (Hong Kong, Singapore) • Architect
Human-in-the-Loop
LLM Evaluation
Multi-Agent Systems
LLM
AI Agents
Apply
Verified live · 2 hours ago 3 months ago Likely open · 48%

Senior Product Manager, Multilingual AI and Evals

≈ $80k – $160k per year (Estimated) • Senior • 3+ years exp • In office (Singapore) • Bachelor's Degree • Senior • Chinese
Fine-tuning
Hallucination
LLM Evaluation
AI Agents
Mobile
MVP
Apply

atomic

atomic.ae
atomic.ae • Charlotte • Atlanta • Dallas • San Francisco • Miami • Real Estate Brokerage • Property Management • Real Estate • 51-200 employees • Est. 2009 • Hiring 7
Charlotte • Atlanta • Dallas • San Francisco • Miami • Real Estate Brokerage • Property Management • Real Estate • 51-200 employees • Est. 2009 • Hiring 7
About us Home About Us Atomic Properties Atomic Properties established in 2009, has grown into a leading property brokerage, investment, and consultancy company. The company owner, Mr.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 2 hours ago 1 month ago Hiring now · 73%

Founding Forward Deployed Engineer

$200k – $250k per year • United States • Remote (United States) • Full-Time
Jupyter Notebook
Gemini
LLM Evaluation
LLM Guardrails
Claude
RAG
LLM
Apply
lilly.com • HQ: Indianapolis, United States • Oncology Therapeutics • Cardiometabolic Therapeutics • Prescription Drugs • 5000+ employees • Est. 1876 • Trust B • Hiring 498, 108 new
HQ: Indianapolis, United States • Oncology Therapeutics • Cardiometabolic Therapeutics • Prescription Drugs • 5000+ employees • Est. 1876 • Trust B • Hiring 498, 108 new
Eli Lilly and Company, known as Lilly, is an American pharmaceutical company headquartered in Indianapolis, Indiana, that discovers, develops and manufactures medicines for diabetes, obesity, cancer, immunology and neuroscience. Founded in 1876 by pharmacist Eli Lilly, it employs more than 50,000 people, sells its products in about 125 countries and runs manufacturing and research sites in places such as Limerick, Cork, Alcobendas, Concord and Kobe. Its openings span pharmaceutical sales territory managers, formulation operators, software engineers and AI architects, finance and marketing staff, and a large programme of interns and apprentices.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 day ago 1 month ago Fading · 29%

Principle SDET

≈ $22k – $50k per year (Estimated) • Staff+ • 10+ years exp • In office (Hyderabad, India) • Bachelor's Degree • Full-Time • GMP / cleanroom • Staff
TypeScript
Java
Python
AI/ML
Human-in-the-Loop
LLM Evaluation
AI Agents
DevOps
Splunk
OpenTelemetry
SLI/SLO/SLA
GitHub Actions
Azure DevOps
Jenkins
Terraform
Kubernetes
CI/CD
AWS
Azure
Cybersecurity
Shift-Left Security
HIPAA
Management
ITSM
ServiceNow
QA
Selenium
Playwright
Postman
Rest-Assured
Pytest
k6
Locust
+20
Apply

E Source

esource.com
esource.com • HQ: Boulder, United States • Power Grid • Market Research • Management Consulting • Est. 1986 • Trust B • Hiring 15, 2 new
HQ: Boulder, United States • Power Grid • Market Research • Management Consulting • Est. 1986 • Trust B • Hiring 15, 2 new
E Source is a research, consulting and data science firm serving electric, gas and water utilities in North America. It provides market research, benchmarking, customer experience studies, energy efficiency program support, grid and transmission planning consulting and analytics that help utilities make operational and customer decisions. The company is headquartered in Boulder, Colorado, United States.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 1 month ago Likely open · 55%

Forward Deployed AI/ML Engineer IV

$175k – $200k per year • Senior • 5+ years exp • In office (United States) • Bachelor's Degree • Full-Time • Senior
Scala
TypeScript
Java
SQL
Python
JavaScript
Databases
Databricks
AI/ML
Fine-tuning
Knowledge Distillation
Gradio
Streamlit
Anomaly Detection
LLMOps
Knowledge Graph
LLM Evaluation
Multi-Agent Systems
Model Distillation
Spark
RAG
LLM
Machine Learning
AI Agents
Frontend
GraphQL
React.js
DevOps
Rest API
Git
Docker
GCP
Azure
CI/CD
AWS
+23
Apply

Pax8

pax8.com
pax8.com • HQ: Greenwood Village, United States • IT Resellers & VARs • Marketplaces • Est. 2012 • Startup • Trust A • Hiring 49, 5 new
HQ: Greenwood Village, United States • IT Resellers & VARs • Marketplaces • Est. 2012 • Startup • Trust A • Hiring 49, 5 new
Pax8 is a US cloud marketplace company headquartered in Greenwood Village, Colorado, that sells and manages cloud software, security products and AI agents for managed service providers and the small and mid-sized businesses they serve. Founded in 2012, it offers hundreds of software vendors through the Pax8 Marketplace and Agent Store, which the company says is used by more than 47,000 partners serving over 800,000 small businesses, and it operates across North America, EMEA and Australia and New Zealand. It hires channel account managers, partner development and sales staff, customer success managers, product leaders and software, QA and identity engineers, many of them remote.
Nick Heddy · Executive Officer · decision-maker
Craig Foster · Executive Officer · decision-maker
Scott Chasin · Executive Officer, Director · decision-maker
Puneet Pamnani · Executive Officer · decision-maker
Careers mailbox is known
Verified live · 4 hours ago Visa sponsor 1 month ago Fading · 30%

Director of Product Management - Agentic Platform Enablement Experience (APEX)

≈ $177k – $318k per year (Estimated) • Equity • Head+ • 3+ years exp • United States • Remote (United States) • Bachelor's Degree • Architect
Function Calling
OpenAI Agents SDK
Human-in-the-Loop
LLM Evaluation
Computer Use
Claude
Copilot
AI Agents
LLM
Analytics
A/B Testing
Design
Figma
+3
Apply
Machines can read this selection · checked 16:09 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.