LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

ARSIEM

arsiem.com
arsiem.com • HQ: Baltimore, United States • IT Consulting & Digital Transformation • National Security • Custom Software Development • Information Security • 51-200 employees • Est. 2013 • Trust C • Hiring 46, 1 new
HQ: Baltimore, United States • IT Consulting & Digital Transformation • National Security • Custom Software Development • Information Security • 51-200 employees • Est. 2013 • Trust C • Hiring 46, 1 new
ARSIEM Corporation is a US government contractor that delivers cybersecurity, enterprise architecture, applications development, embedded software development and software test and evaluation services to Department of Defense and intelligence community customers. Founded in 2013 by chief executive R. Chuck Matthews, the company supports several federal agencies, with much of its current work for a government client in Arlington, Virginia, in cyber defence, forensics and lab infrastructure. It hires information systems security engineers, host and network systems analysts, incident handlers, embedded systems researchers, lab managers and cyberspace operations instructors.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 4 months ago Fading · 33%

AI Engineer – SME

$222k – $239k per year • Staff+ • 18+ years exp • In office (Columbia, United States) • Bachelor's Degree • Full-Time • Architect
Python
JavaScript
TypeScript
AI/ML
LangGraph
AutoGen
LangChain
LlamaIndex
Prompt Engineering
Function Calling
AI Agents
Haystack
Semantic Kernel
CrewAI
LLM
RAG
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
Embeddings
Human-in-the-Loop
+13
Apply

Qventus

qventus.com
qventus.com • HQ: Mountain View, United States • Medical AI • Hospital Operations Software • 201-500 employees • Est. 2012 • Startup • Trust A • Hiring 12
HQ: Mountain View, United States • Medical AI • Hospital Operations Software • 201-500 employees • Est. 2012 • Startup • Trust A • Hiring 12
Qventus uses machine learning and behavioural science to automate hospital operations such as operating room scheduling and discharge planning. Founded in 2012 in California, it plugs into electronic health records and nudges staff with concrete next actions. Its customers include many of the largest American health systems.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago Visa sponsor 4 months ago Long shot · 20%

AI Tooling Engineer

$120k – $150k per year • Equity • Junior • 1+ year exp • United States • Remote (United States) • Junior
Python
TypeScript
AI/ML
Copilot
LangChain
AI Agents
LLM
RAG
LLM Evaluation
Machine Learning
Management
Slack
Notion
Jira
+4
Apply

Multi Bank Group

multibankgroup.com
multibankgroup.com • HQ: Dubai, United Arab Emirates • Online Brokerage & Trading Platforms • Forex & CFD Brokers • Trust C • Hiring 13
HQ: Dubai, United Arab Emirates • Online Brokerage & Trading Platforms • Forex & CFD Brokers • Trust C • Hiring 13
Join 2M+ traders who trust MultiBank Group — a globally regulated broker offering CFDs on FX, crypto, and more with advanced technology and deep liquidity.
No named decision-maker yet.
No careers mailbox known
Likely inactiveVerified live · 2 hours ago 4 months ago Long shot · 3%

AI Engineer – Generative AI and Automation

Junior • 2+ years exp • In office (Dubai, United Arab Emirates) • Bachelor's Degree • Full-Time • Junior
Python
JavaScript
TypeScript
Python
FastAPI
Databases
Weaviate
Chroma
pgvector
Pinecone
Qdrant
PostgreSQL
AI/ML
LangGraph
AutoGen
Weights & Biases
LangChain
Claude
Airflow
LlamaIndex
Model Context Protocol
AI Agents
Haystack
Helicone
LangSmith
Semantic Kernel
Mistral
CrewAI
Gemini
LLM
RAG
Semantic Search
OpenAI
Anthropic
GPT-4
Human-in-the-Loop
Semantic Search
LLM Evaluation
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
Tool Use
DevOps
Rest API
GCP
Azure
CI/CD
AWS
Docker
Management
n8n
Zapier
Make.com
+40
Apply

Holocene

holocene.eu
holocene.eu • HQ: Berlin, Germany • Logistics • Freight Forwarding • 51-200 employees • Est. 2022 • Hiring 2
HQ: Berlin, Germany • Logistics • Freight Forwarding • 51-200 employees • Est. 2022 • Hiring 2
Holocene is a leading brand in the field of logistics and supply chain automation. With their AI-enabled tools, they bring unparalleled visibility to your business processes, allowing for faster decision-making and improved efficiency. By breaking down knowledge silos and optimizing execution and communication across the supply chain, Holocene helps you increase speed, reduce costs, and bring accountability to your operations. Their connected supply chain creates streamlined end-to-end processes, cutting costs in procurement, supply chain, and distribution. Holocene's analysis capabilities and proactive alerts help reduce operational costs and penalties, saving your organization time and money. By forging better relationships with suppliers through real-time collaboration, Holocene enables you to accelerate time-to-market and deliver unbeatable quality. With their automated and connected digital infrastructure, Holocene drives commercial growth and facilitates targeted initiatives and workforce improvements. Their scalable and interoperable digital tools eliminate the need to hire more people or outsource operations, ensuring top and bottom-line security. Holocene's automation capa
No named decision-maker yet.
Careers mailbox is known
Open 139 daysVerified live · 5 hours ago 4 months ago Long shot · 9%

Senior QA Engineer

≈ $30k – $86k per year (Estimated) • Senior • 3+ years exp • In office (Kosovo) • Full-Time • Senior
Python
TypeScript
JavaScript
Node JS
Node JS
Prisma
AI/ML
Langfuse
LLM
LLM Evaluation
OCR
Frontend
Next.js
React.js
QA
Playwright
+4
Apply
iovance.com • HQ: San Carlos, United States • Cell & Gene Therapy • Biologics & Biosimilars • Oncology Therapeutics • Est. 2007 • NASDAQ: IOVA • Hiring 16
HQ: San Carlos, United States • Cell & Gene Therapy • Biologics & Biosimilars • Oncology Therapeutics • Est. 2007 • NASDAQ: IOVA • Hiring 16
Iovance Biotherapeutics is a leading brand that is revolutionizing cancer treatment through its pioneering approach. Their mission is to develop and deliver tumor infiltrating lymphocyte (TIL) therapy, leveraging the power of the human immune system to recognize and attack cancer cells in each patient. With their late-stage TIL product candidate, lifileucel, they aim to create the first approved one-time cell therapy for solid tumor cancer, specifically metastatic melanoma. Iovance's TIL platform has shown promising results in clinical trials for various solid tumors. The company is committed to continuous innovation in cell therapy, including gene-edited cell therapy, providing hope for cancer patients. As a patient-centric and collaborative organization, Iovance values integrity, agility, innovation, collaboration, and excellence in everything they do. Their dedicated and experienced management team is at the forefront of this ground-breaking work. Please note that TIL therapy is still investigational and has not been approved by the FDA or any other regulatory agency.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago Visa sponsor 5 months ago Long shot · 13%

Principal AI Systems Engineer

$175k – $200k per year • Lead • 10+ years exp • Remote (United States) • Bachelor's Degree • Principal
Python
Databases
ElasticSearch
OpenSearch
Amazon Redshift
AI/ML
Claude
Model Context Protocol
AI Agents
AWS Bedrock
Gemini
LLM
RAG
Hallucination
Reranking
OpenAI
Anthropic
LLM Evaluation
LLM Guardrails
DevOps
CI/CD
Git
AWS
Amazon S3
IAM
Azure
Cybersecurity
Least Privilege
HIPAA
Management
Agile
+18
Apply

Intent Lab

intentlab.ai
intentlab.ai • HQ: Sunnyvale, United States • Code Intelligence • AI Agents • Likely startup • Trust B • Hiring 4
HQ: Sunnyvale, United States • Code Intelligence • AI Agents • Likely startup • Trust B • Hiring 4
Intent Lab is an AI company that builds core intelligence to automate the software development lifecycle and turn a customer's intent into production systems. Its work covers LLM-powered systems for code understanding, generation and reasoning, agents and workflows, and it hires technical staff, agent engineers and forward deployed engineers. The company is headquartered in Sunnyvale, United States.
No named decision-maker yet.
No careers mailbox known
Open 142 daysVerified live · 3 hours ago Visa sponsor 5 months ago Long shot · 6%

Agent Engineer / Forward Deployed Engineer

≈ $110k – $227k per year (Estimated) • Middle • 3+ years exp • In office (Sunnyvale, United States) • Relocation • Full-Time • Middle
Python
Go
TypeScript
AI/ML
Prompt Engineering
Function Calling
LLM Evaluation
Tool Use
DevOps
GCP
Azure
CI/CD
AWS
+3
Apply

Sweatpals

sweatpals.com
sweatpals.com • HQ: Austin, United States • Hobbies & Leisure • Fitness • 51-200 employees • Est. 2023 • Startup • Trust B • Hiring 4
HQ: Austin, United States • Hobbies & Leisure • Fitness • 51-200 employees • Est. 2023 • Startup • Trust B • Hiring 4
Discover trending fitness classes, workouts, and wellness experiences near you. Search by city, browse dates, and book your next Sweatpals experience today.
Salar Shahini Shamsabadi · Executive Officer, Director · decision-maker
Mandi Zhou · Executive Officer · decision-maker
Careers mailbox is known
Open 142 daysVerified live · 2 hours ago 5 months ago Long shot · 10%

Senior Machine Learning Scientist

Senior • 5+ years exp • Remote (EU, European time zones hours) • PhD • Full-Time • Senior
Python
SQL
Python
FastAPI
Databases
PostgreSQL
FAISS
Google BigQuery
BigQuery
AI/ML
Claude
Sentence-Transformers
Function Calling
AI Agents
Gemini
LLM
RAG
Semantic Search
Human-in-the-Loop
Structured Outputs
Semantic Search
LLM Evaluation
Tool Use
Machine Learning
Cursor
Claude Code
Embeddings
NLP
Transformers
Recommender Systems
DevOps
AWS
Web3
Rollup
Analytics
A/B Testing
+22
Apply

Upright

uprightproject.com
uprightproject.com • HQ: Helsinki, Finland • Corporate Events • 11-50 employees • Est. 2017 • Startup • Hiring 2
HQ: Helsinki, Finland • Corporate Events • 11-50 employees • Est. 2017 • Startup • Hiring 2
Upright enables smarter decision-making for investors, companies and governments by quantifying the net impact of companies.
Juho Ojala · CTO · founder
Annu Nieminen · CEO · founder
Careers mailbox is known
Open 143 daysVerified live · 2 hours ago 5 months ago Long shot · 11%

Member of Technical Staff (Data Science)

$56k – $224k per year • Equity • Staff+ • 6+ years exp • Hybrid (Helsinki, Finland) • Full-Time • Staff
Python
TypeScript
SQL
AI/ML
Cursor
Claude Code
Function Calling
AI Agents
LLM
Amazon SageMaker
Structured Outputs
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
DevOps
GCP
Azure
AWS
AWS Fargate
Analytics
ETL/ELT
+11
Apply

SWBC

swbc.com
swbc.com • HQ: San Antonio, United States • Mortgage Lending & Brokers • Insurance Brokers & Agencies • Property & Casualty Insurance • 1001-5000 employees • Trust B • Hiring 57, 1 new
HQ: San Antonio, United States • Mortgage Lending & Brokers • Insurance Brokers & Agencies • Property & Casualty Insurance • 1001-5000 employees • Trust B • Hiring 57, 1 new
SWBC is a Texas financial services company offering insurance, mortgage and lending services. It hires collections supervisors, flood underwriters, application developers and sales directors for its offices, mainly in San Antonio. The company is headquartered in San Antonio, Texas, United States.
No named decision-maker yet.
No careers mailbox known
Open 144 days 5 months ago Long shot · 5%

Data Scientist II

≈ $87k – $165k per year (Estimated) • Middle • 5+ years exp • In office (San Antonio, United States) • Master's Degree • Full-Time • Middle
Python
SQL
Databases
Snowflake
AI/ML
MLFlow
Scikit-learn
AWS Bedrock
TensorFlow
PyTorch
Anomaly Detection
Amazon SageMaker
Context Engineering
LLM Evaluation
Machine Learning
DevOps
AWS
Amazon S3
+7
Apply
Open 144 days 5 months ago Long shot · 6%

Senior Data Scientist

≈ $103k – $197k per year (Estimated) • Senior • 8+ years exp • In office (San Antonio, United States) • Master's Degree • Full-Time • Senior
Python
Databases
Snowflake
AI/ML
MLFlow
Scikit-learn
Computer Vision
NLP
AWS Bedrock
TensorFlow
PyTorch
Time Series Forecasting
Amazon SageMaker
Context Engineering
LLM Evaluation
Machine Learning
DevOps
CI/CD
AWS
Platform Engineering
Amazon S3
Analytics
A/B Testing
+11
Apply

Socure

socure.com
socure.com • HQ: New York, United States • Financial AI • Fraud Detection • Identity Management • 501-1000 employees • Est. 2012 • Startup • Trust A • Hiring 84, 4 new
HQ: New York, United States • Financial AI • Fraud Detection • Identity Management • 501-1000 employees • Est. 2012 • Startup • Trust A • Hiring 84, 4 new
Socure is a leading digital identity verification and fraud prevention platform that uses artificial intelligence and machine learning to verify consumer identities in real time. The company analyzes thousands of predictive data points - including biometrics, device intelligence, and email or phone attributes - to accurately authenticate individuals during online onboarding. By providing high accuracy rates across demographic groups, it enables financial institutions, digital healthcare providers, and online platforms to reduce fraud while streamlining user conversion.
Thomas Thimot · Executive Officer, Director · decision-maker
Sunil Madhu · Director · decision-maker
Avi Aronovitz · Executive Officer · decision-maker
John Ayers · Executive Officer, Director · decision-maker
Careers mailbox is known
Top 25% payVerified live · 9 min ago Visa sponsor 5 months ago Fading · 27%

Senior AI Engineer

$200k – $230k per year • Senior • 8+ years exp • Hybrid (New York, United States) • Full-Time • Senior
Python
AI/ML
LangGraph
AutoGen
Weights & Biases
Model Context Protocol
Function Calling
AI Agents
Arize Phoenix
LangSmith
AWS Bedrock
CrewAI
LLM
RAG
Amazon SageMaker
AWS Bedrock AgentCore
AWS Strands Agents
Human-in-the-Loop
Knowledge Graph
LLM Evaluation
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
Tool Use
LangChain
DevOps
AWS
AWS Lambda
+18
Apply
Top 25% payVerified live · 9 min ago Visa sponsor 5 months ago Fading · 27%

AI Engineer

$220k – $290k per year • Senior • 8+ years exp • Hybrid (Incline Village, United States) • Full-Time • Staff
Python
AI/ML
LangGraph
AutoGen
Weights & Biases
Model Context Protocol
Function Calling
AI Agents
Arize Phoenix
LangSmith
AWS Bedrock
CrewAI
LLM
RAG
Amazon SageMaker
AWS Bedrock AgentCore
AWS Strands Agents
Human-in-the-Loop
Knowledge Graph
LLM Evaluation
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
Tool Use
LangChain
DevOps
AWS
AWS Lambda
+18
Apply

The AGI Company

theagi.company
theagi.company • HQ: San Francisco, United States • AI Agents • Likely startup • Trust B • Hiring 6
HQ: San Francisco, United States • AI Agents • Likely startup • Trust B • Hiring 6
MultiOn builds artificial intelligence agents that browse and act on the web for users. Its API automates bookings, purchases and research tasks. The company focuses on reliable multi step web actions.
No named decision-maker yet.
Careers mailbox is known
Open 144 daysVerified live · 1 hour ago 5 months ago Long shot · 5%

Research Engineer - Evals

≈ $165k – $362k per year (Estimated) • In office (San Francisco, United States) • Relocation • Full-Time
Function Calling
AI Agents
OpenAI
LLM Evaluation
Computer Use
Tool Use
Apply

Rebtel

rebtel.com
rebtel.com • HQ: Stockholm, Sweden • Mobile Networks • Unified Communications • 51-200 employees • Trust B • Hiring 8, 1 new
HQ: Stockholm, Sweden • Mobile Networks • Unified Communications • 51-200 employees • Trust B • Hiring 8, 1 new
Make cheap calls abroad to any mobile or landline. You will enjoy top quality calls as you won't need any internet connection. Try now, your first call is free.
No named decision-maker yet.
No careers mailbox known
Open 144 daysVerified live · 2 hours ago 5 months ago Long shot · 9%

Senior Machine Learning Engineer

≈ $68k – $174k per year (Estimated) • Senior • 5+ years exp • In office (Stockholm, Sweden) • Relocation • Full-Time • Senior • English
Python
AI/ML
LangGraph
LangChain
LlamaIndex
MLFlow
Embeddings
AI Agents
LLM
RAG
Feature Store
LLM Evaluation
Agentic Workflows
Tool Use
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Kubernetes
+11
Apply

Analyticsvidhya

analyticsvidhya.com
analyticsvidhya.com • Gurgaon • Trust D • Hiring 12
Gurgaon • Trust D • Hiring 12
No named decision-maker yet.
No careers mailbox known
Likely inactiveVerified live · 3 hours ago 5 months ago Long shot · 3%

AI Engineer

In office (Gurgaon, India) • Bachelor's Degree • Full-Time
Python
Databases
Weaviate
pgvector
Pinecone
Qdrant
PostgreSQL
AI/ML
Cursor
LangChain
Claude Code
LlamaIndex
Fine-tuning
Embeddings
Prompt Engineering
AI Agents
LLM
RAG
OpenAI
Anthropic
Hugging Face
OpenAI Codex
LLM Evaluation
LLM Guardrails
Tool Use
Model Context Protocol
Promptfoo
Ragas
Multi-Agent Systems
DevOps
GCP
Azure
AWS
Docker
+23
Apply

5C Network

5cnetwork.com
5cnetwork.com • HQ: Bengaluru, India • Medical Imaging Systems • Medical Laboratories • 11-50 employees • Est. 2016 • Hiring 4
HQ: Bengaluru, India • Medical Imaging Systems • Medical Laboratories • 11-50 employees • Est. 2016 • Hiring 4
5C Network provides teleradiology services connecting hospitals with remote reporting radiologists. Its platform routes scans to available specialists and applies artificial intelligence for triage. Smaller hospitals use it to access diagnostic expertise they cannot employ directly.
No named decision-maker yet.
Careers mailbox is known
Open 145 daysVerified live · 1 day ago 5 months ago Long shot · 11%

Member of Technical Staff — Vision-Language Models

≈ $34k – $84k per year (Estimated) • Staff+ • 2+ years exp • In office (Bengaluru, India) • Full-Time • Staff
Python
AI/ML
Fine-tuning
RLHF
Multimodal AI
Computer Vision
NLP
PyTorch
LLM
Ray
LLaVA
LLM Evaluation
+3
Apply

Kyndryl

kyndryl.com
kyndryl.com • HQ: New York, United States • Cloud Consulting & Migration • Systems Integrators • IT Infrastructure & Networking Services • Managed IT Services (MSP) • 5000+ employees • Est. 2021 • IT services • Trust B • Hiring 731, 34 new
HQ: New York, United States • Cloud Consulting & Migration • Systems Integrators • IT Infrastructure & Networking Services • Managed IT Services (MSP) • 5000+ employees • Est. 2021 • IT services • Trust B • Hiring 731, 34 new
Kyndryl is an American IT infrastructure services company created in November 2021 when IBM spun off its managed infrastructure division, and it is the largest provider of its kind in the world. It designs, builds, runs and modernises the mission-critical systems of thousands of enterprise and government customers, covering mainframes, hybrid cloud, networks, security, applications and data platforms across more than sixty countries. Freed from its former parent, the company has built alliances with Microsoft, Amazon Web Services, Google Cloud and SAP, and is shifting revenue mix from legacy managed contracts toward consulting and modernisation work.
Martin Schroeter · Chairman & Chief Executive Officer · decision-maker
Elly Keinan · Group President · decision-maker
David Wyshner · Chief Financial Officer · decision-maker
Careers mailbox is known
Open 145 daysVerified live · 1 day ago 5 months ago Long shot · 7%

Platform Engineer – Agentic AI & Harness Engineering

≈ $54k – $99k per year (Estimated) • Senior • 5+ years exp • Madrid • Remote (Spain) • Full-Time • Senior
Python
AI/ML
Model Context Protocol
AI Agents
LLM
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Agentic Workflows
Copilot
LangGraph
AutoGen
LangChain
Claude Code
CrewAI
LLMOps
OpenAI Codex
DevOps
GCP
Azure
CI/CD
AWS
Kubernetes
Platform Engineering
+14
Apply

Harper

harpercorp.com
harpercorp.com • HQ: San Francisco, United States • Manufacturing • Trust A • Hiring 30
HQ: San Francisco, United States • Manufacturing • Trust A • Hiring 30
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 2 hours ago 5 months ago Long shot · 19%

Product Manager

$125k – $170k per year • Junior • 1+ year exp • In office (San Francisco, United States) • Relocation • Full-Time • Junior
Cursor
Claude Code
AI Agents
Lovable
Context Engineering
LLM Evaluation
Apply

Machinify

machinify.com
machinify.com • HQ: Palo Alto, United States • Medical AI • Revenue Cycle & Medical Billing • 51-200 employees • Est. 2016 • Trust A • Hiring 39, 6 new
HQ: Palo Alto, United States • Medical AI • Revenue Cycle & Medical Billing • 51-200 employees • Est. 2016 • Trust A • Hiring 39, 6 new
Machinify is an artificial intelligence software company headquartered in Palo Alto, California, and founded in 2016. The company provides an AI-powered operating system designed to automate healthcare payment integrity processes, including claims auditing, subrogation, and pharmacy payment accuracy. It serves major health plans across the United States, managing data for over 270 million members to identify cost savings and reduce administrative friction for payers and providers.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago Visa sponsor 5 months ago Likely open · 53%

Sr. Director | Engineering, ML

≈ $182k – $371k per year (Estimated) • Head+ • 8+ years exp • Remote (United States) • Bachelor's Degree • Senior
Python
Java
Rust
Scala
AI/ML
LLM
Semantic Search
LLM Evaluation
Apply
Top 25% payVerified live · 3 hours ago Visa sponsor 8 months ago Fading · 26%

Staff Data Scientist | NLP

$180k – $230k per year • Staff+ • 3+ years exp • Remote (United States) • Staff
Python
SQL
Databases
Weaviate
pgvector
Pinecone
PostgreSQL
AI/ML
LoRA
Sentence-Transformers
Fine-tuning
JAX
NLP
QLoRA
spaCy
Transformers
PyTorch
LLM
RAG
Semantic Search
Hugging Face
Human-in-the-Loop
Semantic Search
LLM Evaluation
Agentic Workflows
Multimodal AI
PEFT
DevOps
GCP
Azure
AWS
Analytics
A/B Testing
+21
Apply
Verified live · 3 hours ago Visa sponsor 8 months ago Long shot · 24%

AI Engineer | Agentic Systems

$130k – $200k per year • Junior • 2+ years exp • Remote (United States) • Bachelor's Degree • Junior
Python
Python
Pydantic
AI/ML
LangGraph
Claude
Claude Code
AI Agents
Anthropic SDK
Gemini
LLM
OpenAI Codex
OpenAI Agents SDK
Structured Outputs
LLM Evaluation
LangChain
Multimodal AI
OCR
+8
Apply

Firebird

firebird.ai
firebird.ai • Yerevan • Data Centers & Colocation • AI Compute & Inference • Est. 2025 • Trust C • Hiring 13
Yerevan • Data Centers & Colocation • AI Compute & Inference • Est. 2025 • Trust C • Hiring 13
About Firebird Where the future of AI takes flight. Building large-scale, US-stack AI compute in high-growth emerging markets.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveVerified live · 4 hours ago 5 months ago Long shot · 5%

ML Engineer, Inference and Serving

Middle • 3+ years exp • In office (Yerevan, Armenia) • Middle
Python
AI/ML
vLLM
Triton Inference Server
Quantization
SGLang
AWQ
GPTQ
TensorRT
TensorRT-LLM
PyTorch
LLM
Mixture of Experts
Triton
OpenAI
Hugging Face
LLM Evaluation
Speculative Decoding
KV Cache
Machine Learning
LoRA
Embeddings
ONNX
PEFT
NCCL
InfiniBand
NVLink
DevOps
Grafana
Helm
Kubernetes
Gateway API
+22
Apply

Fieldguide

fieldguide.io
fieldguide.io • HQ: San Francisco, United States • Workflow & Process Automation (RPA, BPM) • Security Compliance • Est. 2020 • Startup • Trust A • Hiring 47, 4 new
HQ: San Francisco, United States • Workflow & Process Automation (RPA, BPM) • Security Compliance • Est. 2020 • Startup • Trust A • Hiring 47, 4 new
Fieldguide is an AI-powered automation platform designed specifically for risk, compliance, and audit advisory firms. Founded in 2020 and headquartered in San Francisco, the company provides cloud software that streamlines engagement workflows for cybersecurity and compliance frameworks like SOC 2, ISO 27001, and NIST. By automating data collection, testing, and report drafting, Fieldguide enables accounting and risk advisory professionals to deliver higher-quality audit services in less time.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 3 hours ago Visa sponsor 5 months ago Long shot · 9%

Software Engineer, Agents (Internal Audit)

$170k – $300k per year • Hybrid (San Francisco, United States) • Full-Time
Python
TypeScript
Databases
PostgreSQL
AI/ML
AI Agents
LLM
Human-in-the-Loop
Prompt Engineering
Arize Phoenix
Langfuse
LangSmith
Braintrust
LLM Evaluation
Frontend
GraphQL
+5
Apply
Open 181 daysTop 25% pay Visa sponsor 6 months ago Long shot · 13%

Senior AI Engineer, Quality

$200k – $250k per year • Senior • Hybrid (San Francisco, United States) • Full-Time • Senior
Python
TypeScript
Databases
PostgreSQL
AI/ML
LangGraph
AI Agents
LangSmith
LLM Evaluation
LLM Guardrails
LangChain
Langfuse
LLM
RAG
Lovable
+5
Apply

Cassi

cassihome.com
cassihome.com • HQ: New York, United States • Scheduling & Booking Software • Field Service Management Software • Est. 2022 • Likely startup • Hiring 4
HQ: New York, United States • Scheduling & Booking Software • Field Service Management Software • Est. 2022 • Likely startup • Hiring 4
Cassi is the coordination system for residential services — one place to run every home you manage. Work orders, vendors, residents, and field execution, unified.
No named decision-maker yet.
No careers mailbox known
Open 156 daysVerified live · 1 hour ago 5 months ago Long shot · 10%

Staff AI Infrastructure Engineer

≈ $134k – $259k per year (Estimated) • Staff+ • 8+ years exp • New York • Remote (United States) • Bachelor's Degree • Full-Time • Staff
TypeScript
Python
Databases
PostgreSQL
DynamoDB
AI/ML
Copilot
Embeddings
AI Agents
LLM
RAG
Tokenization
Hybrid Search
Structured Outputs
LLM Evaluation
Prompt Caching
Tool Use
LangGraph
LangChain
DSPy
Fine-tuning
Knowledge Distillation
Pydantic AI
Text-to-Speech
Model Distillation
Mastra
Vercel AI SDK
Mobile
Clean Architecture
DevOps
WebRTC
WebSockets
AWS
AWS Lambda
Cybersecurity
SOC 2
+23
Apply
Machines can read this selection · checked 20:29 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.