LLM Evaluation Jobs - Remote & On-site

LLM Evaluation jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $238,075/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

You searched for “LLM Evaluation Jobs - Remote & On-site”, so this list shows: technical roles only · the stack names LLM Evaluation · known staffing agencies left out. Adjust the filters

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Goldman Sachs

goldmansachs.com
goldmansachs.com • HQ: New York, United States • Wealth Management & Financial Advisors • Asset Management & Funds • Investment Banking & M&A Advisory • 1001-5000 employees • Est. 1869 • Trust B • Hiring 314, 67 new
HQ: New York, United States • Wealth Management & Financial Advisors • Asset Management & Funds • Investment Banking & M&A Advisory • 1001-5000 employees • Est. 1869 • Trust B • Hiring 314, 67 new
Goldman Sachs is a global investment banking, securities, and asset and wealth management firm headquartered at 200 West Street in New York, serving corporations, financial institutions, governments and high-net-worth individuals. Founded in 1869 and listed on the New York Stock Exchange, it runs its business through Global Banking and Markets and Asset and Wealth Management and has major offices in London, Frankfurt, Tokyo, Hong Kong, Birmingham, Dallas, Salt Lake City and Bengaluru. Its lateral hiring covers software engineers, trading and capital markets analysts, private wealth and Ayco advisers, compliance, internal audit and human capital roles.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago Visa sponsor 2 hours ago Hiring now · 86%

The Core Engineering - Technical AI Solutions Engineer - VP - London

≈ $131k – $241k per year (Estimated) • Head+ • 9+ years exp • In office (London, United Kingdom) • Bachelor's Degree • Architect
Python
Java
AI/ML
Embeddings
AI Agents
LLM
RAG
Hallucination
Human-in-the-Loop
Structured Outputs
LLM Evaluation
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
+7
Apply
Verified live · 1 hour ago Visa sponsor 4 days ago Likely open · 63%

The Core Engineering- AI Solutions Engineer - VP - London

≈ $131k – $241k per year (Estimated) • Head+ • 9+ years exp • In office (London, United Kingdom) • Bachelor's Degree • Architect
Python
Java
AI/ML
Embeddings
AI Agents
LLM
RAG
Structured Outputs
LLM Evaluation
Machine Learning
Hallucination
Human-in-the-Loop
DevOps
GCP
Azure
CI/CD
AWS
+7
Apply
Verified live · 1 hour ago Visa sponsor 10 days ago Likely open · 53%

The Core Engineering-L2-New York-Vice President-Software Engineering

≈ $186k – $349k per year (Estimated) • Head+ • 9+ years exp • In office (New York, United States) • Bachelor's Degree • Architect
Python
Java
AI/ML
Embeddings
AI Agents
LLM
RAG
Hallucination
Human-in-the-Loop
Structured Outputs
LLM Evaluation
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
+7
Apply

Amazon

amazon.com
amazon.com • HQ: Seattle, United States • Robotics AI • Logistics & Warehouse Robotics • Advertising • Logistics • Streaming & OTT Platforms • Cloud Platforms (IaaS & PaaS) • Marketplaces • 5000+ employees • Est. 1994 • Trust A • Hiring 8583, 1361 new
HQ: Seattle, United States • Robotics AI • Logistics & Warehouse Robotics • Advertising • Logistics • Streaming & OTT Platforms • Cloud Platforms (IaaS & PaaS) • Marketplaces • 5000+ employees • Est. 1994 • Trust A • Hiring 8583, 1361 new
Amazon is an American technology and retail conglomerate founded by Jeff Bezos in 1994 as an online bookstore and headquartered in Seattle, Washington. It operates the world's largest online marketplace together with a global logistics network, physical grocery stores and a third-party seller platform that accounts for most units sold. Amazon Web Services, launched in 2006, is the leading public cloud provider and generates the majority of the group's operating profit, while advertising, Prime Video, Alexa devices and Kuiper satellite broadband round out the business.
Jeff Bezos · Founder & Executive Chairman · decision-maker
Doug Herrington · Chief Executive Officer, Worldwide Amazon Stores · decision-maker
Matt Garman · Chief Executive Officer, Amazon Web Services · decision-maker
Brian Olsavsky · Senior Vice President & Chief Financial Officer · decision-maker
Careers mailbox is known
Top 25% payVerified live · 27 min ago Visa sponsor 12 hours ago Likely open · 63%

Software Development Engineer, AI Foundations, Amazon Leo Networking Software

$144k – $194k per year • Equity • Middle • 3+ years exp • In office (Redmond, United States) • Bachelor's Degree • Full-Time • Middle
Java
C#
C++
Perl
AI/ML
AI Agents
LLM Evaluation
DevOps
AWS
Apply
Top 25% payVerified live · 27 min ago Visa sponsor 3 days ago Likely open · 62%

Senior MLE, CreativeFlux, AI Studios

$168k – $227k per year • Equity • Senior • 5+ years exp • In office (Culver City, United States) • Bachelor's Degree • Full-Time • Senior
Fine-tuning
Quantization
Amazon SageMaker
Human-in-the-Loop
LLM Evaluation
Machine Learning
AI Agents
DevOps
KEDA
Kubernetes
Amazon EKS
AWS
Design
Maya
Adobe After Effects
+5
Apply
Top 25% payVerified live · 27 min ago Visa sponsor 10 days ago Likely open · 50%

Sr. Applied Scientist, AWS Applied AI Solutions - Life Sciences

$167k – $226k per year • Equity • Senior • 6+ years exp • In office (Seattle, United States) • Master's Degree • Full-Time • Senior
Python
Java
C++
C++
TensorFlow C++
AI/ML
Fine-tuning
RLHF
AI Agents
LLM
LLM Evaluation
Spark
Scikit-learn
SciPy
TensorFlow
NumPy
DevOps
AWS
+7
Apply

Palo Alto Networks

paloaltonetworks.com
paloaltonetworks.com • HQ: Santa Clara, United States • Endpoint Security • Threat Intelligence • Security Operations • Cloud Security • Network Security • 1001-5000 employees • Est. 2005 • Hiring 223, 118 new
HQ: Santa Clara, United States • Endpoint Security • Threat Intelligence • Security Operations • Cloud Security • Network Security • 1001-5000 employees • Est. 2005 • Hiring 223, 118 new
Palo Alto Networks is a cybersecurity company headquartered in Santa Clara, California, selling next-generation firewalls and SASE network security, the Prisma and Cortex platforms for cloud security and security operations, and Unit 42 threat intelligence and incident response services. Founded in 2005 by Nir Zuk and listed on Nasdaq, it reports more than 16,000 employees and over 70,000 customers, with major engineering centres in Israel and India and offices across the Americas, Europe and Asia. It hires software engineers, product managers and designers, solutions consultants, account managers, go-to-market strategists and legal and sourcing staff.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 4 hours ago Visa sponsor 1 day ago Hiring now · 90%

Principal Product Manager, CMDB - (Console)

$177k – $286k per year • Equity • Lead • 5+ years exp • In office (United States) • Full-Time • Confidential • Principal
Databricks
AI/ML
AI Agents
LLM Evaluation
Design
Webflow
Management
ITSM
Apply
Verified live · 4 hours ago 4 days ago Hiring now · 90%

Distinguished Architect Software Engineer (Cortex AgentiX)

≈ $91k – $272k per year (Estimated) • Lead • 10+ years exp • In office (Tel Aviv, Israel) • Full-Time • Confidential • Architect
Python
Go
AI/ML
LangGraph
AutoGen
AI Agents
LLM
LLM Evaluation
LangChain
DevOps
GCP
Azure
AWS
Kubernetes
Cortex
Prometheus
+6
Apply
Top 25% payVerified live · 4 hours ago Visa sponsor 8 days ago Hiring now · 78%

Sr Staff Security Researcher (AI-Assisted Vulnerability Research)

$140k – $226k per year • Equity • Staff+ • 5+ years exp • In office (Santa Clara, United States) • Master's Degree • Full-Time • Confidential • Staff
AI Agents
LLM Evaluation
DevOps
GitHub
Chips/EDA
PoC Library
Apply

SRC, Inc.

srcinc.com
srcinc.com • HQ: Syracuse, United States • Higher Education • Nonprofits & Foundations • Military • Est. 1957 • Hiring 51, 17 new
HQ: Syracuse, United States • Higher Education • Nonprofits & Foundations • Military • Est. 1957 • Hiring 51, 17 new
SRC is an independent not-for-profit research and development company headquartered in North Syracuse, New York, working in defense, environment and intelligence for the US Air Force, Army, Navy and allied governments. Founded in 1957, formerly known as Syracuse Research Corporation and chartered by the State of New York, it develops radar, electronic warfare and sensor systems and runs engineering laboratories and test facilities with offices across the country. Its openings include SMT electronics hardware technicians, electronics test technicians, quality inspectors, contracts administrators and engineering interns, mostly near Syracuse and in Fairborn, Ohio.
No named decision-maker yet.
Careers mailbox is known
Verified live · 4 hours ago 1 day ago Hiring now · 99%

AI/ML Engineer

$70k – $96k per year • In office (New York, United States) • Bachelor's Degree
Python
AI/ML
DVC
Weights & Biases
LoRA
Model Context Protocol
MLFlow
Fine-tuning
Reinforcement Learning
Scikit-learn
Multimodal AI
Axolotl
PEFT
QLoRA
TRL
Unsloth
Transformers
NumPy
PyTorch
LLM
RAG
Stable-Baselines3
Time Series Forecasting
Gymnasium
Hugging Face
DPO
SFT
GRPO
Post-training
Structured Outputs
LLM Evaluation
Agentic Workflows
Tool Use
Machine Learning
DevOps
Git
Docker
Analytics
Matplotlib
+28
Apply

Novisto

novisto.com
novisto.com • HQ: Montreal, Canada • Software • ESG & Carbon Accounting Software • 201-500 employees • Startup • Trust B • Hiring 16, 2 new
HQ: Montreal, Canada • Software • ESG & Carbon Accounting Software • 201-500 employees • Startup • Trust B • Hiring 16, 2 new
Novisto is a leading ESG Software Company offering sustainable solutions for more resilient business models. Speak with one of our ESG specialists today.
No named decision-maker yet.
No careers mailbox known
Verified live · 10 min ago Visa sponsor 1 day ago Hiring now · 86%

Senior AI Engineer

≈ $82k – $155k per year (Estimated) • Equity • Senior • 6+ years exp • Montreal • Remote (Canada) • Senior
Python
Python
FastAPI
Databases
pgvector
Qdrant
ElasticSearch
PostgreSQL
AI/ML
LangGraph
Model Context Protocol
AI Agents
LLM
RAG
Google ADK
Hallucination
Hybrid Search
LLMOps
Human-in-the-Loop
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
LangChain
DevOps
GCP
Azure
CI/CD
Kubernetes
Platform Engineering
+18
Apply

Guidewire

guidewire.com
guidewire.com • HQ: San Mateo, United States • InsurTech • 1001-5000 employees • Est. 2001 • Trust B • Hiring 140, 22 new
HQ: San Mateo, United States • InsurTech • 1001-5000 employees • Est. 2001 • Trust B • Hiring 140, 22 new
Guidewire is an American software company that provides core systems for property and casualty insurers, including PolicyCenter for underwriting and policy administration, BillingCenter and ClaimCenter, together with analytics and digital engagement tools delivered through its Guidewire Cloud platform. Founded in 2001 and listed on the New York Stock Exchange, it serves several hundred insurers worldwide and has development and services teams in Bengaluru, Toronto, Kraków and other cities. The company is headquartered in San Mateo, California, United States.
No named decision-maker yet.
Careers mailbox is known
Verified live 1 day ago Likely open · 63%

AI Engineer

≈ $24k – $56k per year (Estimated) • Middle • 3+ years exp • In office (Bengaluru, India) • Bachelor's Degree • Full-Time • Middle
Python
Databases
pgvector
Pinecone
OpenSearch
PostgreSQL
AI/ML
LangGraph
LangChain
Claude
Claude Code
LlamaIndex
Fine-tuning
Embeddings
Scikit-learn
Prompt Engineering
Function Calling
AWS Bedrock
NumPy
LLM
RAG
Reranking
OpenAI
Anthropic
Structured Outputs
Knowledge Distillation
AI Agents
Amazon SageMaker
OpenAI Agents SDK
LLM Evaluation
Model Distillation
DevOps
CI/CD
Git
AWS
+24
Apply
22 days ago Likely open · 45%

AI Architect

≈ $37k – $91k per year (Estimated) • Staff+ • 8+ years exp • In office (Bengaluru, India) • Full-Time • Staff
Python
Java
Databases
OpenSearch
AI/ML
Fine-tuning
Embeddings
Prompt Engineering
Function Calling
AI Agents
NLP
LLM
RAG
Reranking
Structured Outputs
Agentic Workflows
Tool Use
Machine Learning
Knowledge Distillation
AWS Bedrock
Amazon SageMaker
LLM Evaluation
Model Distillation
DevOps
CI/CD
Git
AWS
+16
Apply

Oracle

oracle.com
oracle.com • HQ: Austin, United States • CRM Software • HR & Payroll Software • ERP & Business Management Software • Cloud Platforms (IaaS & PaaS) • Databases & DBMS • 5000+ employees • Est. 1977 • NYSE: ORCL • Trust A • Hiring 937, 152 new
HQ: Austin, United States • CRM Software • HR & Payroll Software • ERP & Business Management Software • Cloud Platforms (IaaS & PaaS) • Databases & DBMS • 5000+ employees • Est. 1977 • NYSE: ORCL • Trust A • Hiring 937, 152 new
Oracle is an American enterprise technology company founded in 1977 by Larry Ellison, Bob Miner and Ed Oates, and headquartered in Austin, Texas. It built its business on the Oracle Database, still the reference relational engine for large transactional systems, and has expanded into a full applications suite covering finance, human resources, supply chain and customer experience through Fusion Cloud and NetSuite. Its fastest growing segment is Oracle Cloud Infrastructure, which the company has positioned aggressively for AI training and inference workloads through large multi-year capacity contracts.
Larry Ellison · Co-Founder, Chairman & Chief Technology Officer · decision-maker
Clay Magouyrk · Chief Executive Officer · decision-maker
Safra Catz · Executive Vice Chair · decision-maker
Ed Oates · Co-Founder · founder
No careers mailbox known
Top 25% payVerified live · 1 hour ago Visa sponsor 1 day ago Likely open · 63%

Senior Software Engineer

$105k – $235k per year • Equity • Senior • 3+ years exp • In office (Nashville, United States) • Bachelor's Degree • Senior
Python
Go
Java
C#
C++
AI/ML
Model Context Protocol
AI Agents
RAG
LLM Evaluation
DevOps
Rest API
CI/CD
GCP
Azure
AWS
Docker
Kubernetes
Management
Agile
+9
Apply

Two Six Technologies

twosixtech.com
twosixtech.com • HQ: Arlington, United States • National Security • Intelligence • Electronic Warfare • Cyber Warfare • 1001-5000 employees • Est. 2021 • Trust B • Hiring 64, 2 new
HQ: Arlington, United States • National Security • Intelligence • Electronic Warfare • Cyber Warfare • 1001-5000 employees • Est. 2021 • Trust B • Hiring 64, 2 new
Two Six Technologies is an American company formed in 2021 when the private equity firm Carlyle combined the national security business of IST Research with parts of Two Six Labs. It builds cyber capabilities, electronic warfare systems, information operations tooling and research prototypes for United States defence and intelligence customers, sitting closer to research than to traditional systems integration. Headquartered in Arlington, Virginia, it employs mostly cleared engineers and researchers, and much of its work involves turning DARPA-funded research into systems operational units can actually deploy.
Jeff Gregory · Executive Officer · decision-maker
Chris Greamo · Executive Officer, Director · decision-maker
John Backus · Director
Steve Frederick · Director
Careers mailbox is known
Top 25% payVerified live · 20 min ago 1 day ago Likely open · 63%

Vulnerability Research Analyst

$158k – $237k per year • In office (Linthicum Heights, United States) • Bachelor's Degree • TS/SCI
Assembly
Assembly
Unicorn Engine
AI/ML
LLM Evaluation
Machine Learning
DevOps
QEMU
Cybersecurity
Semgrep
CodeQL
Ghidra
Apply

Provectus

provectus.com
provectus.com • HQ: San Francisco, United States • IT Consulting & Digital Transformation • AI Consulting & Integration • Est. 2010 • Hiring 37, 3 new
HQ: San Francisco, United States • IT Consulting & Digital Transformation • AI Consulting & Integration • Est. 2010 • Hiring 37, 3 new
Provectus is a technology consulting firm that delivers artificial intelligence, machine learning, data engineering and cloud projects for enterprise clients, with a strong focus on generative AI solutions built on Amazon Web Services. Founded in 2010, it runs engineering teams across the United States, Latin America, Armenia and Eastern Europe and hires machine learning engineers, forward deployed engineers and business development staff. The company is headquartered in San Francisco, California, United States.
No named decision-maker yet.
Careers mailbox is known
Verified live · 5 hours ago 1 day ago Hiring now · 90%

Senior Forward Deployed AI Engineer (GenAI, AWS)

≈ $152k – $274k per year (Estimated) • Senior • 8+ years exp • Remote (United States) • Full-Time • Senior • English: C1
Python
TypeScript
Databases
Neo4j
Amazon Neptune
AI/ML
Claude
Claude Code
AI Agents
LLM
Anthropic
ChatGPT
MLFlow
Fine-tuning
Knowledge Distillation
PyTorch
Amazon SageMaker
LLM Evaluation
Agentic Workflows
Model Distillation
DevOps
GCP
Azure
CI/CD
AWS
Kubernetes
Amazon ECS
Terraform
AWS CDK
CloudFormation
+19
Apply
Verified live · 5 hours ago 7 days ago Hiring now · 90%

Junior AI/ML Engineer (GenAI, AWS)

Junior • 2+ years exp • Yerevan • Remote (Poland, Serbia, Spain, Ukraine) • Full-Time • Junior • English
Python
TypeScript
Go
Rust
AI/ML
Claude
Claude Code
AI Agents
AWS Bedrock
RAG
Anthropic
AWS Bedrock AgentCore
Spark
Airflow
Model Context Protocol
NLP
LLM
OpenAI
A2A
LLM Evaluation
DevOps
CI/CD
AWS
AWS Lambda
Amazon S3
Amazon ECS
Rest API
GitHub Actions
GitLab CI
+19
Apply

Sitetracker

sitetracker.com
sitetracker.com • HQ: Montclair, United States • Project & Work Management Software • 501-1000 employees • Est. 2013 • Trust B • Hiring 20, 4 new
HQ: Montclair, United States • Project & Work Management Software • 501-1000 employees • Est. 2013 • Trust B • Hiring 20, 4 new
Headquartered in Montclair, New Jersey, Sitetracker is an enterprise software company specializing in critical infrastructure lifecycle management solutions. The company provides a cloud-based Asset Lifecycle Management (ALM) platform designed for telecommunications operators, renewable energy developers, EV charging networks, and utilities.
Brett Cupta · Executive Officer · decision-maker
Timothy May · Director · decision-maker
Giuseppe Incitti · Executive Officer, Director · decision-maker
Michael Creegan · Executive Officer · decision-maker
Careers mailbox is known
Top 25% payVerified live · 1 hour ago Visa sponsor 1 day ago Hiring now · 90%

Senior Data Scientist (Agentic UX), Design

$145k – $215k per year • Senior • Remote (United States) • Full-Time • Senior
Cursor
Claude Code
AI Agents
LLM
LLM Evaluation
Analytics
A/B Testing
Management
Slack
Scrum
Apply

Boon

getboon.ai
getboon.ai • HQ: San Francisco, United States • Custom Software Development • Startup • Hiring 4, 1 new
HQ: San Francisco, United States • Custom Software Development • Startup • Hiring 4, 1 new
Boon is the AI teammate for preconstruction teams — reads full plan-and-spec sets, catches spec/drawing conflicts, generates RFIs, levels bids, and runs takeoff inside the tools your team already uses.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 1 day ago Hiring now · 86%

Technical Architect

≈ $166k – $277k per year (Estimated) • Staff+ • 10+ years exp • Remote (United States) • Full-Time • Architect
Python
Ruby
Ruby
Sidekiq
Databases
PostgreSQL
RabbitMQ
AI/ML
MLFlow
Computer Vision
AI Agents
VLM
LLM
OpenAI Agents SDK
OCR
LLM Evaluation
DevOps
GCP
Helm
CI/CD
AWS
Kubernetes
+10
Apply

Alice

alice.io
alice.io • New York • London • Hanoi • Ramat Gan • San Francisco • Foundation Models • LLM & Generative AI • Artificial Intelligence • Threat Intelligence • AI Governance & Compliance • AI Safety & Alignment • 51-200 employees • Startup • Hiring 29, 6 new
New York • London • Hanoi • Ramat Gan • San Francisco • Foundation Models • LLM & Generative AI • Artificial Intelligence • Threat Intelligence • AI Governance & Compliance • AI Safety & Alignment • 51-200 employees • Startup • Hiring 29, 6 new
Alice is the most trusted partner for GenAI safety and security. Built on a decade of threat intelligence research, Alice helps organizations detect, prevent, and respond to AI risks across the full model lifecycle.
No named decision-maker yet.
No careers mailbox known
Verified live · 5 hours ago 1 day ago Hiring now · 90%

Senior Data Product Manager, AI

≈ $117k – $261k per year (Estimated) • Senior • 5+ years exp • Hybrid (Ramat Gan, Israel) • Full-Time • Senior
Prompt Engineering
AI Agents
LLM
RAG
Red Teaming
LLM Evaluation
LLM Guardrails
Apply
Verified live · 5 hours ago 29 days ago Fading · 34%

Researcher, Evaluations and Benchmarks

≈ $136k – $273k per year (Estimated) • Middle • 3+ years exp • New York • Remote (United States) • Master's Degree • Full-Time • Middle • English
vLLM
Function Calling
AI Agents
DPO
SFT
GRPO
Post-training
LLM Evaluation
LLM Guardrails
Tool Use
Machine Learning
+3
Apply

InPost

inpost.eu
inpost.eu • HQ: Kraków, Poland • Logistics • Delivery • Courier Services • 5000+ employees • Est. 1999 • Trust B • Hiring 110, 29 new
HQ: Kraków, Poland • Logistics • Delivery • Courier Services • 5000+ employees • Est. 1999 • Trust B • Hiring 110, 29 new
InPost is a leading European logistics company and out-of-home delivery provider best known for its extensive network of Automated Parcel Machines (APMs) and pick-up/drop-off points. The company offers last-mile parcel delivery, courier services, and efficient returns handling tailored for major e-commerce merchants and individual shoppers. By combining modern automated infrastructure with a mobile application, it delivers a convenient, flexible, and eco-friendly alternative to traditional door-to-door delivery.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 1 day ago Hiring now · 90%

Staff ML Platform Engineer - Fintech Engineering (m/f/n)

≈ $77k – $133k per year (Estimated) • Staff+ • 7+ years exp • Hybrid (Warsaw, Poland) • Full-Time • Senior • English: B2
Python
Databases
Databricks
AI/ML
Spark
MLFlow
SHAP
XGBoost
Scikit-learn
AI Agents
PyTorch
LLM
Feature Store
LLM Evaluation
LLM Guardrails
Machine Learning
DevOps
CI/CD
+7
Apply
Verified live · 3 hours ago 1 day ago Hiring now · 90%

Senior ML Engineer - Fintech Engineering (m/f/n)

≈ $63k – $105k per year (Estimated) • Senior • Hybrid (Warsaw, Poland) • Contractor • Senior • English: B2
Python
SQL
Databases
Databricks
AI/ML
Spark
SHAP
AI Agents
LIME
Feature Store
LLM Evaluation
LLM Guardrails
DevOps
CI/CD
+3
Apply
Verified live · 3 hours ago 11 days ago Hiring now · 74%

Principal Software Engineer - Fintech Platform (m/f/n)

≈ $68k – $110k per year (Estimated) • Lead • 10+ years exp • Hybrid (Warsaw, Poland) • Bachelor's Degree • Full-Time • Senior • Polish (Optional) • English: B2
AI Agents
LLM
Time Series Forecasting
LLM Evaluation
Multi-Agent Systems
Tool Use
DevOps
Rest API
GCP
Azure
AWS
Cybersecurity
PCI DSS
+3
Apply

Zinkworks

zinkworks.com
zinkworks.com • Athlone • Shannon • Cloud Consulting & Migration • IT Consulting & Digital Transformation • 11-50 employees • Trust A • Hiring 14, 3 new
Athlone • Shannon • Cloud Consulting & Migration • IT Consulting & Digital Transformation • 11-50 employees • Trust A • Hiring 14, 3 new
About Us Zinkworks is a trusted partner to Telecommunications and Financial Services organizations around the world. We help modernise legacy systems, move mission-critical systems into the cloud, and exploit the power of AI-driven automation.
No named decision-maker yet.
Careers mailbox is known
Verified live · 5 hours ago 1 day ago Hiring now · 86%

Senior AI/ML Engineer

≈ $86k – $171k per year (Estimated) • Senior • In office (Athlone, Ireland) • Full-Time • Senior
Python
Databases
Google BigQuery
BigQuery
AI/ML
Vertex AI
Scikit-learn
Function Calling
AI Agents
NumPy
LLM
Anomaly Detection
Time Series Forecasting
LLM Evaluation
LLM Guardrails
Tool Use
RAG
DevOps
GCP
CI/CD
Git
Management
Jira
+11
Apply

Nuvei

nuvei.com
nuvei.com • HQ: Montreal, Canada • Crypto Payments • Payment Processing & Gateways • 51-200 employees • Est. 2003 • Trust A • Hiring 56, 15 new
HQ: Montreal, Canada • Crypto Payments • Payment Processing & Gateways • 51-200 employees • Est. 2003 • Trust A • Hiring 56, 15 new
Nuvei is a Canadian payment technology company that provides merchants with payment processing, acquiring, payouts and risk management across online, mobile and in-store channels, supporting hundreds of local payment methods and cryptocurrencies. Founded in 2003, it serves sectors such as e-commerce, online gaming, financial services and marketplaces, and was taken private by Advent International in 2024. The company is headquartered in Montreal, Quebec, Canada.
David Schwartz · Executive Officer · decision-maker
Phil Atherton · Executive Officer · decision-maker
Keith Birdsong · Executive Officer · decision-maker
Mordechay Bring · Executive Officer · decision-maker
Careers mailbox is known
Verified live · 4 hours ago 1 day ago Hiring now · 90%

Agentic Software Engineer

Hybrid (Tel Aviv, Israel) • Full-Time
Model Context Protocol
Function Calling
AI Agents
RAG
Hallucination
LLM Evaluation
Agentic Workflows
Tool Use
DevOps
GCP
Azure
CI/CD
AWS
Platform Engineering
+5
Apply
Verified live · 4 hours ago 1 day ago Hiring now · 90%

Agentic Softwaer Engineering Expert

≈ $89k – $227k per year (Estimated) • Senior • Hybrid (Tel Aviv, Israel) • Full-Time • Senior
Model Context Protocol
AI Agents
LLM Evaluation
DevOps
CI/CD
Platform Engineering
Apply

Vi

vi.co
vi.co • HQ: Tel Aviv, Israel • Health Data & Interoperability • Medical AI • Est. 2011 • Startup • Hiring 10, 5 new
HQ: Tel Aviv, Israel • Health Data & Interoperability • Medical AI • Est. 2011 • Startup • Hiring 10, 5 new
Vi is a health technology company that builds productized artificial intelligence for healthcare enterprises such as providers, payers and health systems. Its data science products target patient outcomes and operational efficiency, including patient engagement and care management use cases. The company originated as the Israeli startup LifeBEAM and is headquartered in Israel.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 1 day ago Hiring now · 90%

Senior Data Scientist

≈ $77k – $199k per year (Estimated) • Senior • 4+ years exp • In office (Tel Aviv, Israel) • Full-Time • Senior
Python
SQL
AI/ML
Spark
Embeddings
AI Agents
LLM
LLM Evaluation
Agentic Workflows
DevOps
AWS
CI/CD
Docker
+3
Apply

Marsh McLennan

marshmclennan.com
marshmclennan.com • HQ: New York, United States • 1001-5000 employees • Est. 1871 • Hiring 181, 82 new
HQ: New York, United States • 1001-5000 employees • Est. 1871 • Hiring 181, 82 new
Marsh McLennan is a global professional services firm in risk, strategy and people, headquartered in New York and listed on the New York Stock Exchange. It operates through four businesses, Marsh in insurance broking, Guy Carpenter in reinsurance, Mercer in health, wealth and benefits consulting and Oliver Wyman in management consulting, with about 90,000 colleagues in some 130 countries. It hires catastrophe risk analysts, reinsurance brokers, benefits consultants, sales executives, paralegals, software engineers and IT support staff in hubs such as London, Cluj-Napoca and Mexico City.
No named decision-maker yet.
No careers mailbox known
Verified live · 5 hours ago 1 day ago Hiring now · 90%

Software Engineer (Generative AI and Innovation)

Junior • 2+ years exp • Hybrid (Dublin, Ireland) • Full-Time • Junior
Python
JavaScript
TypeScript
Node JS
Node JS
Nest.JS
AI/ML
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
RAG
Semantic Search
Structured Outputs
Semantic Search
LLM Evaluation
LLM Guardrails
Tool Use
Frontend
Vue.js
Angular
React.js
DevOps
AWS
Kubernetes
Management
Agile
+14
Apply

Svitla Systems

svitla.com
svitla.com • HQ: Corte Madera, United States • DevOps & Platform Engineering • IT Outsourcing & Dedicated Teams • Custom Software Development • Est. 2003 • Trust B • Hiring 98, 12 new
HQ: Corte Madera, United States • DevOps & Platform Engineering • IT Outsourcing & Dedicated Teams • Custom Software Development • Est. 2003 • Trust B • Hiring 98, 12 new
Svitla Systems is a global digital solutions and custom software engineering company headquartered in California, with delivery centers across North America, Latin America, Europe, and Asia. Founded in 2003, the company offers end-to-end IT services, including cloud architecture, AI/machine learning integration, data engineering, DevOps, and mobile and web application development.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 1 day ago Hiring now · 90%

Senior Data Engineer

≈ $90k – $204k per year (Estimated) • Senior • 5+ years exp • Remote (likely Argentina, Colombia, Mexico, Costa Rica) • Senior
Python
SQL
AI/ML
AI Agents
LLM
LLM Evaluation
DevOps
GitHub
Apply
Verified live · 3 hours ago 1 day ago Hiring now · 90%

Senior Full-Stack Engineer

≈ $54k – $125k per year (Estimated) • Senior • 6+ years exp • Argentina • Remote (Argentina) • Senior
JavaScript
AI/ML
AI Agents
LLM
LLM Evaluation
LLM Guardrails
Frontend
React.js
Mobile
React Native
DevOps
CI/CD
GitHub
+1
Apply

Level

level.me
level.me • HQ: Austin, United States • Trust A • Hiring 30, 2 new
HQ: Austin, United States • Trust A • Hiring 30, 2 new
Level is an educational technology and interactive learning company headquartered in Austin, Texas, with team presence in Bellevue, Washington, and Auckland, New Zealand. The company builds a digital learning platform that merges learning science and standards-aligned curricula with interactive game mechanics and software design to make academic practice engaging and rewarding. Focused initially on K-8 education - beginning with Math and English Language Arts (ELA) - its application delivers structured practice modules for students, workflow and engagement tools for teachers, and progress-tracking resources for parents.
No named decision-maker yet.
Careers mailbox is known
Verified live · 5 hours ago 1 day ago Likely open · 63%

Applied AI Engineer

≈ $129k – $245k per year (Estimated) • Senior • 7+ years exp • In office (Austin, United States) • Full-Time • Senior
Python
TypeScript
AI/ML
LangGraph
Claude
LlamaIndex
Embeddings
Prompt Engineering
Function Calling
Chain-of-Thought
AI Agents
Anthropic SDK
Instructor
Outlines
Pydantic AI
CrewAI
LLM
In-Context Learning
Hybrid Search
OpenAI Agents SDK
Human-in-the-Loop
Structured Outputs
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
Mastra
LangChain
DSPy
Model Context Protocol
GraphRAG
DevOps
GCP
AWS
Cybersecurity
NIST CSF
+25
Apply
Open 142 daysVerified live · 5 hours ago 5 months ago Long shot · 5%

Senior Applied AI Engineer

≈ $129k – $245k per year (Estimated) • Senior • 7+ years exp • In office (Austin, United States) • Relocation • Full-Time • Senior
Python
TypeScript
AI/ML
LangGraph
Claude
LlamaIndex
Embeddings
Prompt Engineering
Function Calling
Chain-of-Thought
AI Agents
Anthropic SDK
Instructor
Outlines
Pydantic AI
CrewAI
LLM
In-Context Learning
Hybrid Search
OpenAI Agents SDK
Human-in-the-Loop
Structured Outputs
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
Mastra
LangChain
DSPy
Model Context Protocol
GraphRAG
DevOps
GCP
AWS
+24
Apply

BOLD

bold.com
bold.com • Noida • San Francisco • Taipei • Job Boards & Aggregators • Recruiting & Staffing • Est. 2007 • Trust B • Hiring 23, 2 new
Noida • San Francisco • Taipei • Job Boards & Aggregators • Recruiting & Staffing • Est. 2007 • Trust B • Hiring 23, 2 new
Our family of BOLD solutions help jobseekers and employers. Our online destinations provide unique solutions that help people find jobs, and employers find people.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 1 day ago Likely open · 60%

Director, Security

≈ $50k – $131k per year (Estimated) • Head+ • 12+ years exp • Hybrid (Noida, India) • Architect
Python
Go
Java
SQL
Databases
GraphDB
AI/ML
LLM
LLM Guardrails
EU AI Act
Tool Use
LLM Evaluation
NIST AI RMF
Agentic Workflows
DevOps
Terraform
Azure
CI/CD
AWS
Kubernetes
Amazon EKS
Azure AKS
IAM
Cybersecurity
OWASP Top 10
PCI DSS
GDPR
Least Privilege
OWASP
+17
Apply
Machines can read this selection · checked 10:04 UTC
LLM Evaluation Jobs - Remote & On-site
Frequently asked questions
How many LLM Evaluation jobs are available on Alion?
There are currently 761 active listings from 478 hiring companies on Alion, refreshed daily.
What salary do LLM Evaluation jobs pay?
The average salary is around $238,075 per year based on the current listings.
Are remote options available for LLM Evaluation jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for LLM Evaluation jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.