2,365,226open jobs
148,022companies
288,497added this week
Browse all
Location
In office (Seattle)
Seniority
Middle · 3+ years exp
Visa
H-1B filings in 12 months: 6,518 · for this role: 2,981 · green card filings: 214

Confirmed on the employer's own hiring board on Nov 18, 2026. First seen by Alion on Nov 16, 2026. Apple scores A on the Alion truth index.

Overview
Company
Impact
Profile match
Apple is an American multinational technology company founded in 1976 by Steve Jobs, Steve Wozniak and Ronald Wayne, and headquartered in Cupertino, California. It designs and sells consumer hardware including the iPhone, Mac, iPad, Apple Watch, AirPods and Vision Pro, together with the operating systems and silicon that run them. A growing services division built around the App Store, iCloud, Apple Music, Apple TV+ and Apple Pay now contributes a large share of profit, making Apple one of the most valuable companies in the world.

AI systems are only as trustworthy as the methods used to evaluate them. At Apple, where AI powers experiences for billions of people, getting evaluation right is not a support function, it is a foundational science. Our team, part of Apple Services Engineering, is building that scientific foundation: rigorous, scalable evaluation methodology for LLMs, agentic systems, and human-AI interaction. Our goal is evidence that teams can act on: what to measure, whether a change helped, why a system failed, and whether it is ready to ship.

What makes this team unusual is its interdisciplinary core. You will work alongside measurement scientists (psychometrics, validity theory), ML researchers, and platform engineers, bringing together ML research, statistical rigor, and production engineering.

We are looking for an Applied Scientist who works across the full arc of evaluation science: turning research into tools engineers can use on their own, and turning what those engineers run into new research. You care whether a method holds up on real data, at real scale, for a real decision, and you are curious enough to go after the open question underneath when it doesn't.

Description

Our team is building self-service evaluation: tools, SDKs, and AI-powered capabilities that let engineers across Apple evaluate their AI features on their own, quickly and correctly, so they can build and ship those features faster. You will develop the methods that make this possible: raising the quality of the evaluations engineers run, and helping them understand what their results mean and what to do next. Often the method a problem needs doesn't exist yet. When that happens, you will figure it out, whether that means extending a recent paper or developing something new, and share what you learn through publications and internal research reports. We are looking for individuals across a range of experience levels.

With research and measurement scientists, you will co-develop new methods, make sure the tools give engineers valid, trustworthy signals, and bring back the hard problems that should shape the team's research agenda. With platform and research engineers, you will define what each method needs to work reliably without an expert in the loop, including its assumptions, failure modes, and validation tests, so it can ship in the evaluation SDKs and APIs used across Apple.

The successful candidate combines scientific depth with practical judgment: you know which methods fit a problem and why, can design experiments that show whether they actually work, can diagnose why they break down on messy real-world data, and can explain clearly what an evaluation result does and does not support.

Minimum Qualifications

Ph.D. in Computer Science, Machine Learning, Statistics, or a closely related field, or a Master's degree in one of these fields with 3+ years of applied research experience.

Deep expertise in evaluating AI systems, gained through research on evaluation methods, substantial hands-on experience evaluating LLMs or agentic systems in real products, or both.

Strong proficiency in Python and the modern ML ecosystem, with demonstrated ability to implement complex methods from recent papers and run large-scale experiments.

Hands-on experience with large language models, whether fine-tuning, inference, prompting pipelines, or building LLM-powered applications.

Demonstrated research ability through publications at peer-reviewed venues, preprints, or equivalent research output.

Track record of applying research to practical problems: methods, prototypes, or tools adopted by other teams or used to inform real product decisions.

Solid software engineering fundamentals for research code: version control, testing, reproducibility, and code others can build on.

Excellent written and verbal communication skills, including the ability to explain complex results, and their limitations, to diverse audiences.

Comfort with ambiguity and new problem spaces; you thrive when building something that doesn't yet have a playbook.

Preferred Qualifications

First-author publications at top-tier venues (NeurIPS, ICML, ICLR, ACL, EMNLP), especially on evaluation methodology: papers about how to evaluate, not just papers that use evaluation to demonstrate model improvements.

Specific experience in one or more of: LLM-as-judge approaches (calibration, rubric design, bias mitigation); benchmark design and validation (IRT, contamination detection); human evaluation methodology (protocol design, quality control); experimentation and comparisons between system versions (A/B testing, uncertainty quantification); or agentic and multi-agent system evaluation, including failure diagnosis and automated red-teaming.

Familiarity with theoretical foundations of evaluation: measurement theory and validity frameworks, statistical learning theory (calibration, reliability, decision theory), causal inference, or preference aggregation.

Experience with the practical challenges of evaluating generative AI and agentic systems: non-deterministic outputs, token economics, multi-turn agent trajectories, and tool use.

Experience building methods or tools used directly by non-experts, such as developer-facing ML tooling or self-service analytics.

Familiarity with modern evaluation tools and frameworks (e.g., DeepEval, Ragas, TruLens, LangSmith, or agent tracing and observability tools).

Experience working with distributed computing or cloud-native tooling (e.g., Ray, Spark, Docker/Kubernetes) to run evaluations at scale.

Experience with cross-disciplinary work, such as collaboration with social scientists, psychometricians, or domain experts.

Experience in fast-moving, early-stage teams where you helped define technical direction from the ground up.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,365,226 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Remote, many countries
Similar stack
Same company
Seattle
$160k – $235k per year · Remote (United States) · 10+ years exp · Bachelor's Degree · United States
DevOps
HPC
Apply
$230k – $262k per year · Hybrid · Full-Time · 6+ years exp · Bachelor's Degree · New York · McLean · Cambridge
Python
Go
Java
C++
Scala
C++
TensorFlow C++
AI/ML
Spark
Reinforcement Learning
Scikit-learn
Transformers
TensorFlow
Pandas
NumPy
PyTorch
Ray
Explainable AI
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Kubernetes
Management
Agile
Apply
$230k – $262k per year · Hybrid · Full-Time · 6+ years exp · Bachelor's Degree · McLean · Richmond
Python
Go
Java
C++
Scala
C++
TensorFlow C++
AI/ML
Spark
Reinforcement Learning
Scikit-learn
Transformers
TensorFlow
Pandas
NumPy
PyTorch
Ray
Explainable AI
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Kubernetes
Management
Agile
Apply
$134k – $168k per year · In office · Full-Time · 3+ years exp · Bachelor's Degree · Boston
Python
SQL
AI/ML
Feature Store
Machine Learning
Analytics
ETL/ELT
Apply
In office · Full-Time · 8+ years exp · Master's Degree · Los Altos
Python
C++
Apply
$22k – $44k per year (net) · Remote (EAEU) · 3+ years exp · Yekaterinburg
Python
JavaScript
TypeScript
SQL
Node JS
Python
FastAPI
Django
AI/ML
AI Agents
LLM
RAG
DevOps
Rest API
CI/CD
Git
Docker
GitHub
Apply
$55k – $88k per year (net) · Remote (EU) · Full-Time · Tallinn
Python
PowerShell
AI/ML
AI Agents
AWS Bedrock
LLM
LLM Guardrails
DevOps
Terraform
CI/CD
AWS
Docker
Kubernetes
Amazon EKS
Apply
AI Platform Engineer 12 hours ago
$49k – $79k per year · Remote (EU) · Full-Time · Riga
Python
PowerShell
AI/ML
AI Agents
AWS Bedrock
LLM
LLM Guardrails
DevOps
Terraform
CI/CD
AWS
Docker
Kubernetes
Amazon EKS
Apply
$30k – $36k per year · Remote (LATAM, Europe, Africa, US time zones hours) · Full-Time · 5+ years exp
JavaScript
TypeScript
Node JS
Node JS
Nest.JS
Prisma
AI/ML
Claude
Claude Code
Model Context Protocol
Function Calling
AI Agents
OpenAI Codex
Multi-Agent Systems
Frontend
Turborepo
DevOps
GitHub Actions
CI/CD
AWS
Docker
AWS Fargate
Amazon ECS
Cybersecurity
ISO 27001
SOC 2
Apply
$54k – $60k per year · Remote (LATAM, Europe, Africa, US time zones hours) · Contractor · 5+ years exp · Bachelor's Degree
Python
TypeScript
C#
C#
.NET
Databases
Databricks
Amazon Redshift
AI/ML
Claude
Model Context Protocol
AI Agents
AWS Bedrock
LLM
AWS Bedrock AgentCore
Human-in-the-Loop
Structured Outputs
DevOps
AWS
Management
Zapier
Apply
Hybrid · Full-Time · 10+ years exp · Bengaluru
Python
JavaScript
Java
TypeScript
SQL
Node JS
Perl
Databases
Databricks
Oracle
Azure Cosmos DB
Azure SQL Database
DevOps
Rest API
Azure
CI/CD
GitLab
Unix
SOAP
Management
Jira
Oracle ERP
Apply
Hybrid · Full-Time · Master's Degree · Bengaluru
Python
SQL
Databases
MS SQL
Analytics
Power BI
Apply
In office · Bachelor's Degree · Thousand Oaks
Python
PowerShell
C#
Bash
Databases
Oracle
MS SQL
DevOps
Linux
Windows
Apply
In office · Bachelor's Degree · Carlsbad
Python
PowerShell
C#
Bash
Databases
Oracle
MS SQL
DevOps
Linux
Windows
Apply
In office · Bachelor's Degree · Walnut Creek
Python
PowerShell
C#
Bash
Databases
Oracle
MS SQL
DevOps
Linux
Windows
Apply
In office · PhD · Seattle
Python
AI/ML
AI Agents
LLM
Machine Learning
Apply
In office · Seattle
AI/ML
LLM
Apply
In office · 3+ years exp · Bachelor's Degree · Seattle
Python
AI/ML
Spark
NLP
MLX ML
LLM
Ray
Tokenization
LLM Guardrails
Edge AI
Machine Learning
Mobile
Core ML
DevOps
CI/CD
Kubernetes
Apply
In office · 10+ years exp · Bachelor's Degree · Cupertino
Python
Rust
C++
Rust
PyO3
Databases
Apache Iceberg
Delta Lake
DuckDB
RocksDB
AI/ML
Polars
JAX
Multimodal AI
PyTorch
Ray
Megatron-LM
TPU
DevOps
Amazon S3
Apply
In office · 8+ years exp · PhD · Cupertino
Python
AI/ML
Fine-tuning
Quantization
JAX
PyTorch
Time Series
Machine Learning
Apply
$184k – $249k per year · Equity · In office · Full-Time · 6+ years exp · Master's Degree · Arlington · New York · Seattle
Python
Java
C++
AI/ML
Machine Learning
Apply
$147k – $261k per year · Hybrid · Full-Time · Associate's Degree · San Jose · San Francisco · Los Angeles · Seattle
DevOps
GCP
Apply
In office · Nationals only · Full-Time · Seattle
Management
Agile
Apply
In office · Nationals only · Full-Time · Seattle
Management
Agile
Apply
$103k per year · In office · Secret · Full-Time · 3+ years exp · Seattle
DevOps
Splunk
VMWare
Windows Server
Windows
Apply
See all jobs
This is one of many
2,365,226 more open roles from verified company boards, updated every day.