1,981,693open jobs
116,967companies
252,700added this week
Browse all
Salary
$184k – $249k per year
Location
In office (New York)
Seniority
Senior · 6+ years exp
Visa
H-1B filings in 12 months: 16,768 · for this role: 10,545 · green card filings: 56
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 26, 2026. First seen by Alion on Apr 13, 2026. Amazon scores B on the Alion truth index.

Overview
Company
Impact
Profile match
Amazon is an American technology and retail conglomerate founded by Jeff Bezos in 1994 as an online bookstore and headquartered in Seattle, Washington. It operates the world's largest online marketplace together with a global logistics network, physical grocery stores and a third-party seller platform that accounts for most units sold. Amazon Web Services, launched in 2006, is the leading public cloud provider and generates the majority of the group's operating profit, while advertising, Prime Video, Alexa devices and Kuiper satellite broadband round out the business.

We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role, you will focus on designing how we measure, stress-test, and improve robot behavior across a wide range of real-world tasks. Your work will play a critical role in shaping how policies are validated and how high-quality datasets are generated to accelerate system performance.

You will operate at the intersection of robotics, machine learning, and human-in-the-loop systems, building the infrastructure and methodologies that connect teleoperation, evaluation, and learning. This includes developing evaluation policies, defining task structures, and contributing to operator-facing interfaces that enable scalable and reliable data collection.

The ideal candidate is highly experimental, systems-oriented, and comfortable working across software, robotics, and data pipelines, with a strong focus on turning ambiguous capability goals into measurable and actionable evaluation systems.

Key job responsibilities

- Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios

- Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies

- Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs

- Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection

- Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection

- Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack

- Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches

- Lead technical projects from conception through production deployment

- Mentor junior scientists and engineers

Basic qualifications

- PhD, or Master's degree and 6+ years of applied research experience

- 3+ years of industry or academic research experience

- Experience with any programming language such as Python, Java, C++

- 5+ years of building machine learning models or developing algorithms for business application experience

- Experience leading technical initiatives and key deliverables

- - Experience in patents or publication at top-tier conferences

- - Demonstrated expertise in deep learning and model development

- - Strong experience with robotics systems, control, or embodied AI

- - Experience designing evaluation methodologies, benchmarks, or experimental frameworks for large-scale ML models or robotic systems

- - Familiarity with teleoperation systems, simulation environments, or human-in-the-loop data collection

Preferred qualifications

- Experience managing and deploying ML products

- - Experience in patents or publications at top-tier peer-reviewed conferences or journals

- - Experience leading research initiatives in robotics or foundation models

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, NY, New York - 183,800.00 - 248,700.00 USD annually

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,981,693 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Similar stack
Same company
New York
$155k – $256k per year • Equity • Hybrid • Full-Time • 5+ years exp • Bachelor's Degree • San Jose
Python
Go
AI/ML
LLM
NCCL
DevOps
Splunk
Terraform
OpenShift
etcd
Prometheus
SLURM
CI/CD
GitOps
Kubernetes
Grafana
Apply
$203k – $297k per year • Equity • Hybrid • Full-Time • 7+ years exp • Bachelor's Degree • Milpitas • Plano
Python
Go
DevOps
Splunk
Terraform
GCP
Helm
Azure
CI/CD
GitOps
ArgoCD
Jenkins
AWS
Docker
Kubernetes
AIOps
GitHub
Apply
≈ $138k – $255k per year (Estimated) • Remote (United States) • 5+ years exp • Master's Degree
Python
AI/ML
TensorFlow
PyTorch
Machine Learning
DevOps
Platform Engineering
Apply
≈ $179k – $358k per year (Estimated) • In office • Full-Time • Paris
Python
Bash
AI/ML
Physical AI
DevOps
GitHub
Windows
Cybersecurity
Okta
ISO 27001
SOC 2
Microsoft Entra ID
Management
Notion
Apply
$180k – $220k per year • In office • Full-Time • 5+ years exp • Waltham
Python
JavaScript
TypeScript
Databases
PostgreSQL
Redis
AI/ML
Claude Code
Fine-tuning
Computer Vision
AI Agents
LLM
Context Engineering
Frontend
React.js
DevOps
OpenTelemetry
Apply
≈ $44k – $115k per year (Estimated) • Remote (Spain) • Full-Time • Bachelor's Degree • Madrid
Python
Java
C#
C#
.NET
DevOps
Rest API
GCP
Azure
AWS
Docker
Kubernetes
Apply
≈ $58k – $117k per year (Estimated) • In office • Full-Time • 3+ years exp • Nottingham
Python
SQL
Python
pySpark
Databases
Databricks
AI/ML
Spark
Fine-tuning
LLM
Time Series
Machine Learning
DevOps
Azure DevOps
Azure
Git
Apply
≈ $22k – $48k per year (Estimated) • In office • 5+ years exp • Bachelor's Degree • Bengaluru
Python
Databases
SAP HANA
Analytics
Tableau
Power BI
Management
Power Automate
Apply
≈ $24k – $48k per year (Estimated) • In office • Full-Time • 9+ years exp • Bachelor's Degree • Bengaluru • Chennai
Java
COBOL
COBOL
CICS
VSAM
Databases
Db2
DevOps
Unix
Apply
$128k – $214k per year • In office • TS/SCI • 14+ years exp • Associate's Degree • Fort Meade
Python
Bash
Perl
DevOps
Ansible
Rancher
VMWare
AWS
Kubernetes
Linux
Cybersecurity
PKI
Apply
$143k – $193k per year • Equity • In office • Full-Time • Seattle
Python
Java
C++
AI/ML
LLM
Machine Learning
Apply
$143k – $193k per year • Equity • In office • Full-Time • Master's Degree • Seattle • Arlington
Python
Java
C++
AI/ML
Machine Learning
DevOps
Linux
Unix
Apply
$199k – $269k per year • Equity • In office • Full-Time • 7+ years exp • PhD • Seattle • Denver
Python
AI/ML
Computer Vision
Hallucination
Machine Learning
DevOps
AWS
Apply
$136k – $184k per year • Equity • In office • Full-Time • 10+ years exp • Bachelor's Degree • Seattle
Apply
$167k – $226k per year • Equity • In office • Full-Time • 6+ years exp • Master's Degree • Seattle
Python
Java
C++
AI/ML
Fine-tuning
Prompt Engineering
NLP
Speech Recognition
RAG
Multi-Agent Systems
Machine Learning
Apply
$200k – $320k per year • In office • New York
AI/ML
Machine Learning
Apply
$200k – $320k per year • In office • New York
AI/ML
Machine Learning
Apply
$74k – $129k per year • Equity • In office • Full-Time • 2+ years exp • Bachelor's Degree • New York
Apply
$180k – $270k per year • In office • New York
Apply
$240k – $400k per year • In office • New York
Apply
See all jobs
This is one of many
1,981,693 more open roles from verified company boards, updated every day.