955,510open jobs
57,746companies
157,915added this week
Browse all
Salary
$185k – $250k per year
Location
In office (Seattle)
Seniority
Staff · 8+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Sep 30, 2026. First seen by Alion on Sep 30, 2026.

Overview
Company
Impact
Profile match
Amazon is an American technology and retail conglomerate founded by Jeff Bezos in 1994 as an online bookstore and headquartered in Seattle, Washington. It operates the world's largest online marketplace together with a global logistics network, physical grocery stores and a third-party seller platform that accounts for most units sold. Amazon Web Services, launched in 2006, is the leading public cloud provider and generates the majority of the group's operating profit, while advertising, Prime Video, Alexa devices and Kuiper satellite broadband round out the business.

We are looking for a talented Software Development Manager to lead the team that powers A/B testing at Amazon, guiding builders from setup through execution, analysis, launching, reporting, and learning. The team owns the experimentation process end-to-end, driving Amazon's innovation cycle through rapid evaluation of ideas. The manager of this team is the single threaded owner of the experimentation process.

Key job responsibilities

Work backwards from customers. The experimentation leader is the single threaded owner of running randomized experiments at Amazon. The SDM must closely understand the customer problems to ensure we're working backwards from the most critical customer needs.

Work closely with Science. Weblab is fundamentally a science and engineering product with neither able to operate at maximum effectiveness without the other.

Relentlessly Prioritize. The team will receive far more asks for things to build and to support away teams than we can feasibly support.

Trade off technical decisions. The team will be faced with high stakes technical tradeoff decisions. The SDM needs to listen to the opinions and recommendations of their tech leads while being able to make a clear decision.

Manage large scale operations. The scale of the operations of the team is massive, both in terms of analyses run but also distinct teams and users. Small bugs can create massive headaches if they aren't caught or we don't have systems to detect issues and respond quickly.

A day in the life

Within the team we have a capable mix of developers at all points in their careers. The developers tend to be attracted to the hard scaling problems, and the complex user-experience required to guide people through statistical reasoning. The team also works closely with scientists who work on hard problems around causal inference and how to tease out quiet signals from a wealth of noise across disparate groups in Amazon. Weblab powers hundreds of thousands of experiments per year ran by tens of thousands of unique users each with their own needs and requirements.

About the team

Amazon’s Weblab team provides experiment based support to launch product changes, make product decisions, and evaluate the impact on customers. A/B testing is in Amazon’s DNA, and we are at the core of how Amazon innovates on behalf of customers. Be part of the team that helps Amazonians uncover the real impact of product changes to avoid accidental harm to customers or the business.

Basic qualifications

- 3+ years of engineering team management experience

- 7+ years of working directly within engineering teams experience

- 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience

- 8+ years of leading the definition and development of multi tier web services experience

- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations

- Experience partnering with product or program management teams

Preferred qualifications

- Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy

- Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, Seattle - 184,900.00 - 250,200.00 USD annually

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
955,510 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Management
Similar stack
Same company
Seattle
Leader in Training 9 hours ago
≈ $61k – $137k per year (Estimated) • In office • 1+ year exp • Warwick
Apply
≈ $97k – $191k per year (Estimated) • Hybrid • 10+ years exp • Bachelor's Degree • Atlanta
Management
Microsoft Office
Apply
$120k – $180k per year • Hybrid • 10+ years exp • Bachelor's Degree • Greenwood Village
Design
AutoCAD
Management
Outlook
Microsoft Office
Apply
$88k – $115k per year • Hybrid • 10+ years exp • Bachelor's Degree • Chicago
Apply
$160k – $190k per year • Hybrid • Top Secret • 8+ years exp • Bachelor's Degree • Washington
Apply
In office • Full-Time • Bachelor's Degree • Jakarta
Analytics
A/B Testing
Marketing
Google Ads
TikTok Ads
Shopify
Apply
≈ $20k – $41k per year (Estimated) • In office • Full-Time • 5+ years exp • Hyderabad
Python
Python
pySpark
Databases
Snowflake
Databricks
AI/ML
Spark
dbt
DevOps
Terraform
GitHub Actions
Datadog
Prometheus
Azure
CI/CD
Git
AWS
Grafana
Platform Engineering
IAM
Analytics
Tableau
Power BI
A/B Testing
Fivetran
Looker
Apply
≈ $203k – $431k per year (Estimated) • In office • Los Angeles
Databases
Redis
Apache Kafka
AI/ML
Vertex AI
Reinforcement Learning
JAX
Flink
TensorFlow
PyTorch
Ray
Amazon SageMaker
Feature Store
Machine Learning
Analytics
A/B Testing
Apply
≈ $156k – $305k per year (Estimated) • Equity • Remote (Poland) • Full-Time • 7+ years exp • Phoenix
Python
Databases
Databricks
AI/ML
LangGraph
LangChain
Model Context Protocol
Embeddings
Function Calling
AI Agents
NLP
Arize Phoenix
Langfuse
LangSmith
Semantic Kernel
AWS Bedrock
Gemini
LLM
RAG
Hybrid Search
OpenAI
Anthropic
AWS Bedrock AgentCore
A2A
Human-in-the-Loop
Context Engineering
LLM Guardrails
Tool Use
DevOps
GCP
Azure
CI/CD
AWS
Platform Engineering
Analytics
A/B Testing
Management
Agile
Apply
≈ $42k – $98k per year (Estimated) • Remote (Colombia, Mexico) • 7+ years exp • Bachelor's Degree • Barranquilla
SQL
AI/ML
AI Agents
Analytics
A/B Testing
Management
Google Docs
Apply
$185k – $250k per year • Equity • In office • Full-Time • 7+ years exp • Bachelor's Degree • Boston
AI/ML
LoRA
Fine-tuning
RLHF
PEFT
Amazon SageMaker
SFT
Machine Learning
DevOps
AWS
Kubernetes
Amazon EKS
Amazon EC2
Amazon S3
AWS Step Functions
Apply
$116k – $160k per year • Equity • In office • Full-Time • 5+ years exp • Master's Degree • Austin
Apply
$220k – $298k per year • Equity • In office • Full-Time • 10+ years exp • Boston
AI/ML
Post-training
Management
Agile
Apply
$116k – $160k per year • Equity • In office • Full-Time • 5+ years exp • Master's Degree • Austin
Apply
$185k – $250k per year • Equity • In office • Full-Time • 7+ years exp • Bachelor's Degree • Seattle
AI/ML
Model Context Protocol
Agentic Workflows
DevOps
AWS
Apply
$88k – $93k per year • In office • Full-Time • 5+ years exp • High School Diploma • Seattle
AI/ML
Supervision
Apply
$130k – $175k per year • In office • 10+ years exp • Seattle
Design
AutoCAD
Apply
$80k – $115k per year • In office • 5+ years exp • Bachelor's Degree • Seattle
Cybersecurity
HIPAA
Management
Outlook
Microsoft Office
Apply
$84k – $127k per year • In office • Contractor • 3+ years exp • Seattle
PHP
PHP
WordPress
Drupal
Apply
Underwriter I, PL 1 day ago
≈ $71k – $185k per year (Estimated) • Remote (United States) • Seattle
Apply
See all jobs
This is one of many
955,510 more open roles from verified company boards, updated every day.