2,299,313open jobs
145,909companies
270,197added this week
Browse all
Salary
$120k – $235k per year
Location
In office (Redmond)
Seniority
Senior · 4+ years exp
Visa
H-1B filings in 12 months: 6,957 · for this role: 5,265 · green card filings: 2,767

Confirmed on the employer's own hiring board on Nov 16, 2026. First seen by Alion on Nov 3, 2025. Microsoft scores B on the Alion truth index.

Overview
Company
Impact
Profile match
Microsoft is an American multinational technology corporation founded in 1975 by Bill Gates and Paul Allen and headquartered in Redmond, Washington. It built the personal computing era around the Windows operating system and the Office productivity suite, and now generates the largest share of its revenue from Azure cloud infrastructure and commercial subscriptions. The company also owns GitHub, LinkedIn and the Xbox gaming business, and has invested heavily in artificial intelligence through its partnership with OpenAI and the Copilot assistants embedded across its products.
Overview

Generative AI is transforming how people create, collaborate, and communicate-redefining productivity across Microsoft 365 for customers worldwide. At Microsoft, we operate one of the largest collaboration and productivity platforms in the world, serving hundreds of millions of consumer and enterprise users. Delivering these AI experiences at scale requires solving some of the hardest efficiency challenges in modern AI systems.

We are an applied research team focused on advancing efficiency across the AI stack, spanning models, ML frameworks, cloud infrastructure, and hardware. We drive mid- and long-term product innovation through close collaboration with research and product teams across the company. We communicate our research both internally and externally through internal technical reports, academic conference publications, open-source releases, and patents. Beyond producing research, we take responsibility for driving ideas through prototyping, validation, and production, with a bias toward real-world impact.

The candidate will work across the full stack-from large-scale serving systems to hardware- and kernel-level optimizations-exploring algorithmic, systems, and hardware/software co-design techniques. Areas of focus include batching, routing, scheduling, caching, endpoint configuration, and GPU architecture-aware optimizations. This role emphasizes end-to-end ownership, with responsibility for identifying high-impact problems and driving research ideas through prototyping, validation, and deployment to deliver measurable customer impact.

For more see: https://aka.ms/efficient-ai

Responsibilities

  • Formulate, develop, and evaluate new algorithmic and system-level approaches for end-to-end AI serving, using analytical modeling and large-scale measurement to study token-level latency, tail latency (p95/p99), throughput-per-dollar, cold-start behavior, warm pool strategies, and capacity planning under multi-tenant SLOs and variable sequence lengths.
  • Design and experimentally evaluate endpoint configuration and execution policies, including batching, routing, and scheduling strategies, tensor and pipeline parallelism, quantization and precision profiles, speculative decoding, and chunked or streaming generation, and drive the most promising approaches through robust rollout and validation into production.
  • Perform hardware- and kernel-aware optimization by collaborating closely with model, kernel, compiler, and hardware teams to align serving algorithms with attention/KV innovations and accelerator capabilities.
  • Build and benchmark experimental prototypes and large-scale measurements to validate research ideas and drive them toward production readiness; produce clear technical documentation, design reviews, and operational playbooks.
  • Publish research results, file patents, and, where appropriate, contribute to open-source systems and serving frameworks

Qualifications

Required Qualifications

  • Doctorate in relevant field OR Master's Degree in relevant field AND 3+ years related research experience OR Bachelor's Degree in relevant field AND 4+ years related research experience OR equivalent experience.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications

  • Demonstrated experience in designing and optimizing efficient inference systems, combining foundations in algorithmic optimization, parallel computing, and request orchestration under strict SLO constraints with deep knowledge of attention and KV-cache optimizations, batching and scheduling strategies, and cost-aware deployment.
  • 3+ years of experience with machine learning frameworks (e.g., PyTorch, TensorFlow) and inference serving frameworks (e.g., vLLM, Triton Inference Server, TensorRT-LLM, ONNX Runtime, Ray Serve, DeepSpeed-MII).
  • 3+ years of experience in GPU programming and optimization, with expert knowledge of CUDA, ROCm, Triton, PTX, CUTLASS, or similar GPU programming frameworks.
  • Proficiency in C++ and Python for high-performance systems, with code quality and profiling/debugging skills
  • Research impact through publications and/or patents, coupled with hands-on experience taking research ideas through execution and delivery in production.

#M365Core #M365Research #Research

Research Sciences IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,299,313 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Remote, many countries
Similar stack
Same company
Redmond
$102k – $210k per year · Equity · In office · Secret · 10+ years exp · Bachelor's Degree · Reston
AI/ML
AI Agents
RAG
Edge AI
Management
Agile
Apply
$113k – $235k per year · Equity · In office · 3+ years exp · Bachelor's Degree · United States
AI/ML
LangChain
LlamaIndex
MLFlow
Fine-tuning
Prompt Engineering
Multimodal AI
Computer Vision
Transformers
LLM
LLMOps
Machine Learning
Apply
$125k – $175k per year · Hybrid · 3+ years exp · New York
Apply
AI Claims Engineer 6 hours ago
$125k – $175k per year · In office · Full-Time · 3+ years exp · New York
Apply
Equity · In office · Full-Time · San Francisco
Python
AI/ML
Reinforcement Learning
AI Agents
LLM
OpenAI
Post-training
Reward Modeling
Machine Learning
Apply
$25k – $36k per year · Remote (EAEU) · 3+ years exp · Moscow
Python
SQL
AI/ML
Claude
DeepSeek
AI Agents
Langfuse
LLM
RAG
OpenAI
Anthropic
Machine Learning
Apply
Remote (EAEU) · Tashkent
AI/ML
Claude
Prompt Engineering
YandexGPT
Gemini
LLM
RAG
OpenAI
DevOps
Rest API
WebSockets
Git
Docker
Apply
Hybrid · 3+ years exp · Moscow
AI/ML
Claude Code
Model Context Protocol
AI Agents
DevOps
CI/CD
Kubernetes
GitLab
Apply
Remote (EAEU) · Full-Time · Saint Petersburg
Python
Databases
ClickHouse
AI/ML
CatBoost
Computer Vision
NLP
LightGBM
PyTorch
Apply
Remote (likely Europe, North America) · Contractor
Python
SQL
Databases
PostgreSQL
DuckDB
Qdrant
AI/ML
Semantic Search
Apply
$46k – $50k per year · Equity · In office · 1+ year exp · High School Diploma · Redmond
Cybersecurity
HIPAA
Apply
Equity · In office · Full-Time · 2+ years exp · High School Diploma · Redmond
Apply
In office · Redmond · Washington
Apply
$102k – $202k per year · In office · 5+ years exp · Bachelor's Degree · Redmond
Apply
In office · Full-Time · Redmond
Apply
See all jobs
This is one of many
2,299,313 more open roles from verified company boards, updated every day.