2,348,292open jobs
147,256companies
285,762added this week
Browse all
Salary
$143k – $275k per year
Location
In office (Redmond)
Seniority
Principal · 8+ years exp
Visa
H-1B filings in 12 months: 6,957 · for this role: 5,005 · green card filings: 2,767

Confirmed on the employer's own hiring board on Nov 17, 2026. First seen by Alion on Nov 6, 2026. Microsoft scores A on the Alion truth index.

Overview
Company
Impact
Profile match
Microsoft is an American multinational technology corporation founded in 1975 by Bill Gates and Paul Allen and headquartered in Redmond, Washington. It built the personal computing era around the Windows operating system and the Office productivity suite, and now generates the largest share of its revenue from Azure cloud infrastructure and commercial subscriptions. The company also owns GitHub, LinkedIn and the Xbox gaming business, and has invested heavily in artificial intelligence through its partnership with OpenAI and the Copilot assistants embedded across its products.
Overview

Microsoft Foundry helps developers and organizations build, deploy and operate AI solutions at scale. Join an engineering team building the infrastructure that makes model training and inference faster, more reliable and more efficient for customers.

As a Principal Software Engineer, you will own an inference service and lead delivery across gateway and runtime boundaries, improving capacity and cost while meeting customer latency and availability expectations.

Responsibilities

  • Evaluate prefix caching, prefill/decode disaggregation, speculative decoding, quantization and tensor/expert parallelism.
  • Preserve streaming, cancellation, retries and token-accounting correctness.
  • Lead capacity planning, incident prevention and model onboarding; mentor engineers.
  • Build secure, tenant-isolated systems with automated testing, observability, reliable recovery and safe releases.
  • Participate in operational support and improve services using production feedback.
  • Preserve model quality and numerical correctness.
  • Use reproducible benchmarks to improve throughput, latency and cost.
  • Pursue near-linear throughput scaling where workloads permit, across agreed GPU and node configurations.
  • Build provider-aware serving stacks and integrate with supported training/post-training stacks for OpenAI, Anthropic, Microsoft AI (MAI) and open-source models.

Qualifications

Required Qualifications:

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Other Qualifications:

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
    • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

  • 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Proven distributed-services and model-serving delivery spanning at least two connected layers.
  • Proven software engineering fundamentals, debugging skills and clear cross-team communication.
  • Experience translating customer requirements into service objectives and measurable performance improvements.
  • Experience with containerized services, Kubernetes, and serving runtimes such as vLLM, SGLang or TensorRT-LLM.

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

https://careers.microsoft.com/us/en/us-corporate-pay

Software Engineering IC6 - The typical base pay range for this role across the U.S. is USD $165,600 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,348,292 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Remote, many countries
Similar stack
Same company
Redmond
$175k – $225k per year · In office · TS/SCI · 15+ years exp · Bachelor's Degree · Chantilly
Python
JavaScript
TypeScript
SQL
C#
Node JS
Python
Django
C#
.NET
Databases
Oracle
Frontend
React.js
DevOps
Ansible
GCP
Azure
CI/CD
Jenkins
AWS
Docker
Kubernetes
Configuration Management
GitHub
Linux
Windows
Management
Jira
Apply
In office · Full-Time · Fort Mill
JavaScript
TypeScript
C#
C#
ASP.NET Core
Entity Framework Core
Databases
Apache Kafka
Frontend
RxJS
Angular
DevOps
Rest API
Azure DevOps
Azure
AWS
AWS Lambda
Amazon EC2
Amazon S3
IAM
Amazon CloudWatch
Apply
$347k – $385k per year · In office · Full-Time · 9+ years exp · San Francisco
AI/ML
AI Agents
OpenAI
OpenAI Codex
Apply
$171k – $214k per year · Equity · Remote (United States) · 6+ years exp · Bachelor's Degree
Go
JavaScript
TypeScript
Databases
DynamoDB
Frontend
React.js
Mobile
Twilio
DevOps
Rest API
Apply
$113k – $193k per year · Hybrid · Top Secret · 5+ years exp · High School Diploma · La Crosse
JavaScript
TypeScript
Databases
RabbitMQ
ElasticSearch
Apache Kafka
Frontend
Angular
Mobile
Clean Architecture
DevOps
OpenTelemetry
Prometheus
Azure
Docker
Kubernetes
Apply
Remote (EAEU) · Moscow
Databases
Apache Kafka
Apply
up to $44k per year (net) · Remote (likely EAEU) · Moscow
Python
Perl
DevOps
WebRTC
Prometheus
Linux
Apply
$22k – $36k per year · Remote (EAEU) · 2+ years exp · Moscow
JavaScript
PHP
PHP
Laravel
PHPUnit
PHPStan
Databases
MySQL
Redis
AI/ML
Copilot
Cursor
Claude Code
DevOps
Rest API
GitHub Actions
GitLab CI
Git
Docker
Apply
$8.8k per year (net) · Remote (likely EAEU) · Full-Time · Perm
Java
DevOps
Git
Apply
Remote (likely EAEU) · Moscow
SQL
C#
C#
ASP.NET Core
AI/ML
Claude Code
AI Agents
DevOps
Git
Apply
$110k – $160k per year · Equity 0–0.2% · In office · Full-Time · 3+ years exp · Redmond
Python
JavaScript
SQL
Node JS
Databases
DynamoDB
ElasticSearch
AI/ML
Cursor
LangChain
Claude Code
Embeddings
Prompt Engineering
RAG
OpenAI
Hugging Face
Machine Learning
DevOps
AWS
AWS Lambda
Amazon EC2
IAM
Amazon ECS
Linux
Apply
Software Engineer 1 day ago
$85k – $168k per year · In office · 2+ years exp · Bachelor's Degree · Redmond
Python
JavaScript
C#
C++
DevOps
Azure
Docker
Kubernetes
Self-Healing
Apply
$85k – $168k per year · In office · 2+ years exp · Bachelor's Degree · Redmond
Python
JavaScript
C#
C++
AI/ML
Machine Learning
DevOps
Docker
Kubernetes
Cybersecurity
SIEM
Analytics
ETL/ELT
Apply
$120k – $235k per year · In office · 8+ years exp · Bachelor's Degree · Redmond
Cybersecurity
SOC 2
GDPR
FedRAMP
Apply
$85k – $115k per year · Equity · In office · Nationals only · 3+ years exp · Bachelor's Degree · Redmond
Apply
See all jobs
This is one of many
2,348,292 more open roles from verified company boards, updated every day.