{"id":2795414,"url":"https://alion.io/job/microsoft-principal-software-engineer-ml-distributed-systems","title":"Principal Software Engineer, ML & Distributed Systems","company":{"id":18,"name":"Microsoft","domain":"microsoft.com","url":"https://alion.io/company/microsoft","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Eightfold","truth_index":{"grade":"B","score":75,"open_postings":157,"ghost_share":0,"stale_share":0.987,"repost_share":0,"time_to_fill_p50_days":28,"computed_at":"2026-10-17T05:46:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Redmond, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":142800,"max":274800,"currency":"USD","period":"year","gross":null,"usd_annual":274800},"salary_estimate":null,"experience_years_min":12,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C#","optional":false},{"name":"C++","optional":false},{"name":"Fine-tuning","optional":false},{"name":"JavaScript","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Microsoft Office","optional":false},{"name":"Python","optional":false},{"name":"Feature Store","optional":true},{"name":"Prompt Engineering","optional":true},{"name":"RAG","optional":true},{"name":"Redis","optional":true}],"status":"live","first_seen_at":"2026-07-30T00:21:47Z","employer_posted_date":"2026-09-01","last_verified_at":"2026-10-18T01:48:00Z","board_verified":true,"closed_at":null,"days_open":80,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":80},"description":"OverviewWe are looking for a Principal Software Engineer to design, build, and operationalize machine learning systems and hyperscale distributed services that power Microsoft's AI experiences. This is a role for an engineer who is equally at home training and shipping ML models and building the large-scale distributed infrastructure that serves them - and who has the appetite to do both. You will own systems end to end: from model development and evaluation, through the serving and orchestration layers, to reliable operation at hyperscale.\nMSN is a personalized content feed powering user experiences across Microsoft. Our mission is to empower every person on the planet to be informed, entertained, and inspired. With nearly 30 years of history, MSN has evolved into a premier content destination with high-quality content, AI-powered user-controlled personalization, and massive global reach. Over the past 4 years, AI and Machine Learning technologies have fueled massive growth, transforming MSN’s content moderation, personalization, and content entry points.Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.\nStarting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.\nResponsibilities\nDesign, build, and operationalize scalable ML and deep learning models using containers and orchestration platforms (e.g., Kubernetes).\nDevelop and refine LLM prompt and fine-tuning strategies, build evaluation pipelines, and continuously optimize model quality, latency, and cost.\nArchitect, implement, and operate multi-tiered distributed services at hyperscale, with high availability, fault tolerance, and low latency.\nBuild model serving and inference infrastructure, including caching, batching, GPU capacity management, and A/B experimentation at scale.\nDesign scalable APIs, data pipelines, and feature/signal stores that ensure efficient, secure, and reliable data flow between ML systems and product surfaces.\nDrive live-site excellence: instrumentation, monitoring, capacity planning, and incident response for ML-backed services.\nCollaborate with applied scientists, data scientists, backend engineers, and product teams to translate requirements into production ML systems.\nParticipate in code reviews and architectural discussions, and mentor engineers across both ML and systems disciplines.\nQualifications\nRequired Qualifications:\nBachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR equivalent experience.\n\nPreferred Qualifications:\nMaster's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python\nOR equivalent experience.\n\nProven experience designing, developing, and operating multi-tiered distributed services at scale.\nHands-on experience building, deploying, and operating machine learning systems in production (model training, evaluation, and/or LLM-based applications).\nExperience working through full product cycles, from initial design to final delivery.\nExperience with LLM application patterns: prompt engineering, RAG, fine-tuning, and model evaluation frameworks.\nExperience with ML infrastructure: distributed training, inference optimization, GPU capacity management, and orchestration platforms such as Kubernetes.\nExperience with large-scale data systems (streaming, caching such as Redis, feature stores) and experimentation platforms.\nDemonstrated ability to work across the ML/systems boundary and a strong desire to keep doing both.\n#MicrosoftAI #Software Engineer #ML engineer\nSoftware Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.\nCertain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:\nhttps://careers.microsoft.com/us/en/us-corporate-pay\nThis position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.\nMicrosoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.","description_format":"text","description_chars":5934,"description_truncated":false,"requirements":{"experience_years_min":12,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Console Games","Cloud Platforms (IaaS & PaaS)","Gaming Consoles","Developer Tools"],"lifecycle":[{"event":"open","at":"2026-10-17T22:28:43Z"}],"visa":[],"liveness":{"score":15,"band":"cold","label":"Long shot","p_open":1,"p_active":0.518,"p_room":0.28,"age_days":80,"expected_fill_days":28,"reasons":["conf:3","win:tail","crowd:brand"],"computed_at":"2026-10-18T04:48:49Z"},"pay":{"stated_usd_annual":274800,"is_top_pay":true},"html_url":"https://alion.io/job/microsoft-principal-software-engineer-ml-distributed-systems","json_url":"https://alion.io/job/microsoft-principal-software-engineer-ml-distributed-systems.json","meta":{"generated_at":"2026-10-18T04:48:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7219,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":18},"rest":"https://alion.io/mcp/rest/get_company?id=18"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmicrosoft-principal-software-engineer-ml-distributed-systems"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmicrosoft-principal-software-engineer-ml-distributed-systems"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmicrosoft-principal-software-engineer-ml-distributed-systems"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/microsoft-principal-software-engineer-ml-distributed-systems\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmicrosoft-principal-software-engineer-ml-distributed-systems"}]}