{"id":2746523,"url":"https://alion.io/job/microsoft-principal-software-engineering-ai-infrastructure","title":"Principal Software Engineering, AI Infrastructure","company":{"id":18,"name":"Microsoft","domain":"microsoft.com","url":"https://alion.io/company/microsoft","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Eightfold","truth_index":{"grade":"B","score":75,"open_postings":93,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":28,"computed_at":"2026-10-16T05:45:00Z"}},"role":"Backend","role_family":"Backend","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":142800,"max":274800,"currency":"USD","period":"year","gross":null,"usd_annual":274800},"salary_estimate":null,"experience_years_min":12,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure AKS","optional":false},{"name":"C#","optional":false},{"name":"C++","optional":false},{"name":"Go","optional":false},{"name":"JavaScript","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"Python","optional":false},{"name":"CUDA","optional":true},{"name":"CUDA Toolkit","optional":true},{"name":"NCCL","optional":true}],"status":"live","first_seen_at":"2026-10-08T20:03:12Z","employer_posted_date":"2026-10-16","last_verified_at":"2026-10-17T02:14:05Z","board_verified":true,"closed_at":null,"days_open":8,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":8},"description":"OverviewThe FIT Infrastructure team builds the foundational accelerated compute platforms that power large scale AI training and inference for Microsoft. Our mission is to deliver secure, reliable, and highly efficient GPU infrastructure that enables multi-tenant AI systems at global scale while maximizing utilization, availability, performance, and reliability.\nThis role sits at the intersection of cloud infrastructure, distributed systems software, and frontier AI model serving, working closely with Azure Infrastructure, Microsoft Foundry, Microsoft AI and Microsoft 365 teams to deliver end-to-end platform capabilities.\nAs a a Principal Software Engineering, AI Infrastructure, you will work on mission critical infrastructure that directly powers largescale AI systems. Influence the future of cloud GPU platforms used by internal and external customers and ollaborate with experts across hardware, networking, and AI deployment and serving software. This a an opportunity to grow as a technical leader, shaping long term platform strategy.\nMicrosoft’s mission is to empower every person and every organization on the planet to achieve more, and we’re dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.\nResponsibilities\nDevelop systems for AI Workload management, scheduling, preemption, and failover. \nDevelop systems for AI Workload serving. \nDesign and build GPU accelerated infrastructure for training and inference workloads, spanning bare metal, virtual machines, and containerized environments. \nBuild and operate advanced orchestration and resource governance scenarios using platforms such as AKS and related Kubernetes ecosystem capabilities to enable fair sharing, isolation, and efficient utilization of accelerated resources. \nDesign, Develop, test, and maintain services written in C#, Golang hosted on Kubernetes clusters. \nOptimize performance, reliability, and utilization across large GPU fleets, including scaleup and scale out configurations. \nDrive end-to-end platform features from design through production, including observability, diagnostics, and operational excellence. \nInfluence platform architecture and technical direction across teams through design reviews and technical leadership. \nEmbody our Culture and Values \nQualifications\nRequired Qualifications\nBachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Linux, Go or PythonOR equivalent experience.\n\nOther Requirements\nAbility to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screeningsMicrosoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter. \n\nPreferred Qualifications\nMaster's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Linux, Go or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, linux, Go or Python \nOR equivalent experience. \n\nProven ability to design and operate large scale, production infrastructure with high reliability and performance requirements. \nDemonstrated problem-solving skills and the ability to debug complex, cross layer systems issues. \nDemonstrated technical leadership, including mentoring engineers and driving cross team architectural alignment. \nHands-on experience with resource scheduling, preemption, priority handling on large clusters. \nAdvanced collaboration and communication skills, with the ability to work across organizational boundaries. \nExperience with large-scale online Inferencing services. \nExperience in building or operating multitenant AI platforms in cloud environments. \nFamiliarity with inference and/or distributed training stacks (e.g., NCCL style collectives, model/data parallelism, Large-Language Models). \nFamiliarity with GPU accelerated computing (e.g., CUDA, GPU drivers, device plugins, or runtime integration).\nDev-ops experience with microservices architecture in a complex infrastructure and operational environment.\nSoftware Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.\nCertain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:\nhttps://careers.microsoft.com/us/en/us-corporate-pay\nThis position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.\nMicrosoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.","description_format":"text","description_chars":6058,"description_truncated":false,"requirements":{"experience_years_min":12,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Console Games","Cloud Platforms (IaaS & PaaS)","Gaming Consoles","Developer Tools"],"lifecycle":[{"event":"open","at":"2026-10-16T22:23:12Z"}],"visa":[],"liveness":{"score":82,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.823,"p_room":1,"age_days":8,"expected_fill_days":28,"reasons":["conf:3","win:early","comp:brand"],"computed_at":"2026-10-17T05:21:32Z"},"pay":{"stated_usd_annual":274800,"is_top_pay":true},"html_url":"https://alion.io/job/microsoft-principal-software-engineering-ai-infrastructure","json_url":"https://alion.io/job/microsoft-principal-software-engineering-ai-infrastructure.json","meta":{"generated_at":"2026-10-17T05:21:32Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7211,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":18},"rest":"https://alion.io/mcp/rest/get_company?id=18"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmicrosoft-principal-software-engineering-ai-infrastructure"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmicrosoft-principal-software-engineering-ai-infrastructure"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmicrosoft-principal-software-engineering-ai-infrastructure"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/microsoft-principal-software-engineering-ai-infrastructure\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmicrosoft-principal-software-engineering-ai-infrastructure"}]}