{"id":1671168,"url":"https://alion.io/job/microsoft-principal-software-engineering-manager-ai-frameworks","title":"Principal Software Engineering Manager - AI Frameworks","company":{"id":18,"name":"Microsoft","domain":"microsoft.com","url":"https://alion.io/company/microsoft","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Eightfold","truth_index":{"grade":"B","score":81,"open_postings":309,"ghost_share":0,"stale_share":0.767,"repost_share":0,"time_to_fill_p50_days":29,"computed_at":"2026-10-24T06:02:35Z"}},"role":"Leadership","role_family":"Leadership","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":142800,"max":274800,"currency":"USD","period":"year","gross":null,"usd_annual":274800},"salary_estimate":null,"experience_years_min":12,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"C#","optional":false},{"name":"C++","optional":false},{"name":"JavaScript","optional":false},{"name":"OpenAI","optional":false},{"name":"Python","optional":false},{"name":"Bazel","optional":true},{"name":"CI/CD","optional":true},{"name":"CUDA","optional":true},{"name":"HPC","optional":true},{"name":"ONNX Runtime","optional":true},{"name":"PyTorch","optional":true},{"name":"ROCm","optional":true},{"name":"TensorFlow","optional":true},{"name":"TensorFlow C++","optional":true},{"name":"Triton","optional":true}],"status":"closed","first_seen_at":"2026-08-03T23:54:38Z","employer_posted_date":"2026-10-02","last_verified_at":"2026-10-19T12:32:34Z","board_verified":false,"closed_at":"2026-10-19T12:32:34Z","days_open":76,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":76},"description":"OverviewAs a Principal Software Engineering Manager - AI Frameworks on the team, you will lead and grow a group of engineers working across the AI software serving stack while remaining technically hands-on. You will set direction and contribute to critical engineering decisions across developer infrastructure, build systems, runtimes, libraries, release pipelines, and application programming interfaces (APIs). You will be responsible for improving engineering velocity and build reliability, establishing effective system and release practices, and ensuring the team ships high-quality software to production for large-scale model training and inference.\nIn this role, you will guide the team’s work on benchmarking OpenAI and other large language models (LLMs) across GPUs and Microsoft hardware, translating performance findings into production-ready builds and releases. You will drive automation across build, validation, benchmarking, regression detection, and deployment workflows, including advanced AI-assisted automation and closed-loop systems that accelerate diagnosis and remediation. You will partner closely with researchers, product teams, and platform owners to improve developer velocity, reduce time-to-deployment and hardware footprint, and support Microsoft Azure’s capex efficiency goals.\nAt Microsoft, our mission to empower every person and every organization on the planet to achieve more guides how we partner with customers to deliver trusted, impactful solutions. With a growth mindset culture, we innovate responsibly and measure success by shared progress people, teams, and customers. Join us to do meaningful work that changes the world and helps shape what’s next for everyone.\nResponsibilities\nLead and develop a team of engineers working across multiple layers of the AI software stack, while staying technically engaged in architecture, design reviews, debugging, and critical implementation decisions that enable large-scale training and inference.\nSet technical vision and execution strategy for developer infrastructure, build and release systems, model performance benchmarking, optimization, and production deployment across GPUs and Microsoft hardware.\nDrive performance and production outcomes by prioritizing and overseeing efforts to build, benchmark, profile, debug, validate, and optimize training and inference workloads, from developer workflows through production release.\nOwn build, release, and performance health by establishing best practices for build reliability, system observability, regression monitoring, release quality, impact measurement, developer velocity, time-to-deploy, and hardware efficiency.\nPartner cross-functionallywith research, product, infrastructure, and hardware teams to deliver scalable, production-ready AI performance improvements. \nBalance short-term delivery and long-term investments by advancing build, release, and validation automation, including AI-assisted workflows and closed-loop systems that identify issues, recommend or implement fixes, and verify outcomes. Ensure these investments align with organizational goals, platform roadmaps, and Azure capex objectives.\nBuild a strong engineering culturethrough coaching, feedback, hiring, and career development, enabling the team to operate with increasing autonomy and impact.\nQualifications\nQualifications\nMinimum/Required Qualifications:\nBachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. \nOther Requirements:\nAbility to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.\nPreferred Qualifications:\nMaster’s Degree in Computer Science or related technical field AND 10+ years of software engineering experience, including 6+ years in engineering management,OR Bachelor’s Degree in Computer Science or related technical field AND 12+ years of software engineering experience, including 6+ years in engineering management,\nor equivalent experience. \n\n4+ years people management experience. \nStrong technical foundation in software engineering principles, computer architecture, GPU architecture, and hardware acceleration for neural networks, combined with hands-on experience in developer infrastructure such as build systems, dependency management, Bazel or comparable tooling, CI/CD, release engineering, and developer productivity.\nExperience leading teams responsible for end-to-end performance analysis and optimization of LLMs, AI systems, or HPC workloads, including GPU profiling and performance analysis tools, and shipping validated builds through release pipelines into production environments.\nDemonstrated ability to lead cross-team initiatives, align stakeholders, and translate research or platform capabilities into scalable, production-ready solutions. \nProven people leadership skills, including hiring, coaching, performance management, and career development, with a track record of building high-performing, inclusive teams.\nWorking knowledge of AI and ML systems across training, inference, evaluation, and benchmarking, with experience in at least one modern deep learning framework such as PyTorch, TensorFlow, or ONNX Runtime. The candidate should be able to reason about how models, frameworks, runtimes, hardware, and developer infrastructure interact across the end-to-end lifecycle.\nFamiliarity with GPU software stacks and acceleration technologies such as CUDA, ROCm, Triton, or equivalent, sufficient to guide technical direction and evaluate tradeoffs. Experience designing advanced automation for build, test, release, benchmarking, and production validation workflows is preferred, including AI-assisted tooling and closed-loop systems that use observed results to drive subsequent actions. \nSoftware Engineering M5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.\nCertain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:\nhttps://careers.microsoft.com/us/en/us-corporate-pay\nThis position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.\nMicrosoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.","description_format":"text","description_chars":7573,"description_truncated":false,"requirements":{"experience_years_min":12,"management_years_min":4,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Console Games","Gaming Consoles","Developer Tools"],"lifecycle":[{"event":"open","at":"2026-10-02T06:34:06Z"},{"event":"close","at":"2026-10-19T12:32:34Z"}],"visa":[],"liveness":null,"pay":{"stated_usd_annual":274800,"is_top_pay":true},"html_url":"https://alion.io/job/microsoft-principal-software-engineering-manager-ai-frameworks","json_url":"https://alion.io/job/microsoft-principal-software-engineering-manager-ai-frameworks.json","meta":{"generated_at":"2026-10-24T18:01:40Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":26240,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-25T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":18},"rest":"https://alion.io/mcp/rest/get_company?id=18"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmicrosoft-principal-software-engineering-manager-ai-frameworks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmicrosoft-principal-software-engineering-manager-ai-frameworks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmicrosoft-principal-software-engineering-manager-ai-frameworks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/microsoft-principal-software-engineering-manager-ai-frameworks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmicrosoft-principal-software-engineering-manager-ai-frameworks"}]}