{"id":4646698,"url":"https://alion.io/job/microsoft-research-intern-ai-serving-systems-and-hardware-microsoft-research","title":"Research Intern - AI Serving Systems and Hardware - Microsoft Research","company":{"id":18,"name":"Microsoft","domain":"microsoft.com","url":"https://alion.io/company/microsoft","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Eightfold","truth_index":{"grade":"A","score":85,"open_postings":557,"ghost_share":0.022,"stale_share":0.528,"repost_share":0.066,"time_to_fill_p50_days":30,"computed_at":"2026-11-20T05:46:30Z"}},"role":"Early Careers","role_family":"Early Careers","seniority":"intern","employment_type":"internship","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Vancouver, Canada"],"countries":["CA"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":9150,"max":10170,"currency":"CAD","period":"month","gross":null,"usd_annual":85140},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"C++","optional":true},{"name":"CUDA","optional":true},{"name":"Mixture of Experts","optional":true},{"name":"NCCL","optional":true},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-11-19T23:24:40Z","employer_posted_date":"2026-11-19","last_verified_at":"2026-11-20T04:04:57Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"OverviewResearch Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.\nWe are seeking Research Interns to work where AI serving workloads meet the systems and hardware that run them. Large-model inference is limited by that hardware and by how well the serving stack uses it. Our team works across this boundary, from serving software and graphics processing unit (GPU) communication, through GPU clusters and their interconnects, down to chip architecture, to make AI serving faster, more reliable, and cheaper to build and run. Open problems range from keeping a large serving system running at predictable performance when GPUs, links, or software components fail to designing chips that keep pace with rapidly evolving workloads.\nResearch Interns will take on a research project in this space, shaped around their background and interests. Expected deliverables include working prototypes or simulators validated on real hardware, measurement studies, and paper submissions to top-tier venues.\nResponsibilities\nResearch Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.\nAdditional Responsibilities\nMeasure and characterize large language model (LLM) inference workloads on state-of-the-art GPU hardware, including how they behave when parts of the system fail or degrade. \nBuild prototypes, simulators, or models that test new ideas in serving systems, fault tolerance, GPU communication, or AI hardware. \nCompare new approaches against existing methods. \nDocument findings and prepare results for publication at top-tier venues. \nPresent the work to technical audiences, both internally and externally. \nQualifications\nRequired Qualifications\nCurrently enrolled in a Doctorate Degree program in Computer Science, Artificial Intelligence, Machine Learning, or a related STEM field.\nOther Requirements\nResearch Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.\nIn addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter. \nPreferred Qualifications\nResearch experience in computer systems, distributed systems, networking, or computer architecture and hardware design. \nProficient programming skills in C/C++ and Python. \nWorking knowledge of ML/AI/LLM concepts. \nExperience designing experiments and writing research papers. \nCandidates should have depth of expertise in one or two of the following areas:\nExperience with GPU microarchitecture, performance modeling, or architectural simulators. \nExperience with CUDA, RDMA/verbs, or GPU collective communication libraries (e.g., NCCL, MSCCL++, DeepEP). \nFamiliarity with LLM inference systems and serving stacks, including MoE models and expert parallelism. \nExperience measuring system performance at scale on real hardware. \nPrior work on fault tolerance or distributed ML systems. \nPublications at venues such as ISCA, MICRO, ASPLOS, HPCA, MLSys, OSDI, SOSP, NSDI, SIGCOMM, EuroSys, or ML venues such as NeurIPS and ICML. \nAbility to work both independently and collaboratively in a fast-moving research environment. \nIntern - MSR- The typical base pay range for this role across Canada is CAD $9,150 - CAD $10,170 per month.\nFind additional pay information here: https://careers.microsoft.com/v2/global/en/canada-pay-information.html\nMicrosoft accepts applications and processes offers for these roles on an ongoing basis throughout the academic calendar (September - April).\nCe poste sera ouvert pendant au moins cinq jours et les candidatures seront acceptées de façon continue jusqu’à ce que le poste soit pourvu.\nThis position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.\nMicrosoft est un employeur offrant l’égalité d’accès à l’emploi. Tous les candidats qualifiés seront pris en considération pour l’emploi, sans égard à l’âge, à l’ascendance, à la citoyenneté, à la couleur, aux congés médicaux ou familiaux, à l’identité ou à l’expression de genre, aux renseignements génétiques, à l’état d’immigration, à l’état matrimonial, à l’état de santé, à l’origine nationale, à un éventuel handicap physique ou mental, à l’affiliation politique, au statut de vétéran protégé ou au statut militaire, à la race, à l’ethnie, à la religion, au sexe (y compris la grossesse), à l’orientation sexuelle ou à toute autre caractéristique protégée par les lois, ordonnances et règlements locaux applicables. Si vous avez besoin d’aide avec des accommodements religieux et/ou d’un accommodement raisonnable en raison d’un handicap pendant le processus de candidature, apprenez-en plus sur la demande d’accommodement.\nMicrosoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.","description_format":"text","description_chars":6803,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Canada","iso":"CA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Cloud Platforms (IaaS & PaaS)","Office & Productivity Software","Gaming Consoles","Developer Tools"],"lifecycle":[{"event":"open","at":"2026-11-20T00:29:16Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["conf:1","stale_co","velocity","win:early","comp:junior,brand"],"computed_at":"2026-11-20T05:46:30Z"},"pay":{"stated_usd_annual":85140,"is_top_pay":true},"html_url":"https://alion.io/job/microsoft-research-intern-ai-serving-systems-and-hardware-microsoft-research","json_url":"https://alion.io/job/microsoft-research-intern-ai-serving-systems-and-hardware-microsoft-research.json","meta":{"generated_at":"2026-11-20T07:01:22Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5156,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":18},"rest":"https://alion.io/mcp/rest/get_company?id=18"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmicrosoft-research-intern-ai-serving-systems-and-hardware-microsoft-research"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmicrosoft-research-intern-ai-serving-systems-and-hardware-microsoft-research"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmicrosoft-research-intern-ai-serving-systems-and-hardware-microsoft-research"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/microsoft-research-intern-ai-serving-systems-and-hardware-microsoft-research\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmicrosoft-research-intern-ai-serving-systems-and-hardware-microsoft-research"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4646698}},{"tool":"search_jobs","arguments":{"company":"microsoft.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4646698},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}