Applied AI Engineer II
Confirmed on the employer's own hiring board on Sep 28, 2026. First seen by Alion on Sep 22, 2026. Microsoft scores B on the Alion truth index.
Microsoft's Applied AI Research team and help shape the future of AI-powered security and compliance. We are a high-impact team within Microsoft Purview focused on solving complex enterprise challenges in data security, compliance, governance, and risk management. Our strength lies in turning bold ideas into reality, taking innovations from concept to prototype and ultimately into products that deliver value to millions of users. As an AI Engineer, you will work on cutting-edge AI technologies including large language models, agentic systems, reasoning frameworks, and advanced machine learning solutions. You will partner with researchers, architects, engineers, and product leaders to design and deliver intelligent experiences that improve how organizations protect and govern their most valuable data. This is an opportunity to own meaningful technical challenges, influence platform strategy, and contribute directly to the next generation of AI innovations powering Microsoft Purview.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- Design, build and maintain AI system that hosts ML Models, tools/APIs, manage state/memory, and reliably complete multi-step workflows.
- Own entire ML/DL development cycle through production, including deployment, monitoring, and live-site reliability, with an eval-first development lifecycle.
- Define success criteria, build evaluation datasets and automated harnesses, and run human-in-the-loop reviews where needed.
- Debug AI behavior and performance using log analysis, data inspection, and model/tool-call traces, and translate failure patterns into targeted improvements.
- Establish and track AI quality metrics (e.g., accuracy, relevance, hallucination rate) and integrate them into CI/CD release gates.
- Optimize runtime performance and economics (token usage, inference cost, latency, caching, model selection/routing, batching) and implement monitoring and continuous improvement loops (online signals, drift detection, structured user feedback).
- Partner with product, design, and domain stakeholders to define use cases, acceptance criteria, and rollout plans for AI features. Live site responsibility.
Qualifications
- Bachelor's Degree in Computer Science, Data Science or related technical field Should have atleast 5 years in building and maintaining ML/AI System.
- Hands on experience with MLOPs, AIOps 4+ years of experience in shipping at least 2 large scale ML/AI-based services or applications on cloud platforms (Azure, AWS, GCP, etc.)
- 4+ years technical engineering experience with coding in languages including C#, Python and Pytorch Proficiency in writing production-quality software code in one or more modern programming languages (Python, C#)
- 1-2 years of experience with LLMs and open-source GenAI frameworks, such as LangChain, LlamaIndex, Haystack, or equivalents (e.g., Transformers, AutoGen, DSPy), including agent-based orchestration, prompt engineering, retrieval-augmented generation (RAG), and fine-tuning and evaluation.
Other Requirements
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:
- This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter.
#MSFTSecurity
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.