Sr. Software Engineer - AI Agent and LLM Applications
Confirmed on the employer's own hiring board on Nov 5, 2026. First seen by Alion on Oct 14, 2026. Supermicro scores A on the Alion truth index.
Job Req ID: 30247
About Supermicro:
Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented global expansion has provided us with the opportunity to offer a large number of new positions to the technology community. We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.
Job Summary:
We are building an AI Agent-powered platform to handle customer issues related to AI Servers and Racks. The system will interact with customers via chatbot, analyze issue tickets, and generate troubleshooting steps for the on-site service team. This role focuses on the design, implementation, and system integration of the Agent platform.
Essential Duties and Responsibilities:
- Design and implement Multi-Agent or Tool-using Agent systems (using OpenClaw or other agent frameworks)
- Define, develop, and maintain Tools / Function Calling interfaces that agents can invoke
- Integrate with external systems (ticket systems, databases, monitoring data, automation workflows, etc.)
- Build and optimize the RAG pipeline and integrate the existing Knowledge Base
- Support hybrid deployment and switching between cloud models (e.g., Grok) and local models (e.g., Ollama)
- Implement agent execution flows, error handling, human-in-the-loop, and escalation mechanisms
- Collaborate with the Automation team to ensure stable Tool interfaces and proper access control
- Establish basic logging, tracing, and observability
Qualifications:
- Experience in LLM applications or AI Agent development (2+ years of experience is preferred)
- Hands-on experience building Tool-using Agents or Multi-Agent systems
- Familiarity with Function Calling / Tool Use and agent orchestration
- Experience implementing RAG (vector databases, embeddings, retrieval tuning)
- Strong Python skills with API design and system integration experience
- Experience with at least one major LLM API and local model deployment solutions
- Ability to communicate effectively with cross-functional teams (Automation, Domain SMEs)
- Experience integrating with ITSM, technical support, operations, or monitoring systems is a plus
- Hands-on experience with frameworks such as OpenClaw, LangGraph, CrewAI, or AutoGen is a plus
- Experience with agent observability, cost control, or production deployment is a plus
- Experience implementing human-in-the-loop or escalation mechanisms is a plus
Salary Range
$160,000 - $ 200,000
The salary offered will depend on several factors, including your location, level, education, training, specific skills, years of experience, and comparison to other employees already in this role. In addition to a comprehensive benefits package, candidates may be eligible for other forms of compensation, such as participation in bonus and equity award programs.
EEO Statement
Supermicro is an Equal Opportunity Employer and embraces diversity in our employee population. It is the policy of Supermicro to provide equal opportunity to all qualified applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status or special disabled veteran, marital status, pregnancy, genetic information, or any other legally protected status.