Principal Engineer - Agentic AI Architect
Job Details:
Job Description:
Location: Shanghai, China
Role Overview
We are seeking aPrincipal Engineer - Agentic AI Architect to lead the design and development of next-generationagentic AI systems integrated withFPGA/ASIC platforms.
This role sits at the intersection of:
Large Language Models (LLMs)
Agent frameworks & autonomous systems
Retrieval-Augmented Generation (RAG)
Hardware-aware AI system design (FPGA / ASIC / EDA)
You will define architecture, drive technical strategy, and build scalable AI systems that bridgesoftware intelligence and hardware acceleration.
Key Responsibilities
AI Architecture & System Design
Design and implementagentic AI systems using LLMs, tools, and multi-agent orchestration
ArchitectRAG pipelines for enterprise-scale knowledge integration
Defineend-to-end AI system architecture from data ingestion → reasoning → action
Agentic AI & LLM Development
Develop advanced workflows using:
tool-using agents
planning & reasoning agents
multi-agent collaboration frameworks
Evaluate and integrate leading LLMs (open-source and proprietary)
Optimize prompt engineering, memory, and reasoning capabilities
Hardware-Aware AI Optimization
Co-design AI systems with:
FPGA acceleration
ASIC platforms
heterogeneous compute (CPU/GPU/FPGA)
Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)
Collaborate with hardware teams onEDA and system integration
Framework & Platform Development
Build internal platforms using
LangChain
LlamaIndex
custom agent orchestration framework
Develop reusable components for:
memory management
tool integration
knowledge retrieval
Technical Leadership
Lead architecture reviews and guide engineering teams
Mentor senior engineers and influence cross-functional teams
Drive innovation inAI + hardware convergence
What Makes This Role Unique
Opportunity to defineagentic AI architecture for hardware-driven systems
Work at the convergence of:
AI reasoning systems
FPGA acceleration
next-generation computing platforms
High-impact role influencingfuture AI + semiconductor integration
Impact
You will help shape howAI agents interact with hardware, enabling:
intelligent system orchestration
real-time decision-making pipelines
scalable AI deployment on FPGA platforms
Summary
This role is ideal for asenior technical leader who can:
bridgeLLM + Agentic AI + RAG withFPGA/ASIC system architecture
and drive innovation innext-generation AI systems.
Qualifications:
Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following:
AI/ML systems
Distributed systems
Hardware-software co-design
Recognized expertise in AI/ Large Language Models (LLMs)
Deep understanding of:
LLM architectures and inference
RAG systems and vector databases
Agentic AI / autonomous agents
Hands-on experience building:
Production-grade LLM applications
Multi-step reasoning and orchestration workflows
Scalable and reliable AI systems in production
Strong background in:
FPGA / ASIC / EDA systems
Heterogeneous computing architectures
Familiarity with:
Hardware acceleration for AI workloads
Performance optimization across system stack
Technical Skills
Programming:
Python
C++ (preferred)
Experience with:
Distributed systems design
APIs and microservices architecture
Cloud and/or edge AI deployment
Hands-on experience with:
LLM fine-tuning, quantization, and model distillation
On-device / edge AI deployment
Robotics, autonomous systems, or real-time AI pipelines
Knowledge of:
Compiler stacks (e.g., MLIR, TVM)
AI model optimization for FPGA platforms