Agentic AI Architect

Job Details:

Job Description:

Location: Shanghai, China

Role Overview

We are seeking aPrincipal Engineer - Agentic AI Architect to lead the design and development of next-generationagentic AI systems integrated withFPGA/ASIC platforms.

This role sits at the intersection of:

• Large Language Models (LLMs)

• Agent frameworks & autonomous systems

• Retrieval-Augmented Generation (RAG)

• Hardware-aware AI system design (FPGA / ASIC / EDA)

You will define architecture, drive technical strategy, and build scalable AI systems that bridgesoftware intelligence and hardware acceleration.

Key Responsibilities

AI Architecture & System Design

• Design and implementagentic AI systems using LLMs, tools, and multi-agent orchestration

• ArchitectRAG pipelines for enterprise-scale knowledge integration

• Defineend-to-end AI system architecture from data ingestion → reasoning → action

Agentic AI & LLM Development

• Develop advanced workflows using:

  • tool-using agents

  • planning & reasoning agents

  • multi-agent collaboration frameworks

• Evaluate and integrate leading LLMs (open-source and proprietary)

• Optimize prompt engineering, memory, and reasoning capabilities

Hardware-Aware AI Optimization

• Co-design AI systems with:

  • FPGA acceleration

  • ASIC platforms

  • heterogeneous compute (CPU/GPU/FPGA)

• Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)

• Collaborate with hardware teams onEDA and system integration

Framework & Platform Development

• Build internal platforms using

  • LangChain

  • LlamaIndex

  • custom agent orchestration framework

• Develop reusable components for:

  • memory management

  • tool integration

  • knowledge retrieval

Technical Leadership

• Lead architecture reviews and guide engineering teams

• Mentor senior engineers and influence cross-functional teams

• Drive innovation inAI + hardware convergence

What Makes This Role Unique

• Opportunity to defineagentic AI architecture for hardware-driven systems

• Work at the convergence of:

  • AI reasoning systems

  • FPGA acceleration

  • next-generation computing platforms

• High-impact role influencingfuture AI + semiconductor integration

Impact

You will help shape howAI agents interact with hardware, enabling:

• intelligent system orchestration

• real-time decision-making pipelines

• scalable AI deployment on FPGA platforms

Summary

This role is ideal for asenior technical leader who can:

• bridgeLLM + Agentic AI + RAG withFPGA/ASIC system architecture

• and drive innovation innext-generation AI systems.

Qualifications:

• Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following:

  • AI/ML systems

  • Distributed systems

  • Hardware-software co-design

• Recognized expertise in AI/ Large Language Models (LLMs)

• Deep understanding of:

  • LLM architectures and inference

  • RAG systems and vector databases

  • Agentic AI / autonomous agents

• Hands-on experience building:

  • Production-grade LLM applications

  • Multi-step reasoning and orchestration workflows

  • Scalable and reliable AI systems in production

• Strong background in:

  • FPGA / ASIC / EDA systems

  • Heterogeneous computing architectures

• Familiarity with:

  • Hardware acceleration for AI workloads

  • Performance optimization across system stack

Technical Skills

• Programming:

  • Python

  • C++ (preferred)

• Experience with:

  • Distributed systems design

  • APIs and microservices architecture

  • Cloud and/or edge AI deployment

• Hands-on experience with:

  • LLM fine-tuning, quantization, and model distillation

  • On-device / edge AI deployment

  • Robotics, autonomous systems, or real-time AI pipelines

• Knowledge of:

  • Compiler stacks (e.g., MLIR, TVM)

  • AI model optimization for FPGA platforms

Job Type:

Shift:

Primary Location:

Additional Locations:

Posting Statement: