TensorRT-LLM Jobs - Remote & On-site

TensorRT-LLM jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $275,399/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

RapidClaims

rapidclaims.ai
rapidclaims.ai • Bengaluru • Manhattan • Manhattan • Business Process Outsourcing (BPO) • Custom Software Development • 11-50 employees • Est. 2023 • Startup • Hiring 3, 1 new
Bengaluru • Manhattan • Manhattan • Business Process Outsourcing (BPO) • Custom Software Development • 11-50 employees • Est. 2023 • Startup • Hiring 3, 1 new
RapidClaims is a revenue cycle management company leveraging advanced AI and LLMs to enable autonomous medical coding and workflow automation for modernizing and scaling healthcare billing operations.
No named decision-maker yet.
Careers mailbox is known
2 months ago Long shot · 8%

Senior AI / ML Engineer

≈ $24k – $53k per year (Estimated) • Senior • 5+ years exp • In office (Bengaluru, India) • Senior
Python
Databases
Neo4j
ArangoDB
AI/ML
Qwen
LoRA
Model Context Protocol
vLLM
Fine-tuning
Prompt Engineering
Function Calling
AI Agents
SGLang
Arize Phoenix
Langfuse
LangSmith
TensorRT
PEFT
QLoRA
TensorRT-LLM
Llama
PyTorch
LLM
RAG
Reranking
Hybrid Search
Braintrust
Hugging Face
DPO
SFT
Human-in-the-Loop
Structured Outputs
Knowledge Graph
+24
Apply

Seekr

seekr.com
seekr.com • HQ: Reston, United States • Cybersecurity • Military • Artificial Intelligence • 201-500 employees • Est. 2021 • Trust B • Hiring 28, 1 new
HQ: Reston, United States • Cybersecurity • Military • Artificial Intelligence • 201-500 employees • Est. 2021 • Trust B • Hiring 28, 1 new
Decision-ready, explainable,sovereign AI. Seekr's trusted AI solutions power critical decisions for government and enterprise sectors where accuracy, transparency, and compliance are paramount.
Robin Clark · Executive Officer, Director · decision-maker
Doug Dubiel · Executive Officer, Director · decision-maker
Patrick Condo · Executive Officer, Director · decision-maker
Matthew Jones · Executive Officer · decision-maker
No careers mailbox known
Top 25% payVerified live · 3 hours ago 2 months ago Fading · 40%

AI Site Reliability Engineer

$140k – $210k per year • Equity • Middle • 4+ years exp • Hybrid (Austin, Menlo Park, Reston, United States) • Bachelor's Degree • Middle
Python
AI/ML
DeepSpeed
vLLM
Quantization
TensorRT-LLM
PyTorch
LLM
Triton
FSDP
TensorRT
DevOps
Terraform
OpenTelemetry
Prometheus
CI/CD
Kubernetes
Grafana
Platform Engineering
SLI/SLO/SLA
QA
JMeter
Gatling
k6
Locust
+14
Apply
Top 25% payVerified live · 3 hours ago 3 months ago Long shot · 20%

Staff AI Infrastructure Engineer

$200k – $245k per year • Equity • Staff+ • 8+ years exp • Hybrid (Austin, Reston, Menlo Park, United States) • Staff
Python
Rust
C++
AI/ML
Ray Serve
vLLM
Triton Inference Server
Fine-tuning
Quantization
AI Agents
SGLang
TensorRT-LLM
Edge AI
Multi-Agent Systems
Machine Learning
TensorRT
Ray
DevOps
GCP
Helm
OpenTelemetry
Prometheus
Azure
CI/CD
GitOps
ArgoCD
AWS
Docker
Kubernetes
Grafana
Platform Engineering
+21
Apply
Top 25% payVerified live · 3 hours ago 3 months ago Long shot · 18%

Senior AI Infrastructure Engineer

$160k – $230k per year • Equity • Senior • 5+ years exp • Hybrid (Austin, Menlo Park, Reston, United States) • Senior
Python
Rust
C++
AI/ML
Ray Serve
vLLM
Triton Inference Server
Fine-tuning
Quantization
AI Agents
SGLang
TensorRT-LLM
Edge AI
Multi-Agent Systems
Machine Learning
TensorRT
Ray
DevOps
GCP
Helm
OpenTelemetry
Prometheus
Azure
CI/CD
GitOps
ArgoCD
AWS
Docker
Kubernetes
Grafana
Platform Engineering
+21
Apply

Espire Infolabs

espire.com
espire.com • HQ: Singapore • IoT Platforms & Solutions • IT Consulting & Digital Transformation • Hiring 16
HQ: Singapore • IoT Platforms & Solutions • IT Consulting & Digital Transformation • Hiring 16
Espire Infolabs is a technology services company that delivers smart city, IoT and digital transformation initiatives for public sector clients. It hires project management leads, SharePoint and Power Platform developers, Salesforce engineers and security officers. The company is based in Singapore.
No named decision-maker yet.
No careers mailbox known
2 months ago Long shot · 10%

AI Architect

≈ $31k – $77k per year (Estimated) • Staff+ • 8+ years exp • In office (Gurgaon, India) • Staff
Python
AI/ML
LangGraph
LangChain
Qwen
ChatGPT
LlamaIndex
LoRA
vLLM
Gemma
Fine-tuning
Embeddings
Quantization
Multimodal AI
Knowledge Distillation
Function Calling
AI Agents
PEFT
QLoRA
Semantic Kernel
TensorRT-LLM
Llama
Mistral
Transformers
TensorFlow
PyTorch
LLM
RAG
Tokenization
Hallucination
Reranking
Hybrid Search
Hugging Face
LLMOps
Pre-training
Context Engineering
LLM Guardrails
Agentic Workflows
Model Distillation
Machine Learning
TensorRT
DevOps
Azure
CI/CD
AWS
Kubernetes
Chips/EDA
PoC Library
+37
Apply

超维无际

infiscale-tech.com
infiscale-tech.com • HQ: Shanghai, China • Likely startup • Hiring 105, 1 new
HQ: Shanghai, China • Likely startup • Hiring 105, 1 new
跳转到正文 首页 关于我们 ABOUT INFISCALE 超维无际 沿TPU路线构建下一代智算系统 公司介绍 超维无际是一家基于TPU路线自主研发AI计算芯片及系统级解决方案的公司,总部位于上海。面向多元计算与应用场景,超维无际围绕芯片架构、片间互联、系统设计与软件生态开展全栈协同创新,持续提升AI计算系统的性能、效率、可扩展性与算力经济。 超维无际拥有深度理解AI计算系统的全栈式团队,核心成员来自国内外头部科技企业,在芯片架构设计、系统级协同、软件编译器、AI Infra等领域拥有丰富的工程经验。 加入超维,探索TPU的无限可能! 社会招聘 校园招聘 校园招聘 超维无际生活与福利 年终奖 五险二金及商业保险 年度体检 项目及表彰激励 餐补及交通补贴 周度按摩 团建及社团活动 生日会及零食下午茶 工作,也是为了更好的生活 联系我们 上海(总部) 上海市浦东新区博霞路66号浦东软件园Q座 其他 Site 北京 珠海 邮箱 [email protected] 电话 021-68650181 我们的办公地点 上海 总部 北京 研发中心 珠海 研发中心.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 2 months ago Long shot · 11%

AI云平台研发工程师

In office (Shanghai, China) • Full-Time
Python
Rust
C++
AI/ML
vLLM
JAX
SGLang
TensorRT-LLM
Triton
TensorRT
DevOps
Rest API
gRPC
Docker
Kubernetes
Linux
+6
Apply
Likely inactiveVerified live · 2 hours ago 7 months ago Long shot · 6%

Technical Project Lead

≈ $44k – $127k per year (Estimated) • Lead • 10+ years exp • In office (Shanghai, China) • Full-Time • Staff • Chinese: C1
SystemVerilog
AI/ML
DeepSpeed
vLLM
CUDA Toolkit
JAX
TensorRT-LLM
TensorFlow
PyTorch
LLM
Mixture of Experts
CUDA
Megatron-LM
ROCm
MLIR
Apache TVM
KV Cache
TensorRT
Chips/EDA
UVM
+10
Apply

Techngs

techngs.com
techngs.com • HQ: Utica, United States • IT Consulting & Digital Transformation • Custom Software Development • Est. 2013 • Hiring 3
HQ: Utica, United States • IT Consulting & Digital Transformation • Custom Software Development • Est. 2013 • Hiring 3
Technergetics is a mission-driven, veteran-powered small business specializing in applied research, end-to-end software and hardware solutions, and development of quantum technologies.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 2 months ago Long shot · 19%

AI/ML Engineer III

$125k – $175k per year • Middle • 7+ years exp • Rome • Remote (United States, Italy) • Relocation • Bachelor's Degree • Full-Time • Top Secret • Middle
Python
JavaScript
Java
C++
Python
Django
C++
PyTorch C++
Databases
Weaviate
Milvus
pgvector
FAISS
Qdrant
PostgreSQL
AI/ML
LangGraph
AutoGen
LangChain
LoRA
Model Context Protocol
vLLM
Triton Inference Server
Fine-tuning
Quantization
Prompt Engineering
Multimodal AI
Knowledge Distillation
Function Calling
AI Agents
Arize Phoenix
Langfuse
LangSmith
Ollama
PEFT
Pydantic AI
TensorRT-LLM
PyTorch
CrewAI
LLM
RAG
Hugging Face
Human-in-the-Loop
Structured Outputs
LLM Guardrails
Edge AI
ONNX Runtime
Agentic Workflows
Tool Use
Model Distillation
Machine Learning
DeepSpeed
TensorRT
Transformers
Ray
FSDP
GraphRAG
Knowledge Graph
Frontend
React.js
Mobile
State Management
React Native
DevOps
Rest API
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
GitLab
Linux
SLURM
Management
Agile
Scrum
QA
Pytest
+62
Apply

Vidu AI

vidu.com
vidu.com • HQ: Beijing, China • Generative Image • Generative Video • Trust A • Hiring 80, 6 new
HQ: Beijing, China • Generative Image • Generative Video • Trust A • Hiring 80, 6 new
Vidu is an AI video generation platform that creates videos from text, images and reference material for marketing, social content and animation.
No named decision-maker yet.
No careers mailbox known
Verified live · 1 hour ago 2 months ago Hiring now · 72%

大模型Infra工程师 (VLM推理)

In office (Beijing, China) • Full-Time • Chinese: C1
vLLM
CUDA Toolkit
Triton Inference Server
VLM
SGLang
AWQ
GPTQ
TensorRT-LLM
LLM
CUDA
Speculative Decoding
KV Cache
TensorRT
+5
Apply
Verified live · 1 hour ago 2 months ago Likely open · 58%

数据Infra工程师 (具身)

In office (Beijing, China) • Full-Time • Chinese: C1
Python
Python
Flask
FastAPI
AI/ML
Spark
vLLM
Triton Inference Server
VLM
TensorRT-LLM
LLM
Ray
ONNX Runtime
TensorRT
+4
Apply
Verified live · 1 hour ago 2 months ago Likely open · 58%

数据Infra工程师

In office (Beijing, China) • Full-Time • Chinese: C1
Python
Python
Flask
FastAPI
AI/ML
Spark
vLLM
Triton Inference Server
VLM
TensorRT-LLM
LLM
Ray
ONNX Runtime
TensorRT
+4
Apply

Crodu

crodu.com
crodu.com • HQ: Warsaw, Poland • IT Outsourcing & Dedicated Teams • AI Consulting & Integration • Hiring 5
HQ: Warsaw, Poland • IT Outsourcing & Dedicated Teams • AI Consulting & Integration • Hiring 5
Crodu is a Polish technology services company organised into specialised divisions covering artificial intelligence solutions, experts on demand, ESG and CSRD reporting, and SAFe agile delivery. It places AI, backend, full-stack and Azure Databricks engineers on client projects. The company is headquartered in Warsaw, Poland.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 2 months ago Long shot · 21%

Mid+ AI / Backend Engineer

$82k – $114k per year • Middle • 3+ years exp • Remote (Poland) • Contractor • Middle • English
Python
TypeScript
Python
FastAPI
Pydantic
Alembic
Celery
Databases
PostgreSQL
Redis
Neo4j
RabbitMQ
AI/ML
Claude
Model Context Protocol
Function Calling
AI Agents
Gemini
LLM
RAG
OpenAI
Anthropic
Tool Use
LoRA
vLLM
Fine-tuning
TensorRT
PEFT
QLoRA
TensorRT-LLM
TGI
GraphRAG
Frontend
GraphQL
Mobile
Dependency Injection
DevOps
Terraform
GitHub Actions
AWS CDK
GitLab CI
Azure
CI/CD
AWS
Docker
Kubernetes
AWS Lambda
Amazon S3
Amazon ECS
API Gateway
gRPC
Pulumi
+38
Apply

SpaceX

spacex.com
spacex.com • HQ: Starbase, United States • Satellite Manufacturing • Satellite Communications • Launch Services • 5000+ employees • Est. 2002 • Trust A • Hiring 2469, 139 new
HQ: Starbase, United States • Satellite Manufacturing • Satellite Communications • Launch Services • 5000+ employees • Est. 2002 • Trust A • Hiring 2469, 139 new
SpaceX is an American aerospace manufacturer and launch services provider founded by Elon Musk in 2002 with the goal of making life multiplanetary. It developed the reusable Falcon 9, now by far the most flown orbital rocket in the world, the Dragon capsule that carries NASA astronauts to the International Space Station, and Starship, the fully reusable super-heavy vehicle intended for lunar and Mars missions. The company also operates Starlink, a satellite constellation of thousands of spacecraft providing broadband to consumers, aircraft, ships and militaries, which has become its largest source of revenue.
Elon Musk · Founder, Chief Executive Officer & Chief Engineer · decision-maker
Gwynne Shotwell · President & Chief Operating Officer · decision-maker
Tom Mueller · Founding Employee & former Propulsion Chief
Careers mailbox is known
Top 25% payVerified live · 4 hours ago 2 months ago Fading · 40%

Software Engineer, Inference (AI Data Engineering)

$135k – $175k per year • Equity • Junior • 1+ year exp • Hybrid (Palo Alto, United States) • Bachelor's Degree • Junior
Rust
C++
Python
Go
Databases
PostgreSQL
ClickHouse
AI/ML
vLLM
Quantization
SGLang
TensorRT-LLM
LLM
Speculative Decoding
KV Cache
TensorRT
Triton
DevOps
CI/CD
gRPC
Docker
Kubernetes
+11
Apply

TRACTIAN

tractian.com
tractian.com • HQ: Atlanta, United States • Maintenance, Repair & Operations (MRO) • Industrial AI • Sensors & Transducers • Industrial IoT (IIoT) • 201-500 employees • Est. 2019 • Startup • Trust C • Hiring 69
HQ: Atlanta, United States • Maintenance, Repair & Operations (MRO) • Industrial AI • Sensors & Transducers • Industrial IoT (IIoT) • 201-500 employees • Est. 2019 • Startup • Trust C • Hiring 69
TRACTIAN is a company founded in 2019 by Brazilian engineers that builds sensors and software for industrial maintenance. Its vibration and energy monitors stream data to models that detect bearing wear, misalignment and other failures weeks before machines break down. It serves manufacturers across the Americas and develops its own hardware, firmware and analytics.
Daniel Heise · Director
Hans Robertson · Director
Igor Alvarenga Marinelli · Director
Lak Ananth · Director
No careers mailbox known
Verified live · 2 hours ago 2 months ago Fading · 30%

AI Engineer

≈ $134k – $255k per year (Estimated) • Senior • 5+ years exp • United States • Remote (United States) • Bachelor's Degree • Full-Time • Senior
Go
TypeScript
Databases
PostgreSQL
Redis
Weaviate
ClickHouse
pgvector
Pinecone
AI/ML
llama.cpp
Quantization
Prompt Engineering
TensorRT-LLM
PyTorch
Gemini
LLM
RAG
OpenAI
Anthropic
Model Distillation
TensorRT
DevOps
Rest API
gRPC
Datadog
CI/CD
AWS
Docker
Kubernetes
Grafana
QA
Cypress
Playwright
k6
+23
Apply

KRAFTON

krafton.com
krafton.com • HQ: Seoul, South Korea • Mobile Games • PC Games • 11-50 employees • Est. 2007 • Trust A • Hiring 38, 1 new
HQ: Seoul, South Korea • Mobile Games • PC Games • 11-50 employees • Est. 2007 • Trust A • Hiring 38, 1 new
KRAFTON is a Seoul game company founded in 2007 that developed PUBG Battlegrounds, one of the best selling games ever made. Its studios operate the battle royale franchise across personal computer, console and mobile platforms with hundreds of millions of players worldwide. The company invests in deep learning research and has acquired studios in India, Japan and the United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 18 min ago 2 months ago Likely open · 62%

[AI Research Div.] ML Serving Engineer (5년 이상)

In office (Seoul, South Korea)
vLLM
CUDA Toolkit
TensorRT-LLM
PyTorch
LLM
CUDA
Triton
KV Cache
TensorRT
DevOps
CI/CD
GitOps
+3
Apply

Ltm

ltm.com
ltm.com • Bengaluru • Mumbai • Hyderabad • Chennai • Pune • Branding • Creative Agencies • Media & Entertainment • Enterprise Apps Implementation Partners • IT Outsourcing & Dedicated Teams • IT Consulting & Digital Transformation • Est. 1996 • Trust B • Hiring 633, 29 new
Bengaluru • Mumbai • Hyderabad • Chennai • Pune • Branding • Creative Agencies • Media & Entertainment • Enterprise Apps Implementation Partners • IT Outsourcing & Dedicated Teams • IT Consulting & Digital Transformation • Est. 1996 • Trust B • Hiring 633, 29 new
LTIMindtree is a worldwide technology consulting and digital solutions company that empowers businesses in a variety of sectors to get to the future faster by combining engineering DNA and tech expertise.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 2 months ago Long shot · 7%

Associate Principal - Cloud Engineering

$164k per year • Lead • 8+ years exp • Albany • Remote (United States) • Principal
vLLM
CUDA Toolkit
Embeddings
TensorRT-LLM
LLM
RAG
CUDA
Triton
TensorRT
DevOps
KEDA
Kubernetes
Amazon EKS
AWS
+5
Apply

Arago

arago.inc
arago.inc • HQ: Paris, France • AI Chips & Accelerators • Processors, MCUs & AI Chips • 201-500 employees • Est. 2024 • Startup • Trust A • Hiring 14
HQ: Paris, France • AI Chips & Accelerators • Processors, MCUs & AI Chips • 201-500 employees • Est. 2024 • Startup • Trust A • Hiring 14
Arago develops photonic processors that run artificial intelligence workloads using light instead of electrons. Its aim is to cut the energy consumption of large model inference by an order of magnitude. The company is headquartered in Paris.
Eric Acher · Gérant · decision-maker
Careers mailbox is known
Verified live · 4 hours ago 2 months ago Long shot · 14%

ML Systems Engineer — Inference Acceleration

≈ $58k – $124k per year (Estimated) • Equity • In office (Paris, France) • Full-Time • English
Python
C++
AI/ML
vLLM
CUDA Toolkit
SGLang
TensorRT-LLM
CUDA
Triton
ROCm
MLIR
KV Cache
TensorRT
+4
Apply

WEKA

weka.io
weka.io • HQ: Campbell, United States • AI Compute & Inference • Enterprise Storage Systems • 1001-5000 employees • Est. 2013 • Trust B • Hiring 57, 4 new
HQ: Campbell, United States • AI Compute & Inference • Enterprise Storage Systems • 1001-5000 employees • Est. 2013 • Trust B • Hiring 57, 4 new
WEKA builds a parallel file system designed to keep GPU clusters fed with data during large training runs. Founded in 2013 with Israeli engineering roots, its software runs on commodity flash hardware and cloud instances alike. It is widely deployed in artificial intelligence research centres and supercomputing sites.
No named decision-maker yet.
Careers mailbox is known
Verified live · 4 hours ago Visa sponsor 2 months ago Fading · 43%

Principal Product Manager, Augmented Memory Grid (AMG)

≈ $213k – $374k per year (Estimated) • Lead • 10+ years exp • Remote (United States) • PhD • Principal
Ray Serve
vLLM
Quantization
AI Agents
TensorRT-LLM
LLM
Together AI
Triton
CoreWeave
KV Cache
Machine Learning
TensorRT
Ray
DevOps
Kubernetes
+6
Apply

Socure

socure.com
socure.com • HQ: New York, United States • Financial AI • Fraud Detection • Identity Management • 501-1000 employees • Est. 2012 • Startup • Trust A • Hiring 86, 4 new
HQ: New York, United States • Financial AI • Fraud Detection • Identity Management • 501-1000 employees • Est. 2012 • Startup • Trust A • Hiring 86, 4 new
Socure is a leading digital identity verification and fraud prevention platform that uses artificial intelligence and machine learning to verify consumer identities in real time. The company analyzes thousands of predictive data points - including biometrics, device intelligence, and email or phone attributes - to accurately authenticate individuals during online onboarding. By providing high accuracy rates across demographic groups, it enables financial institutions, digital healthcare providers, and online platforms to reduce fraud while streamlining user conversion.
Thomas Thimot · Executive Officer, Director · decision-maker
Sunil Madhu · Director · decision-maker
Avi Aronovitz · Executive Officer · decision-maker
John Ayers · Executive Officer, Director · decision-maker
Careers mailbox is known
Verified live · 2 hours ago 2 months ago Likely open · 50%

Software Engineer II — Agentic AI Foundations

$95k – $124k per year • Middle • 2+ years exp • In office (Toronto, Canada) • Bachelor's Degree • Full-Time • Middle
Python
Go
Java
AI/ML
Function Calling
AI Agents
LLM
Human-in-the-Loop
LLM Guardrails
Tool Use
Machine Learning
vLLM
CUDA Toolkit
Triton Inference Server
Fine-tuning
TensorRT
Ollama
TensorRT-LLM
CUDA
Knowledge Graph
Multi-Agent Systems
Analytics
A/B Testing
+13
Apply

Didichuxing

didichuxing.com
didichuxing.com • Beijing • Shanghai • Guangzhou • Shenzhen • Chongqing • 5000+ employees • Hiring 476, 111 new
Beijing • Shanghai • Guangzhou • Shenzhen • Chongqing • 5000+ employees • Hiring 476, 111 new
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 2 months ago Long shot · 15%

AI Infra资深研发工程师

Middle • 3+ years exp • In office (Beijing, China) • Senior
Go
C++
AI/ML
Model Context Protocol
vLLM
SGLang
TensorRT-LLM
LLM
TensorRT
DevOps
SLI/SLO/SLA
+1
Apply
Verified live · 3 hours ago 2 months ago Long shot · 16%

AI Infra架构师

≈ $30k – $88k per year (Estimated) • Senior • 5+ years exp • In office (Beijing, China) • Architect
LangGraph
LangChain
Model Context Protocol
vLLM
Function Calling
SGLang
TensorRT-LLM
RAG
InfiniBand
KV Cache
TensorRT
DevOps
Kubernetes
SLI/SLO/SLA
+5
Apply
Verified live · 3 hours ago 2 months ago Long shot · 15%

AI Infra研发专家

Middle • 3+ years exp • In office (Beijing, China) • Senior
Go
C++
AI/ML
Model Context Protocol
vLLM
SGLang
TensorRT-LLM
LLM
TensorRT
DevOps
SLI/SLO/SLA
+1
Apply

XPeng

xpengmotors.com
xpengmotors.com • HQ: Guangzhou, China • Autonomous Driving • Automotive Manufacturing • 5000+ employees • Est. 2014 • Trust B • Hiring 22, 1 new
HQ: Guangzhou, China • Autonomous Driving • Automotive Manufacturing • 5000+ employees • Est. 2014 • Trust B • Hiring 22, 1 new
XPeng is a Chinese smart electric vehicle maker that also develops autonomous driving, intelligent cabin technology and robotics. Its general intelligence center works on foundation models, world models and physical AI, and it hires machine learning engineers and robotics leads in California. The company is headquartered in Guangzhou, China.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 4 hours ago 2 months ago Likely open · 57%

Staff Machine Learning Engineer - LLM Quantization & Deployment

$215k – $364k per year • Staff+ • 3+ years exp • In office (Santa Clara, Mountain View, United States) • Master's Degree • Full-Time • Staff
Python
AI/ML
Fine-tuning
Quantization
Transformers
PyTorch
LLM
Vision-Language-Action
Model Distillation
Machine Learning
llama.cpp
vLLM
SGLang
AWQ
GPTQ
TensorRT
TensorRT-LLM
ONNX Runtime
MLIR
Apache TVM
KV Cache
+12
Apply
Top 25% payVerified live · 4 hours ago 2 months ago Likely open · 57%

Senior Machine Learning Engineer - LLM Quantization & Deployment

$175k – $296k per year • Senior • 1+ year exp • In office (Santa Clara, Mountain View, United States) • Master's Degree • Full-Time • Senior
Python
AI/ML
Fine-tuning
Quantization
Transformers
PyTorch
LLM
Vision-Language-Action
Model Distillation
Machine Learning
llama.cpp
vLLM
SGLang
AWQ
GPTQ
TensorRT
TensorRT-LLM
ONNX Runtime
MLIR
Apache TVM
KV Cache
+12
Apply

Eka Care

eka.care
eka.care • HQ: Bengaluru, India • Practice Management Software • Consumer Health Apps • EHR & Clinical Software • 11-50 employees • Est. 2020 • Startup • Trust B • Hiring 24, 2 new
HQ: Bengaluru, India • Practice Management Software • Consumer Health Apps • EHR & Clinical Software • 11-50 employees • Est. 2020 • Startup • Trust B • Hiring 24, 2 new
Eka Care provides a personal health record and clinic management platform. Patients store prescriptions and reports while doctors manage consultations digitally. The company integrates with national digital health infrastructure.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 2 months ago Long shot · 11%

Senior Data Scientist ( Kernel Optimisation & Inference Engineer)

≈ $24k – $50k per year (Estimated) • Senior • 2+ years exp • In office (Bengaluru, India) • Full-Time • Senior
vLLM
CUDA Toolkit
SGLang
AWQ
GPTQ
TensorRT-LLM
Perplexity
Mixture of Experts
CUDA
Edge AI
Speculative Decoding
TensorRT
+4
Apply

Sarvam AI

sarvam.ai
sarvam.ai • HQ: Bengaluru, India • LLM & Generative AI • Speech & Audio AI • Foundation Models • Natural Language Processing • 501-1000 employees • Est. 2023 • Startup • Trust A • Hiring 40, 1 new
HQ: Bengaluru, India • LLM & Generative AI • Speech & Audio AI • Foundation Models • Natural Language Processing • 501-1000 employees • Est. 2023 • Startup • Trust A • Hiring 40, 1 new
Sarvam AI is a leading Indian artificial intelligence company focused on building full-stack sovereign generative AI infrastructure, foundational large language models (LLMs), and speech technologies tailored for India’s diverse languages and enterprise requirements.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 2 months ago Likely open · 60%

Performance Engineer, Inference

≈ $14k – $34k per year (Estimated) • Junior • 2+ years exp • Hybrid (Bengaluru, Chennai, India) • Full-Time • Junior
C++
AI/ML
vLLM
CUDA Toolkit
Knowledge Distillation
SGLang
TensorRT-LLM
LLM
Mixture of Experts
TPOT
CUDA
NCCL
Speculative Decoding
KV Cache
Model Distillation
Multimodal AI
Speech Recognition
TensorRT
Text-to-Speech
DevOps
SLI/SLO/SLA
+11
Apply

KakaoBank

kakaobank.com
kakaobank.com • HQ: Seongnam, South Korea • Digital Banks & Neobanks • Est. 2016 • Trust B • Hiring 17, 2 new
HQ: Seongnam, South Korea • Digital Banks & Neobanks • Est. 2016 • Trust B • Hiring 17, 2 new
KakaoBank is a Seongnam internet only bank that launched in 2017 and signed up millions of customers within weeks. It offers deposits, loans and card products entirely through a mobile application with no branches, and is known for playful product design. The company is one of the most valuable listed banks in Korea by market capitalisation relative to assets.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 2 months ago Long shot · 8%

LLM 서빙 및 추론 최적화 엔지니어

Junior • 2+ years exp • In office (Seongnam, South Korea) • Junior • Korean: C1
vLLM
CUDA Toolkit
NLP
SGLang
TensorRT-LLM
TGI
LLM
Mixture of Experts
CUDA
Triton
Speculative Decoding
TensorRT
DevOps
Kubernetes
+5
Apply

Spirit AI

spirit-ai.com
spirit-ai.com • HQ: Beijing, China • 501-1000 employees • Est. 2024 • Startup • Trust B • Hiring 48, 1 new
HQ: Beijing, China • 501-1000 employees • Est. 2024 • Startup • Trust B • Hiring 48, 1 new
Spirit AI is a Chinese embodied intelligence company that develops general-purpose humanoid robots and foundation models that act as a general brain for robots, headquartered in Beijing. Founded in January 2024 and operated by a Beijing-registered company, it builds its own Spirit series of embodied models, such as Spirit v1.5, which it reports leads the RoboChallenge benchmark, and delivers robots to research institutes, showrooms and factories. It recruits robot software engineers, model fine-tuning and reinforcement learning researchers, hardware test engineers and solution engineers, plus interns, with offices in Shenzhen and Hangzhou.
No named decision-maker yet.
No careers mailbox known
Verified live · 27 min ago 2 months ago Long shot · 7%

【2027 届校招】AI Infra工程师

In office (Beijing, China) • Full-Time • Chinese: C1
vLLM
VLM
SGLang
TensorRT-LLM
Triton
TensorRT
Apply
Open 126 daysVerified live · 27 min ago 4 months ago Long shot · 4%

【校招实习】AI Infra工程师

In office (Beijing, China) • Internship • Intern • Chinese: C1
vLLM
VLM
SGLang
TensorRT-LLM
Triton
TensorRT
Apply
Machines can read this selection · checked 05:23 UTC
TensorRT-LLM Jobs - Remote & On-site
Frequently asked questions
How many TensorRT-LLM jobs are available on Alion?
There are currently 200 active listings from 89 hiring companies on Alion, refreshed daily.
What salary do TensorRT-LLM jobs pay?
The average salary is around $275,399 per year based on the current listings.
Are remote options available for TensorRT-LLM jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for TensorRT-LLM jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.