TensorRT-LLM Jobs - Remote & On-site

TensorRT-LLM jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $275,399/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Mount Thor

mountthor.com
mountthor.com • HQ: San Francisco, United States • Cloud Platforms (IaaS & PaaS) • Startup • Hiring 8
HQ: San Francisco, United States • Cloud Platforms (IaaS & PaaS) • Startup • Hiring 8
Managed macOS environments for AI workloads that require native desktop access, persistent state, or model inference on Apple silicon.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago Visa sponsor 1 month ago Fading · 35%

Member of Technical Staff, Inference

≈ $196k – $401k per year (Estimated) • Staff+ • Hybrid (San Francisco, United States) • Full-Time • Staff
Python
Rust
C++
AI/ML
Quantization
MLX ML
Mixture of Experts
Speculative Decoding
KV Cache
llama.cpp
vLLM
SGLang
TensorRT
TensorRT-LLM
+5
Apply

River AI

river.ai
river.ai • HQ: Palo Alto, United States • AI Development Tools • AI Chips & Accelerators • Foundation Models • 201-500 employees • Est. 2026 • Startup • Trust C • Hiring 18
HQ: Palo Alto, United States • AI Development Tools • AI Chips & Accelerators • Foundation Models • 201-500 employees • Est. 2026 • Startup • Trust C • Hiring 18
River AI is an artificial intelligence company headquartered in Palo Alto, California, and founded in 2026 by xAI co-founder Igor Babuschkin. The company is building what it calls an open AI stack, spanning personal AI models, tooling for developers to train and serve their own models, and a custom system on chip with an onboard machine learning accelerator. It raised 1.1 billion dollars led by General Catalyst with strategic investment from NVIDIA and AMD Ventures.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 2 hours ago Visa sponsorship 1 month ago Long shot · 19%

Software Engineer, Inference Systems

$200k – $420k per year • In office (Palo Alto, United States) • Relocation • Bachelor's Degree
Python
Rust
C++
AI/ML
Reinforcement Learning
Mixture of Experts
KV Cache
vLLM
CUDA Toolkit
SGLang
TensorRT
TensorRT-LLM
CUDA
Pre-training
Speculative Decoding
+6
Apply

Didi

didi.co
didi.co • San Jose • Mountain View • Los Angeles • UI/UX Design • Est. 1983 • Hiring 9
San Jose • Mountain View • Los Angeles • UI/UX Design • Est. 1983 • Hiring 9
Skip to the content About Contact Home · Product Design · Education · Online Class · Case Study: BIDS Trading · Research · Development Home About Contact Twitter LinkedIn Email Interface Innovation since 1983 We provide rigorous design services to the financial community, the re/insurance industry and other knowledge-work fields.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago Visa sponsor 1 month ago Long shot · 21%

Senior/Sr. Staff AI Infrastructure Engineer, Inference & Optimization

≈ $151k – $292k per year (Estimated) • Staff+ • 3+ years exp • In office (San Jose, Mountain View, United States) • Master's Degree • Full-Time • Staff
Python
C++
C++
PyTorch C++
AI/ML
vLLM
CUDA Toolkit
Quantization
SGLang
TensorRT
OpenMP
TensorRT-LLM
LLM
CUDA
Edge AI
ONNX Runtime
Qwen
AWQ
TGI
PyTorch
+10
Apply

Astribot

astribot.com
astribot.com • HQ: Shenzhen, China • 201-500 employees • Est. 2022 • Startup • Trust B • Hiring 32, 1 new
HQ: Shenzhen, China • 201-500 employees • Est. 2022 • Startup • Trust B • Hiring 32, 1 new
星尘智能(Astribot)于2022年底在深圳成立,我们的愿景是让数十亿人拥有AI机器人助理,我们的使命是推动人机共存、共创、共赢。.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 1 month ago Fading · 28%

数据智能工程师(Agent / 数据工程)

In office • Full-Time • Chinese: C1
Python
Python
Celery
AI/ML
LangGraph
vLLM
Function Calling
AI Agents
VLM
SGLang
TensorRT-LLM
LLM
RAG
Ray
Triton
OpenAI Agents SDK
Tool Use
LangChain
TensorRT
DevOps
Kubernetes
+10
Apply

Tether

tether.to
tether.to • HQ: San Salvador, El Salvador • Crypto Payments • Cryptocurrencies • Stablecoins • 1001-5000 employees • Est. 2014 • Trust A • Hiring 186, 41 new
HQ: San Salvador, El Salvador • Crypto Payments • Cryptocurrencies • Stablecoins • 1001-5000 employees • Est. 2014 • Trust A • Hiring 186, 41 new
Tether is a digital asset company founded in 2014 that issues USDT, the largest stablecoin in circulation and the most heavily traded asset in crypto markets. Each token is intended to hold a one-to-one peg with the United States dollar and is backed by a reserve portfolio dominated by short-dated Treasury bills, with regular attestation reports published on the reserve composition. Headquartered in San Salvador, El Salvador, the group has expanded beyond stablecoin issuance into gold-backed tokens, Bitcoin mining, energy, peer-to-peer communications and local artificial intelligence infrastructure.
Giancarlo Devasini · Chairman · decision-maker
Paolo Ardoino · Chief Executive Officer · decision-maker
Craig Sellars · Co-Founder · founder
Brock Pierce · Co-Founder · founder
No careers mailbox known
Verified live · 2 hours ago 1 month ago Hiring now · 77%

Technical Lead - GPU Infrastructure (100% Remote - Worldwide)

Lead • 8+ years exp • Tirana • Remote (India, UTC+0 – UTC+5:30 hours) • Staff • English: B2
JavaScript
Node JS
Prolog
AI/ML
CUDA Toolkit
Tokenization
CUDA
NCCL
InfiniBand
vLLM
SGLang
TensorRT
TensorRT-LLM
Kubeflow
Frontend
Bootstrap
React.js
DevOps
Loki
Prometheus
SLURM
Kubernetes
Grafana
KubeVirt
HPC
Linux
Cilium
GitOps
kubeadm
KVM
QEMU
Web3
Bitcoin
Management
Telegram
WhatsApp
+23
Apply

ServiceNow

servicenow.com
servicenow.com • HQ: Santa Clara, United States • AI Agents • Customer Support & Help Desk Software • Workflow & Process Automation (RPA, BPM) • IT Service & Asset Management • 1001-5000 employees • Est. 2004 • Trust B • Hiring 547, 113 new
HQ: Santa Clara, United States • AI Agents • Customer Support & Help Desk Software • Workflow & Process Automation (RPA, BPM) • IT Service & Asset Management • 1001-5000 employees • Est. 2004 • Trust B • Hiring 547, 113 new
ServiceNow is an American enterprise software company founded in 2004 by Fred Luddy and headquartered in Santa Clara, California. It began by replacing clumsy IT ticketing systems with a configurable workflow platform, then extended the same engine across employee, customer, security, risk and supply chain processes, so a single system routes work between people and systems across departments. Listed on the New York Stock Exchange, the company now builds AI agents into every workflow through its Now Assist and AI Platform products, and it counts most of the Fortune 500 among its customers.
Nicholas Tzitzon · Executive Officer · decision-maker
Russell Elmer · Executive Officer · decision-maker
William McDermott · Executive Officer, Director · decision-maker
Jacqueline Canney · Executive Officer · decision-maker
Careers mailbox is known
Verified live · 8 min ago Visa sponsor 1 month ago Long shot · 21%

Forward Deployed Solution Engineer – Applied AI FDE

≈ $86k – $174k per year (Estimated) • Senior • 8+ years exp • Hybrid (Montreal, Canada) • Bachelor's Degree • Full-Time • Staff • French: C1
Python
Java
Node JS
JavaScript
TypeScript
Databases
Weaviate
pgvector
Pinecone
FAISS
PostgreSQL
AI/ML
LangGraph
Weights & Biases
LangChain
LlamaIndex
LoRA
vLLM
Vertex AI
Fine-tuning
Embeddings
Quantization
Scikit-learn
Prompt Engineering
Knowledge Distillation
Function Calling
AI Agents
Arize Phoenix
LangSmith
PEFT
Semantic Kernel
TensorRT-LLM
Accelerate
AWS Bedrock
TensorFlow
PyTorch
LLM
RAG
Tokenization
Hallucination
Triton
OpenAI
Anthropic
Hugging Face
Feature Store
Human-in-the-Loop
Structured Outputs
LLM Evaluation
LLM Guardrails
Agentic Workflows
Tool Use
Model Distillation
TensorRT
Transformers
Frontend
GraphQL
Angular
React.js
DevOps
Rest API
GCP
OpenTelemetry
Azure
CI/CD
AWS
Analytics
A/B Testing
Management
ServiceNow
+55
Apply
Verified live · 8 min ago Visa sponsor 1 month ago Long shot · 12%

Senior Staff Machine Learning Engineer, Agentic Systems - Moveworks

≈ $229k – $467k per year (Estimated) • Staff+ • 12+ years exp • In office (Mountain View, United States) • Bachelor's Degree • Full-Time • Staff • English
Python
C++
C++
PyTorch C++
AI/ML
vLLM
AI Agents
NLP
TensorRT-LLM
PyTorch
LLM
Hugging Face
Machine Learning
TensorRT
Analytics
ETL/ELT
Management
ServiceNow
+6
Apply

Cisco Systems

cisco.com
cisco.com • HQ: San Jose, United States • Endpoint Security • Observability & APM • Unified Communications • Network Security • Network Equipment • 5000+ employees • Est. 1984 • NASDAQ: CSCO • Trust A • Hiring 1292, 22 new
HQ: San Jose, United States • Endpoint Security • Observability & APM • Unified Communications • Network Security • Network Equipment • 5000+ employees • Est. 1984 • NASDAQ: CSCO • Trust A • Hiring 1292, 22 new
Cisco Systems is an American networking company founded in 1984 by Stanford computer scientists Leonard Bosack and Sandy Lerner, and headquartered in San Jose, California. It is the largest supplier of enterprise networking equipment in the world, building the routers, switches, wireless access points and optical systems that carry traffic across corporate networks, service providers and data centres, together with the software and silicon that run them. The company has diversified heavily into security, observability through Splunk, collaboration with Webex, and AI infrastructure networking, and now earns a growing share of revenue from software subscriptions rather than hardware sales.
Mark Patterson · Chief Financial Officer · decision-maker
Chuck Robbins · Chair & Chief Executive Officer · decision-maker
Sandy Lerner · Co-Founder · founder
Leonard Bosack · Co-Founder · founder
No careers mailbox known
Top 25% payVerified live · 6 hours ago Visa sponsor 1 month ago Long shot · 21%

Machine Learning Engineering Technical Leader - CX AI

$257k – $384k per year • Equity • Lead • 11+ years exp • Hybrid (San Jose, United States) • Bachelor's Degree • Full-Time • Staff
Python
AI/ML
Fine-tuning
JAX
AI Agents
PyTorch
LLM
Edge AI
Machine Learning
llama.cpp
LoRA
vLLM
Quantization
Knowledge Distillation
Transfer Learning
SGLang
TensorRT
PEFT
TensorRT-LLM
Transformers
RAG
Triton
OpenAI
Speculative Decoding
KV Cache
Agentic Workflows
Model Distillation
DevOps
CI/CD
+19
Apply
Verified live · 6 hours ago 1 month ago Long shot · 22%

Solutions Engineer - AI & Cloud Infrastructure

≈ $131k – $313k per year (Estimated) • Staff+ • 10+ years exp • In office (Melbourne, Sydney, Brisbane, Australia) • Bachelor's Degree • Full-Time • Staff
Python
AI/ML
Machine Learning
vLLM
Triton Inference Server
Multimodal AI
TensorRT-LLM
TensorFlow
PyTorch
NVIDIA NIM
DevOps
OpenShift
Kubernetes
+3
Apply
Verified live · 6 hours ago 1 month ago Long shot · 16%

Solutions Engineer - Artificial Intelligence (AI) Practitioner

≈ $90k – $165k per year (Estimated) • Staff+ • 10+ years exp • Hybrid (Singapore) • Bachelor's Degree • Full-Time • Staff
Python
AI/ML
Machine Learning
vLLM
Triton Inference Server
Multimodal AI
TensorRT
TensorRT-LLM
TensorFlow
PyTorch
NVIDIA NIM
InfiniBand
DevOps
OpenShift
Kubernetes
+5
Apply
shengwang.cn • HQ: Shanghai, China • Artificial Intelligence • Trust B • Hiring 22, 2 new
HQ: Shanghai, China • Artificial Intelligence • Trust B • Hiring 22, 2 new
声网是全球实时音视频云服务开创者,为人与人、人与智能体的音视频互动提供最佳体验。开发者只需简单调用声网 API,即可在应用内快速构建诸如对话式 AI、音视频通话、直播等多种实时互动场景。.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 1 month ago Long shot · 22%

AI模型服务化工程师

In office (Shanghai, China) • Chinese: C1
Python
Rust
C++
C++
PyTorch C++
Databases
ElasticSearch
AI/ML
Seldon Core
Ray Serve
vLLM
CUDA Toolkit
Triton Inference Server
BentoML
TensorRT-LLM
TGI
OpenVINO
PyTorch
LLM
KServe
CUDA
NCCL
InfiniBand
ONNX Runtime
KV Cache
TensorRT
Ray
DevOps
gRPC
Terraform
Helm
Loki
OpenTelemetry
Envoy
Kong
Prometheus
CI/CD
GitOps
ArgoCD
Docker
Kubernetes
Nginx
Grafana
FinOps
SLI/SLO/SLA
API Gateway
Linux
DNS
+36
Apply
Verified live · 2 hours ago 2 months ago Long shot · 9%

深度学习系统工程师(GPU训练/推理)

In office (Shanghai, China) • Chinese: C1
Python
C++
C++
PyTorch C++
AI/ML
vLLM
CUDA Toolkit
SGLang
TensorRT
TensorRT-LLM
Transformers
PyTorch
LLM
CUDA
cuDNN
CUTLASS
Speculative Decoding
+7
Apply

Aisensy

aisensy.com
aisensy.com • HQ: Bengaluru, India • Messaging Apps • Marketing & Sales AI • Est. 2020 • Likely startup • Hiring 3
HQ: Bengaluru, India • Messaging Apps • Marketing & Sales AI • Est. 2020 • Likely startup • Hiring 3
AiSensy is the AI-first WhatsApp Marketing Platform built on official WhatsApp Business APIs. Broadcast offers, automate notifications & solve for support.
No named decision-maker yet.
Careers mailbox is known
1 month ago Long shot · 15%

AI Engineer

≈ $21k – $50k per year (Estimated) • Middle • 3+ years exp • In office (Bengaluru, India) • Middle
Python
Python
FastAPI
Databases
Weaviate
Chroma
Milvus
pgvector
Pinecone
PostgreSQL
AI/ML
LangGraph
AutoGen
LangChain
LlamaIndex
Fine-tuning
Prompt Engineering
Multimodal AI
AI Agents
TensorFlow
PyTorch
CrewAI
LLM
RAG
Hallucination
Agentic Workflows
Multi-Agent Systems
Machine Learning
Claude
vLLM
TensorRT
TensorRT-LLM
TGI
Llama
Mistral
Gemini
DevOps
Rest API
GCP
Azure
CI/CD
Git
AWS
Docker
Kubernetes
+33
Apply

OpenTable

opentable.com
opentable.com • HQ: San Francisco, United States • Catering & Food Services • Scheduling & Booking Software • Food & Beverages • 501-1000 employees • Est. 1998 • Trust A • Hiring 108, 13 new
HQ: San Francisco, United States • Catering & Food Services • Scheduling & Booking Software • Food & Beverages • 501-1000 employees • Est. 1998 • Trust A • Hiring 108, 13 new
OpenTable is an online restaurant reservation platform and restaurant management software provider headquartered in San Francisco, California. Founded in 1998 and owned by Booking Holdings since 2014, it lets millions of diners book tables at more than 70,000 partner restaurants and sells reservation, guest management and marketing tools, with large offices in Toronto, London and New York. It hires sales development representatives, account managers, marketing managers, product designers, legal counsel, recruiters and site reliability engineers.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 1 month ago Likely open · 64%

Staff Machine Learning Engineer

≈ $92k – $188k per year (Estimated) • Equity • Staff+ • 7+ years exp • Hybrid (Toronto, Canada) • PhD • Staff
Python
Java
Python
Flask
FastAPI
Poetry
Gunicorn
Uvicorn
Java
Maven
Databases
PostgreSQL
Redis
Snowflake
Delta Lake
Qdrant
ElasticSearch
Apache Kafka
AI/ML
LangChain
CatBoost
Spark
Model Context Protocol
vLLM
XGBoost
Quantization
Multimodal AI
AI Agents
NLP
LangSmith
TensorRT-LLM
TGI
PyTorch
LLM
RAG
Amazon SageMaker
Machine Learning
TensorRT
DevOps
GCP
Helm
Prometheus
Azure
CI/CD
AWS
Docker
Kubernetes
Grafana
TeamCity
Amazon S3
Analytics
ETL/ELT
A/B Testing
Management
Slack
+40
Apply

Samsung Semiconductor

samsungsemiconductor.com
samsungsemiconductor.com • HQ: San Jose, United States • Processors, MCUs & AI Chips • Memory & Storage Chips • Trust B • Hiring 57, 2 new
HQ: San Jose, United States • Processors, MCUs & AI Chips • Memory & Storage Chips • Trust B • Hiring 57, 2 new
Samsung Semiconductor is the US-based semiconductor arm of Samsung Electronics, headquartered in San Jose, California, handling sales, marketing and research for Samsung memory, storage, foundry and system LSI products in the Americas. It supports customers building smartphones, electric vehicles, hyperscale data centers and IoT devices, and takes part in industry standards work such as NVMe and the Open Compute Project for enterprise storage. Recent openings are mostly senior engineering roles in DRAM, memory systems architecture, RTL design and verification, analog and SerDes circuit design, packaging, thermal and compilers, plus foundry sales, tax and accounting positions.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 2 hours ago Visa sponsor 1 month ago Likely open · 63%

Technical Director, Large-Scale AI Model Inferencing

$219k – $351k per year • Head+ • 12+ years exp • Hybrid (San Jose, United States) • Bachelor's Degree • Architect
llama.cpp
Qwen
DeepSeek
vLLM
CUDA Toolkit
Multimodal AI
AI Agents
SGLang
Mamba
TensorRT-LLM
Llama
Transformers
PyTorch
LLM
RAG
Mixture of Experts
TPOT
CUDA
Speculative Decoding
KV Cache
TensorRT
DevOps
Rest API
Analytics
Cognos
+15
Apply
Top 25% payVerified live · 2 hours ago Visa sponsor 2 months ago Fading · 41%

Senior Staff Engineer - AI Workloads & Storage

$189k – $301k per year • Staff+ • 15+ years exp • In office (San Jose, United States) • Bachelor's Degree • Staff
Python
Rust
C++
SystemC
AI/ML
vLLM
SGLang
TensorRT-LLM
LLM
RAG
Triton
TPU
KV Cache
TensorRT
DevOps
Rest API
eBPF
Linux
+8
Apply
arlo.com • HQ: Carlsbad, United States • Video Surveillance • Smart Home Devices • 501-1000 employees • Est. 2018 • NYSE: ARLO • Trust B • Hiring 22
HQ: Carlsbad, United States • Video Surveillance • Smart Home Devices • 501-1000 employees • Est. 2018 • NYSE: ARLO • Trust B • Hiring 22
Arlo Technologies makes wireless security cameras, video doorbells and floodlight systems. Devices pair with a subscription service offering cloud recording and artificial intelligence detection. The company was spun out of Netgear and now trades independently.
No named decision-maker yet.
No careers mailbox known
Verified live · 10 hours ago Visa sponsor 1 month ago Likely open · 60%

Staff AI Engineer, Applied AI — Smart Vision

≈ $171k – $350k per year (Estimated) • Staff+ • 8+ years exp • In office (Milpitas, United States) • Bachelor's Degree • Full-Time • Staff
Python
C
C
FFmpeg
AI/ML
LoRA
vLLM
Fine-tuning
Embeddings
Quantization
Multimodal AI
Knowledge Distillation
Function Calling
Computer Vision
AI Agents
QLoRA
TensorRT-LLM
PyTorch
LLM
RAG
Hallucination
Hybrid Search
Triton
SFT
LLM Guardrails
Tool Use
Model Distillation
TensorRT
PEFT
Edge AI
DevOps
AWS
Docker
+22
Apply

Snowflake

snowflake.com
snowflake.com • HQ: Bozeman, United States • Databases & DBMS • Data Marketplaces, Sharing & Clean Rooms • Data Warehouses & Lakehouses • 5000+ employees • Est. 2012 • Trust A • Hiring 339, 38 new
HQ: Bozeman, United States • Databases & DBMS • Data Marketplaces, Sharing & Clean Rooms • Data Warehouses & Lakehouses • 5000+ employees • Est. 2012 • Trust A • Hiring 339, 38 new
Snowflake is an American cloud data company founded in 2012 by former Oracle database architects and headquartered in Bozeman, Montana. Its platform separates storage from compute so organisations can scale query power independently of data volume, run workloads across Amazon Web Services, Azure and Google Cloud, and share live datasets with partners without copying them. Originally a cloud data warehouse, it has expanded into data engineering, application development with Snowpark and Native Apps, and AI features through Cortex, and it listed on the New York Stock Exchange in 2020 in the largest software offering to that point.
Marcin Zukowski · Co-Founder · decision-maker
Thierry Cruanes · Co-Founder & Chief Technical Officer · decision-maker
Benoit Dageville · Co-Founder & President of Products · decision-maker
Christian Kleinerman · Executive Officer · decision-maker
Careers mailbox is known
Top 25% payVerified live · 30 min ago Visa sponsor 1 month ago Likely open · 51%

Senior/Staff System Research Engineer – LLM Inference Optimization

$236k – $330k per year • Staff+ • 5+ years exp • Hybrid (Bellevue, Menlo Park, United States) • Bachelor's Degree • Full-Time • Staff
Snowflake
AI/ML
DeepSpeed
vLLM
CUDA Toolkit
Quantization
AI Agents
SGLang
TensorRT-LLM
TensorFlow
LLM
Mixture of Experts
CUDA
Triton
Post-training
cuDNN
CUTLASS
Speculative Decoding
KV Cache
Machine Learning
TensorRT
+12
Apply

Parallel Wireless

parallelwireless.com
parallelwireless.com • HQ: Nashua, United States • Mobile Networks • Network Equipment • 501-1000 employees • Est. 2012 • Trust B • Hiring 46, 3 new
HQ: Nashua, United States • Mobile Networks • Network Equipment • 501-1000 employees • Est. 2012 • Trust B • Hiring 46, 3 new
Parallel Wireless is a telecommunications software and hardware company headquartered in Nashua, New Hampshire, and founded in 2012. The company develops cloud-native Open RAN (Radio Access Network) solutions that support 2G, 3G, 4G, and 5G technologies through software-defined radios and network automation tools. It serves mobile network operators and private industries globally, providing interoperable infrastructure designed to reduce deployment costs and increase operational efficiency.
Rajesh Mishra · Executive Officer, Director · decision-maker
Steve Papa · Executive Officer, Director · decision-maker
Careers mailbox is known
Verified live · 16 min ago Visa sponsor 1 month ago Likely open · 47%

Senior/Principal Local LLM & Generative AI Platform Engineer

≈ $164k – $288k per year (Estimated) • Lead • 7+ years exp • Remote (United States) • Bachelor's Degree • Full-Time • Principal
Python
Go
Java
C++
AI/ML
Fine-tuning
Embeddings
Quantization
Multimodal AI
Knowledge Distillation
Function Calling
LLM
RAG
Tokenization
Reranking
Structured Outputs
Tool Use
Model Distillation
llama.cpp
Ray Serve
LoRA
vLLM
CUDA Toolkit
SGLang
TensorRT
PEFT
QLoRA
TensorRT-LLM
Ray
Synthetic Data
KServe
CUDA
Triton
Post-training
ROCm
Speculative Decoding
DevOps
CI/CD
Git
Docker
Kubernetes
Linux
Cybersecurity
Least Privilege
Active Directory
+34
Apply

Gcore

gcore.com
gcore.com • HQ: Luxembourg City, Luxembourg • Cloud Platforms (IaaS & PaaS) • Web Security & DDoS Protection • AI Compute & Inference • CDN & Edge Delivery • 501-1000 employees • Est. 2014 • Hiring 14, 2 new
HQ: Luxembourg City, Luxembourg • Cloud Platforms (IaaS & PaaS) • Web Security & DDoS Protection • AI Compute & Inference • CDN & Edge Delivery • 501-1000 employees • Est. 2014 • Hiring 14, 2 new
Gcore is a cloud and edge infrastructure provider that operates a global content delivery network, edge cloud, GPU cloud and AI inference services, and DDoS and web application protection from points of presence on several continents. Its customers include gaming, media, technology and enterprise companies. The company was founded in 2014. The company is headquartered in Luxembourg City, Luxembourg.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 1 month ago Likely open · 48%

Python Inference Engineer

≈ $43k – $127k per year (Estimated) • Senior • 5+ years exp • Serbia • Remote (Cyprus) • Full-Time • Senior • English
Python
AI/ML
vLLM
Multimodal AI
SGLang
TensorRT
TensorRT-LLM
PyTorch
Machine Learning
LoRA
CUDA Toolkit
Quantization
PEFT
CUDA
Triton
Speculative Decoding
DevOps
Docker
Kubernetes
Linux
+10
Apply

ZenteiQ

zenteiq.ai
zenteiq.ai • HQ: Bengaluru, India • STEM Education • Machine Learning • Simulation & Digital Twin Software • AI for Science • Est. 2022 • Likely startup • Hiring 10, 1 new
HQ: Bengaluru, India • STEM Education • Machine Learning • Simulation & Digital Twin Software • AI for Science • Est. 2022 • Likely startup • Hiring 10, 1 new
ZenteiQ is a deep technology company headquartered in Bengaluru, India, and founded in 2022 out of research at the Indian Institute of Science. The company works on scientific machine learning, combining numerical simulation with neural networks for engineering and industrial modelling problems, and builds training programmes around those methods. It sells to industrial and research customers in India while running education initiatives that push scientific computing skills into the wider engineering workforce.
No named decision-maker yet.
Careers mailbox is known
1 month ago Long shot · 13%

Performance Engineer - Inference

In office (Bengaluru, India)
Python
AI/ML
vLLM
SGLang
TensorRT-LLM
TPU
Speculative Decoding
KV Cache
Apply

Penguin Solutions

penguinsolutions.com
penguinsolutions.com • HQ: Milpitas, United States • LLM & Generative AI • Education • Artificial Intelligence • High-Performance Computing • AI Compute & Inference • Servers & Data Center Hardware • 201-500 employees • Est. 1998 • NASDAQ: PENG • Hiring 63, 8 new
HQ: Milpitas, United States • LLM & Generative AI • Education • Artificial Intelligence • High-Performance Computing • AI Compute & Inference • Servers & Data Center Hardware • 201-500 employees • Est. 1998 • NASDAQ: PENG • Hiring 63, 8 new
Penguin Solutions designs and operates artificial intelligence computing clusters. Its services cover system design, memory products and managed infrastructure. The company builds large training environments for enterprises.
No named decision-maker yet.
Careers mailbox is known
Verified live · 9 hours ago Visa sponsor 1 month ago Fading · 39%

AI Solution Architect

$130k – $175k per year • Staff+ • 7+ years exp • United States • Remote (United States) • Master's Degree • Architect
Databricks
AI/ML
AI Agents
RAG
Triton Inference Server
Vertex AI
TensorRT
TensorRT-LLM
AWS Bedrock
LLM
Hugging Face
Amazon SageMaker
NVIDIA NeMo
DevOps
HPC
Azure
CI/CD
AWS
Kubernetes
+9
Apply

Arm Holdings

arm.com
arm.com • HQ: Cambridge, United Kingdom • Processors, MCUs & AI Chips • Semiconductor IP & Chip Design Services • 1001-5000 employees • Est. 1990 • Trust A • Hiring 397, 31 new
HQ: Cambridge, United Kingdom • Processors, MCUs & AI Chips • Semiconductor IP & Chip Design Services • 1001-5000 employees • Est. 1990 • Trust A • Hiring 397, 31 new
Arm Holdings is a British semiconductor and software design company headquartered in Cambridge, England. Rather than manufacturing physical chips directly, Arm designs energy-efficient central processing unit (CPU) architectures and intellectual property (IP), licensing them to major technology partners such as Apple, Qualcomm, Samsung, and Nvidia.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago Visa sponsorship 1 month ago Fading · 42%

Staff Software Engineer, AI Inference Cloud

≈ $176k – $320k per year (Estimated) • Staff+ • 5+ years exp • Hybrid (Seattle, United States) • Relocation • Staff
Python
Rust
C++
C++
PyTorch C++
AI/ML
vLLM
SGLang
TensorRT
TensorRT-LLM
PyTorch
Ray
DevOps
Kubernetes
+3
Apply
Verified live · 2 hours ago Visa sponsorship 1 month ago Fading · 41%

Principal Software Engineer, AI Inference Cloud

≈ $150k – $304k per year (Estimated) • Lead • 8+ years exp • Hybrid (Seattle, United States) • Relocation • Principal
Python
Rust
C++
C++
PyTorch C++
AI/ML
vLLM
SGLang
TensorRT
TensorRT-LLM
PyTorch
Ray
DevOps
Kubernetes
+3
Apply
Verified live · 2 hours ago Visa sponsorship 1 month ago Fading · 42%

Staff Software Engineer, AI Compute Infrastructure

≈ $178k – $325k per year (Estimated) • Staff+ • 5+ years exp • Hybrid (Seattle, United States) • Relocation • Staff
Python
Go
AI/ML
vLLM
CUDA Toolkit
Fine-tuning
SGLang
TensorRT-LLM
PyTorch
Ray
CUDA
NCCL
NVLink
TensorRT
DevOps
Terraform
Helm
Prometheus
ArgoCD
AWS
Kubernetes
Grafana
Amazon EKS
HPC
Linux
+15
Apply

Hello Inc

hellobike.com
hellobike.com • HQ: Shanghai, China • 1001-5000 employees • Est. 2016 • Trust D • Hiring 267, 6 new
HQ: Shanghai, China • 1001-5000 employees • Est. 2016 • Trust D • Hiring 267, 6 new
Hello Inc operates shared bicycle, electric moped and ride hailing services. It expanded from bike sharing into battery swapping and local travel services. The platform serves hundreds of Chinese cities.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 1 month ago Long shot · 18%

ai平台开发工程师(J21721)

Middle • 3+ years exp • In office (Hangzhou, China) • Middle • Chinese: C1
Python
Java
Databases
MySQL
Redis
AI/ML
DeepSpeed
vLLM
TensorRT-LLM
Kubeflow
NumPy
PyTorch
Megatron-LM
KV Cache
TensorRT
DevOps
Fluent Bit
Prometheus
CI/CD
Docker
Kubernetes
FinOps
+11
Apply

Aivar Innovations

aivar.tech
aivar.tech • HQ: Bengaluru, India • Speech & Audio AI • Cloud Consulting & Migration • AI Consulting & Integration • 51-200 employees • Est. 2024 • Startup • Hiring 15, 1 new
HQ: Bengaluru, India • Speech & Audio AI • Cloud Consulting & Migration • AI Consulting & Integration • 51-200 employees • Est. 2024 • Startup • Hiring 15, 1 new
Aivar Innovations is a tech company delivering IT services with a focus on AI, ML, and cloud solutions to help businesses drive digital transformation by developing AI-powered platforms and voice AI solutions.
No named decision-maker yet.
Careers mailbox is known
Verified live · 25 min ago 1 month ago Likely open · 62%

Senior Machine Learning Engineer - Kubogent

≈ $25k – $54k per year (Estimated) • Senior • 4+ years exp • In office (Bengaluru, India) • PhD • Full-Time • Senior
Python
AI/ML
Polars
Spark
DeepSpeed
LoRA
vLLM
MLFlow
Fine-tuning
TensorRT-LLM
TGI
Transformers
TensorFlow
Pandas
PyTorch
LLM
Ray
Tokenization
Triton
Hugging Face
FSDP
Machine Learning
AI Agents
TensorRT
PEFT
DevOps
Kubernetes
AWS
+18
Apply
Machines can read this selection · checked 14:40 UTC
TensorRT-LLM Jobs - Remote & On-site
Frequently asked questions
How many TensorRT-LLM jobs are available on Alion?
There are currently 200 active listings from 89 hiring companies on Alion, refreshed daily.
What salary do TensorRT-LLM jobs pay?
The average salary is around $275,399 per year based on the current listings.
Are remote options available for TensorRT-LLM jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for TensorRT-LLM jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.