TensorRT-LLM Jobs - Remote & On-site

TensorRT-LLM jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $275,399/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Coupang

coupang.com
coupang.com • HQ: Seoul, South Korea • Delivery • Marketplaces • E-commerce Platforms • 1001-5000 employees • Est. 2010 • Trust A • Hiring 540, 55 new
HQ: Seoul, South Korea • Delivery • Marketplaces • E-commerce Platforms • 1001-5000 employees • Est. 2010 • Trust A • Hiring 540, 55 new
Coupang is a leading South Korean e-commerce company founded in 2010 that operates one of the country's largest online retail platforms. The company is widely recognized for its specialized logistics network, known as "Rocket Delivery," which enables same-day or next-day fulfillment for millions of products. In addition to online shopping, Coupang has expanded its ecosystem into digital streaming with Coupang Play, food delivery through Coupang Eats, and international markets such as Taiwan.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 25 days ago Hiring now · 87%

Staff Backend Engineer - K8 (Envoy)

≈ $35k – $92k per year (Estimated) • Staff+ • 8+ years exp • In office (Bengaluru, India) • Staff
Python
Go
Java
Databases
Redis
Apache Kafka
AI/ML
vLLM
SGLang
TensorRT-LLM
Kubeflow
LLM
RAG
Ray
KServe
Triton
TensorRT
DevOps
gRPC
GCP
Istio
Envoy
Linkerd
Azure
ArgoCD
AWS
Kubernetes
SLI/SLO/SLA
+17
Apply

Xiaohongshu

xiaohongshu.com
xiaohongshu.com • HQ: Shanghai, China • Social Networks • Social Commerce • 5000+ employees • Est. 2013 • Trust A • Hiring 969, 62 new
HQ: Shanghai, China • Social Networks • Social Commerce • 5000+ employees • Est. 2013 • Trust A • Hiring 969, 62 new
Headquartered in Shanghai, China, Xiaohongshu - frequently referred to as RED or Little Red Book - is a premier social media and lifestyle-sharing platform. The digital network allows users to create, discover, and share short-form videos, photo blogs, and reviews covering fashion, travel, beauty, and daily living. By combining user-generated content with integrated e-commerce capabilities, it serves as a major product discovery engine and influencer marketing hub for global brands.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 26 days ago Likely open · 47%

【2027校招】大模型MaaS架构研发工程师

In office (Beijing, China) • Chinese: C1
Python
Java
C++
AI/ML
vLLM
SGLang
TensorRT-LLM
LLM
TensorRT
DevOps
Kubernetes
SLI/SLO/SLA
+2
Apply
Verified live · 1 hour ago 26 days ago Likely open · 47%

【2027校招】大模型 Infra 工程师

In office (Beijing, China) • Chinese: C1
Python
Rust
C++
C++
PyTorch C++
AI/ML
DeepSpeed
vLLM
CUDA Toolkit
SGLang
AWQ
GPTQ
TensorRT-LLM
TRL
PyTorch
LLM
TPOT
CUDA
DPO
SFT
PPO
GRPO
Megatron-LM
ROCm
KV Cache
Reward Modeling
TensorRT
Transformers
DevOps
SLI/SLO/SLA
+19
Apply
Verified live · 1 hour ago 26 days ago Likely open · 47%

【2027校招】Agent平台全栈研发工程师

In office (Beijing, China)
Python
Java
SQL
Databases
MySQL
Redis
AI/ML
Cursor
AutoGen
LangChain
Claude Code
DeepSpeed
Dify
LlamaIndex
Model Context Protocol
vLLM
Prompt Engineering
Function Calling
SGLang
TensorRT-LLM
Kubeflow
PyTorch
CrewAI
LLM
RAG
LLMOps
OpenAI Codex
Megatron-LM
Tool Use
TensorRT
DevOps
Docker
Kubernetes
Argo Workflows
+23
Apply

NIO

nio.com
nio.com • HQ: Shanghai, China • 1001-5000 employees • Est. 2014 • Trust C • Hiring 253, 12 new
HQ: Shanghai, China • 1001-5000 employees • Est. 2014 • Trust C • Hiring 253, 12 new
NIO designs premium electric vehicles with an extensive battery swapping network. Its cars include a proprietary digital assistant and advanced driver assistance system. The company operates member lounges and services across China and parts of Europe.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 28 days ago Long shot · 22%

AI Infra 测试工程师

In office (Shanghai, China) • Full-Time • Chinese: C1
Python
C++
C
C
GCC
C++
PyTorch C++
LLVM
AI/ML
vLLM
AI Agents
SGLang
TensorRT-LLM
Transformers
PyTorch
KV Cache
TensorRT
DevOps
Linux
QA
Pytest
+8
Apply
Verified live · 3 hours ago 29 days ago Long shot · 22%

AI infra研发工程师(推理系统)

In office (Shanghai, China) • Full-Time
Python
C++
AI/ML
vLLM
CUDA Toolkit
SGLang
AWQ
GPTQ
TensorRT
TensorRT-LLM
Transformers
CUDA
Triton
MLIR
Apache TVM
XLA
IREE
KV Cache
+9
Apply
Verified live · 3 hours ago 1 month ago Long shot · 14%

大模型推理框架工程师实习生

In office (Shanghai, China) • Internship • Intern • Chinese: C1
Python
AI/ML
vLLM
CUDA Toolkit
SGLang
TensorRT-LLM
Transformers
LLM
Ray
CUDA
Triton
LLMOps
KV Cache
TensorRT
DevOps
Helm
Prometheus
CI/CD
Git
Docker
Kubernetes
Grafana
Linux
+13
Apply

NTT DATA

nttdata.com
nttdata.com • HQ: Tokyo, Japan • Data Centers & Colocation • Managed IT Services (MSP) • Financial Software & Embedded Finance • IT Consulting & Digital Transformation • Systems Integrators • 5000+ employees • Est. 1988 • Trust B • Hiring 1484, 422 new
HQ: Tokyo, Japan • Data Centers & Colocation • Managed IT Services (MSP) • Financial Software & Embedded Finance • IT Consulting & Digital Transformation • Systems Integrators • 5000+ employees • Est. 1988 • Trust B • Hiring 1484, 422 new
NTT DATA is a Tokyo system integrator founded in 1988 that spun out of the data communications arm of NTT. It is one of the largest information technology services firms in the world, building banking, public sector and payment systems and operating global consulting and managed services. The company runs the CAFIS payment network used across Japanese retail and banking.
Abhijit Dubey · 代表取締役社長 · decision-maker
No careers mailbox known
Verified live · 2 hours ago 28 days ago Fading · 28%

Senior Principal AI Infrastructure Architect

≈ $75k – $156k per year (Estimated) • Lead • Milan • Remote (Italy) • Bachelor's Degree • Full-Time • Architect
vLLM
CUDA Toolkit
Triton Inference Server
Fine-tuning
TensorRT-LLM
Kubeflow
RAG
CUDA
Triton
Pre-training
NCCL
InfiniBand
NVLink
ROCm
cuDNN
TensorRT
DevOps
SLURM
Kubernetes
Amazon S3
OpenShift
Management
Agile
+13
Apply

Salad Technologies

salad.com
salad.com • HQ: Vancouver, United States • LLM & Generative AI • Cybersecurity • Artificial Intelligence • Cloud Platforms (IaaS & PaaS) • AI Compute & Inference • Est. 2018 • Startup • Hiring 1
HQ: Vancouver, United States • LLM & Generative AI • Cybersecurity • Artificial Intelligence • Cloud Platforms (IaaS & PaaS) • AI Compute & Inference • Est. 2018 • Startup • Hiring 1
Salad Technologies builds a distributed cloud from consumer gaming PCs whose owners rent out spare GPU time. Founded in 2018 in Washington state, it serves artificial intelligence inference, transcription and image generation workloads at low cost. Its network spans hundreds of thousands of consumer machines worldwide.
Robert Miles · Executive Officer, Director · decision-maker
Derek Urben · Director
Damian Fox · Director
Jeffrey Stowell · Director
No careers mailbox known
Verified live · 3 hours ago Visa sponsor 29 days ago Fading · 37%

Staff Software Engineer, AI Inference Gateway

$180k – $220k per year • Equity • Staff+ • Remote (United States) • Full-Time • Staff
Rust
AI/ML
llama.cpp
vLLM
Embeddings
Quantization
TensorRT-LLM
TGI
LLM
KV Cache
CUDA Toolkit
AWQ
GGUF
GPTQ
TensorRT
CUDA
ROCm
DevOps
OpenTelemetry
+9
Apply
Report

Featherless

featherless.ai
featherless.ai • HQ: San Francisco, United States • Artificial Intelligence • LLM & Generative AI • AI Compute & Inference • 51-200 employees • Est. 2023 • Startup • Trust C • Hiring 16
HQ: San Francisco, United States • Artificial Intelligence • LLM & Generative AI • AI Compute & Inference • 51-200 employees • Est. 2023 • Startup • Trust C • Hiring 16
Featherless is a serverless AI inference platform that makes tens of thousands of open-source AI models instantly available through a single API. Learn about our team, our research roots, and our $20M Series A.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 1 hour ago 29 days ago Long shot · 12%

Founding Sales Engineer

$150k – $190k per year • Middle • 3+ years exp • Atlanta • Tampa • Miami • Orlando • Ottawa • Remote (United States, Canada) • Full-Time • Middle
Python
AI/ML
LoRA
vLLM
Quantization
SGLang
TensorRT-LLM
LLM
OpenAI
Hugging Face
KV Cache
TensorRT
PEFT
ROCm
DevOps
Kubernetes
+6
Apply

Verda

verda.com
verda.com • HQ: Helsinki, Finland • Cloud Platforms (IaaS & PaaS) • AI Compute & Inference • 51-200 employees • Est. 2020 • Startup • Hiring 28, 2 new
HQ: Helsinki, Finland • Cloud Platforms (IaaS & PaaS) • AI Compute & Inference • 51-200 employees • Est. 2020 • Startup • Hiring 28, 2 new
Cloud infrastructure shaped by AI workloads. Peak efficiency across software, compute, storage, and networking.
Ruben Bryon · CEO · founder
Careers mailbox is known
29 days ago Likely open · 51%

Senior Backend Engineer – LLM Inference

≈ $62k – $160k per year (Estimated) • Senior • 4+ years exp • In office (Helsinki, Finland) • Senior
Go
SQL
JavaScript
TypeScript
Databases
PostgreSQL
NATS
ClickHouse
Apache Kafka
AI/ML
LLM
OpenAI
vLLM
SGLang
TensorRT
TensorRT-LLM
KServe
KV Cache
Frontend
React.js
DevOps
Helm
GitOps
Kubernetes
kubectl
Istio
Envoy
Prometheus
VictoriaMetrics
ArgoCD
+18
Apply

VESSL AI

vessl.ai
vessl.ai • HQ: San Francisco, United States • Artificial Intelligence • MLOps • AI Compute & Inference • 51-200 employees • Est. 2020 • Startup • Hiring 20, 2 new
HQ: San Francisco, United States • Artificial Intelligence • MLOps • AI Compute & Inference • 51-200 employees • Est. 2020 • Startup • Hiring 20, 2 new
VESSL AI is an artificial intelligence infrastructure and MLOps platform specializing in cloud compute orchestration and GPU cluster management. Headquartered in San Francisco, California, United States, the company unifies fragmented GPU resources across multi-cloud environments to streamline model training, fine-tuning, and deployment. Through automated workflow management and scalable cluster access, the enterprise empowers AI research labs, startups, and commercial clients to reduce infrastructure friction and accelerate machine learning development.
Jaeman An · Executive Officer, Director · decision-maker
Dami Yi · Executive Officer, Director · decision-maker
Walter Apodaca · Executive Officer, Director · decision-maker
Daniel Murphy · Executive Officer · decision-maker
No careers mailbox known
Verified live · 4 min ago 29 days ago Fading · 40%

Forward Deployed Engineer (Junior)

≈ $53k – $143k per year (Estimated) • Junior • Hybrid (Seoul, South Korea) • Full-Time • Junior • Korean: C1
Python
AI/ML
vLLM
AI Agents
SGLang
TensorRT-LLM
InfiniBand
TensorRT
DevOps
Git
Linux
Chips/EDA
PoC Library
+2
Apply
Verified live · 4 min ago 29 days ago Likely open · 60%

Forward Deployed Engineer (Senior)

≈ $87k – $201k per year (Estimated) • Senior • 5+ years exp • Hybrid (Seoul, South Korea) • Full-Time • Senior • Korean: C1
Python
AI/ML
vLLM
AI Agents
SGLang
TensorRT-LLM
InfiniBand
TensorRT
DevOps
Git
HPC
Linux
Chips/EDA
PoC Library
+3
Apply

ByteDance

bytedance.com
bytedance.com • HQ: Beijing, China • Advertising • Digital Media • Recommendation Systems • Video & Photo Sharing • Consumer Internet Groups • 1001-5000 employees • Est. 2012 • Trust A • Hiring 6392, 66 new
HQ: Beijing, China • Advertising • Digital Media • Recommendation Systems • Video & Photo Sharing • Consumer Internet Groups • 1001-5000 employees • Est. 2012 • Trust A • Hiring 6392, 66 new
ByteDance is a Chinese internet technology company founded in Beijing in 2012 that operates some of the world's largest content and commerce platforms. Its portfolio includes the short-video apps TikTok and Douyin, the news aggregator Toutiao, the video editor CapCut, the workplace suite Lark and the Doubao family of AI assistants and models. Recommendation systems trained on user behaviour sit at the centre of every product, and the company has grown into one of the highest-revenue private technology businesses in the world.
Liang Rubo · Co-Founder & Chief Executive Officer · decision-maker
Shou Zi Chew · Chief Executive Officer, TikTok · decision-maker
Zhang Yiming · Co-Founder · founder
No careers mailbox known
Verified live · 3 hours ago Visa sponsor 29 days ago Hiring now · 72%

Software Engineer Graduate (AI Compute) - 2027 Start (PhD)

≈ $159k – $323k per year (Estimated) • Junior • In office (San Jose, United States) • PhD • Full-Time • Junior
Python
Rust
C++
C++
PyTorch C++
AI/ML
vLLM
SGLang
TensorRT-LLM
LLM
Ray
DeepSpeed
CUDA Toolkit
Vertex AI
TensorRT
PyTorch
CUDA
Amazon SageMaker
Machine Learning
DevOps
Docker
Kubernetes
GCP
Azure
AWS
+14
Apply
Verified live · 3 hours ago 1 month ago Hiring now · 72%

AI Agent Algorithm Engineer Intern (Global E-Commerce, Affiliate) - 2027 Start

Intern • In office (Singapore) • Bachelor's Degree • Internship • Intern
Python
Java
Rust
C++
AI/ML
Model Context Protocol
AI Agents
NLP
LLM
DPO
SFT
vLLM
RLHF
TensorRT
TensorRT-LLM
RAG
Mixture of Experts
Post-training
Context Engineering
Prompt Caching
Tool Use
RLAIF
Reward Modeling
+14
Apply

Gallatin

gallatin.ai
gallatin.ai • HQ: El Segundo, United States • Military • Logistics • Artificial Intelligence • 201-500 employees • Est. 2024 • Trust A • Hiring 22, 1 new
HQ: El Segundo, United States • Military • Logistics • Artificial Intelligence • 201-500 employees • Est. 2024 • Trust A • Hiring 22, 1 new
Gallatin is building a logistics platform based on the needs and constraints of today's defense industry.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 30 days ago Hiring now · 90%

Machine Learning Operations (MLOps) Engineer

$80k – $210k per year • Equity • In office (El Segundo, San Francisco, Austin, United States) • PhD • Full-Time
Python
Databases
PostgreSQL
NATS
pgvector
AI/ML
vLLM
Fine-tuning
Quantization
LLM
Amazon SageMaker
Human-in-the-Loop
LLM Evaluation
KV Cache
TensorRT
TensorRT-LLM
DevOps
Azure
CI/CD
GitOps
AWS
Kubernetes
Amazon EKS
ArgoCD
+13
Apply

Joblogic

joblogic.com
joblogic.com • HQ: Birmingham, United Kingdom • Software • Field Service Management Software • 201-500 employees • Est. 1998 • Trust A • Hiring 24
HQ: Birmingham, United Kingdom • Software • Field Service Management Software • 201-500 employees • Est. 1998 • Trust A • Hiring 24
Manage jobs, engineers, assets, compliance, quotes and invoices in one system. Cloud-based field service software built for UK trades. Book a free demo today.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 2 hours ago 30 days ago Hiring now · 76%

MLOps Engineer

$667k per year • Lahore • Remote (United Kingdom, Pakistan) • Bachelor's Degree
Python
Bash
Python
FastAPI
Celery
Databases
PostgreSQL
Redis
Databricks
AI/ML
MLFlow
Computer Vision
AI Agents
LLM
LLMOps
LLM Guardrails
Machine Learning
Ray Serve
vLLM
ElevenLabs
SGLang
Arize Phoenix
Langfuse
LangSmith
TensorRT
TensorRT-LLM
Ray
Braintrust
KServe
Triton
ONNX Runtime
Mobile
Twilio
DevOps
Terraform
Ansible
OpenTelemetry
Azure
CI/CD
AWS
Docker
Ubuntu
Grafana
Configuration Management
Pipeline as Code
Bicep
Amazon EC2
Amazon S3
IAM
Amazon CloudWatch
Linux
Helm
GitHub Actions
Prometheus
Kubernetes
FinOps
Cybersecurity
Least Privilege
ISO 27001
OWASP Top 10
SOC 2
Management
Slack
Jira
WhatsApp
QA
k6
Locust
+52
Apply

PointFive

pointfive.co
pointfive.co • HQ: Tel Aviv, Israel • Cloud Cost & Multi-Cloud Management • 51-200 employees • Startup • Trust B • Hiring 13
HQ: Tel Aviv, Israel • Cloud Cost & Multi-Cloud Management • 51-200 employees • Startup • Trust B • Hiring 13
PointFive is a cloud cost optimisation company that finds the cost buried inside enterprise infrastructure, from cloud and data platforms to coding agents. Its DeepWaste approach and TokenShift product for AI token spend serve customers such as Fanatics, H&M, Hertz and Nubank. The company is headquartered in Tel Aviv, Israel.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 30 days ago Likely open · 62%

Head of LLM Research

≈ $138k – $308k per year (Estimated) • Head+ • Hybrid (Tel Aviv, Israel) • Full-Time • Architect
Python
Go
Databases
Snowflake
AI/ML
llama.cpp
LoRA
vLLM
Fine-tuning
Quantization
Knowledge Distillation
Function Calling
AI Agents
SGLang
Ollama
TensorRT-LLM
Llama
MLX ML
LLM
Hallucination
ONNX Runtime
Speculative Decoding
KV Cache
Tool Use
Model Distillation
Qwen
DeepSeek
CUDA Toolkit
Gemma
Reinforcement Learning
AWQ
GGUF
GPTQ
TensorRT
PEFT
Mistral
PyTorch
Synthetic Data
CUDA
OpenAI
Anthropic
Hugging Face
DPO
GRPO
Post-training
ROCm
Computer Use
Agentic Workflows
DevOps
Linux
Windows
AWS
Cloudflare
+42
Apply

Microsoft

microsoft.com
microsoft.com • HQ: Redmond, United States • Gaming Consoles • Console Games • Developer Tools • Cloud Platforms (IaaS & PaaS) • Office & Productivity Software • Operating Systems • 5000+ employees • Est. 1975 • Trust B • Hiring 1634, 153 new
HQ: Redmond, United States • Gaming Consoles • Console Games • Developer Tools • Cloud Platforms (IaaS & PaaS) • Office & Productivity Software • Operating Systems • 5000+ employees • Est. 1975 • Trust B • Hiring 1634, 153 new
Microsoft is an American multinational technology corporation founded in 1975 by Bill Gates and Paul Allen and headquartered in Redmond, Washington. It built the personal computing era around the Windows operating system and the Office productivity suite, and now generates the largest share of its revenue from Azure cloud infrastructure and commercial subscriptions. The company also owns GitHub, LinkedIn and the Xbox gaming business, and has invested heavily in artificial intelligence through its partnership with OpenAI and the Copilot assistants embedded across its products.
Judson Althoff · Chief Executive Officer, Commercial Business · decision-maker
Amy Hood · Executive Vice President & Chief Financial Officer · decision-maker
Satya Nadella · Chairman & Chief Executive Officer · decision-maker
Paul Allen · Co-Founder · founder
No careers mailbox known
Top 25% payVerified live · 3 hours ago 1 month ago Fading · 29%

Principal AI Software Engineer

$143k – $275k per year • Lead • 12+ years exp • In office (Washington, Mountain View, Hillsboro, United States) • Bachelor's Degree • Principal
Python
JavaScript
C#
C++
AI/ML
AI Agents
LLM
KV Cache
vLLM
CUDA Toolkit
SGLang
TensorRT
TensorRT-LLM
CUDA
NCCL
DevOps
Azure
Linux
Management
OneDrive
+9
Apply
Top 25% payVerified live · 3 hours ago 1 month ago Fading · 29%

Senior Software Engineer - Maia Model Enablement

$120k – $235k per year • Senior • 4+ years exp • In office (United States) • Bachelor's Degree • Senior
Python
C++
C++
PyTorch C++
AI/ML
vLLM
TensorRT
TensorRT-LLM
PyTorch
ONNX Runtime
Apply

Fortinet

fortinet.com
fortinet.com • HQ: Sunnyvale, United States • Endpoint Security • Network Security • Information Security • 5000+ employees • Est. 2000 • NASDAQ: FTNT • Trust A • Hiring 521, 51 new
HQ: Sunnyvale, United States • Endpoint Security • Network Security • Information Security • 5000+ employees • Est. 2000 • NASDAQ: FTNT • Trust A • Hiring 521, 51 new
Fortinet is an American cybersecurity company founded in 2000 by two brothers who had previously built the intrusion prevention firm NetScreen. It is best known for FortiGate, a firewall built around custom silicon that gives it a price and throughput advantage over software-only competitors, and it has extended that installed base into a wide security platform covering secure access service edge, endpoint protection, security operations and switching and wireless. Headquartered in Sunnyvale and listed on Nasdaq, it sells almost entirely through channel partners and is unusually strong with mid-sized enterprises and service providers.
Michael Xie · Co-founder and Chief Technology Officer · decision-maker
Ken Xie · Founder, Chairman and Chief Executive Officer · decision-maker
Christiane Ohlgart · Chief Financial Officer · decision-maker
No careers mailbox known
Verified live · 9 hours ago 1 month ago Long shot · 2%

Software Development Engineer (Machine Learning)

$150k – $183k per year • In office (Sunnyvale, United States)
Python
Rust
C++
C++
PyTorch C++
AI/ML
vLLM
Triton Inference Server
Fine-tuning
Quantization
Knowledge Distillation
AI Agents
TensorRT
TensorRT-LLM
TGI
Transformers
PyTorch
LLM
Tokenization
Triton
Hugging Face
LLM Guardrails
ONNX Runtime
KV Cache
Model Distillation
Machine Learning
CUDA Toolkit
XGBoost
NER
LightGBM
Synthetic Data
CUDA
Human-in-the-Loop
DevOps
Docker
Kubernetes
Cybersecurity
OWASP Top 10
Management
Agile
+27
Apply

Safe City Group

safecity.com
safecity.com • HQ: Abu Dhabi, United Arab Emirates • Video Surveillance • Homeland Security • National Security • Est. 2016 • Hiring 1
HQ: Abu Dhabi, United Arab Emirates • Video Surveillance • Homeland Security • National Security • Est. 2016 • Hiring 1
Headquartered in Abu Dhabi, United Arab Emirates, Safe City Group is a technology company specializing in turnkey public safety and national security solutions. The firm develops integrated command and control centers, AI-powered video analytics platforms, and custom patrol vehicles for municipal and defense clients. By leveraging IoT connectivity, biometric systems, and smart surveillance networks, the organization enables government authorities to streamline crisis management and enhance urban security.
No named decision-maker yet.
Careers mailbox is known
≈ $46k – $118k per year (Estimated) • Senior • 4+ years exp • In office (Dubai, United Arab Emirates) • Relocation • Bachelor's Degree • Full-Time • Senior
Python
SQL
AI/ML
vLLM
Quantization
Function Calling
AI Agents
Speech Recognition
TensorRT
TensorRT-LLM
LLM
RAG
Reranking
Text-to-Speech
Agentic Workflows
Tool Use
DevOps
WebRTC
WebSockets
Linux
SOAP
+11
Apply
Report

Celebal Tech

celebaltech.com
celebaltech.com • Bengaluru • Hyderabad • Ahmedabad • Jaipur • Pune • AI Consulting & Integration • IT Consulting & Digital Transformation • Data Engineering & Migration Services • Est. 2020 • Hiring 23, 1 new
Bengaluru • Hyderabad • Ahmedabad • Jaipur • Pune • AI Consulting & Integration • IT Consulting & Digital Transformation • Data Engineering & Migration Services • Est. 2020 • Hiring 23, 1 new
Celebal Tech provides Data, AI, Cloud, and IT consulting services tailored to industry needs, helping enterprises adopt digital and analytics solutions.
No named decision-maker yet.
No careers mailbox known
1 month ago Long shot · 20%

Senior Lead - Data Science

≈ $24k – $41k per year (Estimated) • Lead • 5+ years exp • Hybrid (Jaipur, Bengaluru, Pune, Noida, Gurgaon, India) • Staff
Python
SQL
Python
FastAPI
Databases
Databricks
Delta Lake
Milvus
Pinecone
Qdrant
AI/ML
LangGraph
AutoGen
LangChain
LlamaIndex
LoRA
MLFlow
Fine-tuning
AI Agents
DeepEval
PEFT
QLoRA
Semantic Kernel
Llama
Mistral
Transformers
TensorFlow
PyTorch
CrewAI
LLM
RAG
TruLens
Hallucination
OpenAI
Anthropic
Hugging Face
NVIDIA NeMo
LLM Guardrails
Agentic Workflows
Machine Learning
vLLM
TensorRT
Ollama
TensorRT-LLM
DevOps
Azure
CI/CD
Git
AWS
Docker
+38
Apply

UnitedHealth Group

unitedhealthgroup.com
unitedhealthgroup.com • HQ: Eden Prairie, United States • Health Insurance & Benefits • Pharmacies • Hospitals & Health Systems • 5000+ employees • Est. 1977 • NYSE: UNH • Trust B • Hiring 2074, 313 new
HQ: Eden Prairie, United States • Health Insurance & Benefits • Pharmacies • Hospitals & Health Systems • 5000+ employees • Est. 1977 • NYSE: UNH • Trust B • Hiring 2074, 313 new
UnitedHealth Group is an American health care and health insurance company headquartered in Eden Prairie, Minnesota, near Minneapolis. It works through two businesses, UnitedHealthcare for health benefits and Optum for care delivery, pharmacy services, data and technology, and it is the largest health care company by revenue, ranked fourth on the 2026 Fortune Global 500. Openings include customer service advocates, care coordinators, pharmacy technicians, clinical staff and software, data and AI engineers in the US, India, the Philippines and Ireland.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 3 hours ago 1 month ago Long shot · 21%

Principal AI/ML Platform Engineer - Remote

$165k – $282k per year • Lead • 10+ years exp • Hybrid (Eden Prairie, United States) • Bachelor's Degree • Principal
vLLM
Vertex AI
Quantization
AWS Bedrock
LLM
KServe
NCCL
InfiniBand
NVLink
DeepSpeed
JAX
TensorRT
TensorRT-LLM
Kubeflow
PyTorch
Ray
FSDP
DevOps
GCP
OpenShift
Azure
GitOps
ArgoCD
AWS
Kubernetes
Platform Engineering
IAM
HPC
Cybersecurity
HIPAA
Least Privilege
+21
Apply
hpe.com • HQ: Spring, United States • Cloud Platforms (IaaS & PaaS) • High-Performance Computing • Network Equipment • Enterprise Storage Systems • Servers & Data Center Hardware • 5000+ employees • Est. 2015 • Trust B • Hiring 1503, 145 new
HQ: Spring, United States • Cloud Platforms (IaaS & PaaS) • High-Performance Computing • Network Equipment • Enterprise Storage Systems • Servers & Data Center Hardware • 5000+ employees • Est. 2015 • Trust B • Hiring 1503, 145 new
Hewlett Packard Enterprise is a global technology company specializing in edge-to-cloud solutions, enterprise IT infrastructure, and intelligent software services. Formed in 2015 following the division of Hewlett-Packard Company, the organization offers servers, storage, high-performance computing, and networking capabilities through flexible consumption models like its GreenLake platform. Headquartered in Spring, Texas, the enterprise operates internationally to help commercial and public-sector clients secure, manage, and modernize their digital infrastructure.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 12 hours ago Visa sponsor 1 month ago Long shot · 22%

Senior Software Engineer, Inference

$144k – $273k per year • Senior • 8+ years exp • Durham • Fort Collins • Remote (United States) • Bachelor's Degree • Full-Time • Senior
Python
C++
AI/ML
vLLM
CUDA Toolkit
Quantization
SGLang
TensorRT-LLM
TGI
LLM
RAG
Mixture of Experts
KServe
NVIDIA NIM
CUDA
NCCL
InfiniBand
Speculative Decoding
KV Cache
TensorRT
DevOps
Kubernetes
+12
Apply
Top 25% payVerified live · 12 hours ago Visa sponsor 1 month ago Long shot · 20%

Principal Software Engineer, Inference

$160k – $303k per year • Lead • 12+ years exp • Durham • Fort Collins • Remote (United States) • Bachelor's Degree • Full-Time • Principal
Python
C++
AI/ML
vLLM
CUDA Toolkit
Quantization
SGLang
TensorRT-LLM
TGI
LLM
RAG
Mixture of Experts
KServe
NVIDIA NIM
CUDA
NCCL
InfiniBand
Speculative Decoding
KV Cache
TensorRT
DevOps
Kubernetes
+12
Apply
Verified live · 12 hours ago 2 months ago Long shot · 8%

AI and HPC Systems Performance Engineer

≈ $33k – $73k per year (Estimated) • Senior • 8+ years exp • In office (Bengaluru, India) • Master's Degree • Full-Time • Staff
Python
C++
Bash
C++
PyTorch C++
Databases
Redis
AI/ML
DeepSpeed
vLLM
CUDA Toolkit
JAX
Multimodal AI
SGLang
TensorRT
TensorRT-LLM
Transformers
PyTorch
LLM
RAG
Ray
CUDA
Hugging Face
Megatron-LM
NCCL
InfiniBand
ONNX Runtime
DevOps
HPC
Linux
Docker
Kubernetes
+20
Apply

General Compute

generalcompute.com
generalcompute.com • HQ: San Francisco, United States • Cloud Platforms (IaaS & PaaS) • AI Compute & Inference • 51-200 employees • Startup • Hiring 8
HQ: San Francisco, United States • Cloud Platforms (IaaS & PaaS) • AI Compute & Inference • 51-200 employees • Startup • Hiring 8
General Compute is the neocloud for SambaNova, Cerebras, Positron and d-Matrix. Prefill on GPUs, decode on purpose-built silicon — dedicated racks, one contract, one set of SLAs.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 1 month ago Likely open · 52%

Inference Engineer

≈ $181k – $345k per year (Estimated) • Senior • 5+ years exp • Hybrid (San Francisco, New York, United States) • Full-Time • Senior
LLM
Cerebras
Speculative Decoding
KV Cache
Groq
vLLM
SGLang
TensorRT
TensorRT-LLM
TGI
TPU
AWS Trainium
+4
Apply
Verified live · 2 hours ago 1 month ago Fading · 29%

Model Bring-up Engineer / ML Compiler Engineer

≈ $166k – $363k per year (Estimated) • Hybrid (San Francisco, New York, United States) • Full-Time
Quantization
Multimodal AI
AI Agents
LLM
Mixture of Experts
Cerebras
MLIR
XLA
KV Cache
Groq
vLLM
CUDA Toolkit
SGLang
TensorRT
TensorRT-LLM
TGI
CUDA
Triton
TPU
AWS Trainium
Apache TVM
+13
Apply
Verified live · 2 hours ago 1 month ago Fading · 29%

Head of Infrastructure

≈ $208k – $390k per year (Estimated) • Head+ • 7+ years exp • Hybrid (San Francisco, United States) • Full-Time • Architect
OpenRouter
vLLM
SGLang
TensorRT
TensorRT-LLM
TGI
Cerebras
TPU
InfiniBand
DevOps
Kubernetes
Platform Engineering
HPC
+4
Apply

Heidi

heidihealth.com
heidihealth.com • HQ: Collingwood, Australia • EHR & Clinical Software • Medical AI • 51-200 employees • Est. 2022 • Startup • Trust B • Hiring 68, 5 new
HQ: Collingwood, Australia • EHR & Clinical Software • Medical AI • 51-200 employees • Est. 2022 • Startup • Trust B • Hiring 68, 5 new
Heidi is an Australian health technology company based in Collingwood, Melbourne, that makes an AI care partner for clinicians, automating clinical documentation, form filling and task management in general practice, emergency departments and specialist clinics. Founded in 2022 as Heidi Health, it reports millions of patient sessions a week in 110 languages, has raised 96.6 million US dollars from investors including Point72, Blackbird and Headline, and supplies NHS trusts and GP practices in the UK. Heidi hires product managers, backend and platform engineers, forward deployed engineers, and customer success, sales and partnerships staff in Melbourne, Sydney, London and New York.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 1 month ago Fading · 40%

Senior AI Infrastructure Engineer

≈ $77k – $213k per year (Estimated) • Senior • 1+ year exp • Hybrid (Melbourne, Australia) • Full-Time • Senior
Python
Go
Rust
C++
C++
PyTorch C++
AI/ML
vLLM
Triton Inference Server
Fine-tuning
Quantization
SGLang
TensorRT-LLM
Triton
Speculative Decoding
KV Cache
CUDA Toolkit
Reinforcement Learning
TensorRT
PyTorch
Mixture of Experts
CUDA
Megatron-LM
FSDP
NCCL
DevOps
SLURM
Kubernetes
Linux
+18
Apply
Machines can read this selection · checked 15:22 UTC
TensorRT-LLM Jobs - Remote & On-site
Frequently asked questions
How many TensorRT-LLM jobs are available on Alion?
There are currently 200 active listings from 89 hiring companies on Alion, refreshed daily.
What salary do TensorRT-LLM jobs pay?
The average salary is around $275,399 per year based on the current listings.
Are remote options available for TensorRT-LLM jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for TensorRT-LLM jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.