Remote TensorRT-LLM Jobs

Remote TensorRT-LLM jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $200,000/year. Work from anywhere: fully remote positions with clear salary, time-zone and visa details. Browse and apply today.

AI/ML
Software
Data
Security
DevOps & Cloud
Leadership
Product
Design
Fintech
Hardware & Chips
Defense
Aerospace
Biotech
Energy
Robotics
Automotive
MedTech
Science

LeewayHertz

leewayhertz.com
leewayhertz.com · HQ: San Francisco, United States · Mobile App Development Services · AI Consulting & Integration · Custom Software Development · Est. 2007 · Hiring 2
HQ: San Francisco, United States · Mobile App Development Services · AI Consulting & Integration · Custom Software Development · Est. 2007 · Hiring 2
LeewayHertz is a software development firm that builds custom applications in artificial intelligence, blockchain and mobile for enterprise clients. It works as an outsourced engineering partner from discovery through deployment and support. The company has delivered projects for large corporates and startups across many industries.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 3 months ago Long shot · 15%

Technical Architect- Remote, India

≈ $138k – $269k per year (Estimated) · Staff+ · 10+ years exp · Remote (India) · Bachelor's Degree · Full-Time · Architect
Python
Databases
Weaviate
pgvector
Pinecone
FAISS
Qdrant
PostgreSQL
AI/ML
LangGraph
LlamaIndex
LoRA
Fine-tuning
Function Calling
DeepEval
LangSmith
PEFT
QLoRA
CrewAI
Hallucination
Hybrid Search
LLMOps
Structured Outputs
Context Engineering
LLM Guardrails
Agentic Workflows
LangChain
RAG
LLM
Machine Learning
AI Agents
vLLM
dbt
Quantization
Multimodal AI
TensorRT
TensorRT-LLM
Transformers
Triton
GraphRAG
EU AI Act
NIST AI RMF
Multi-Agent Systems
Spark
DevOps
GCP
Azure
CI/CD
AWS
+38
Apply

Together AI

together.ai
together.ai · HQ: San Francisco, United States · Foundation Models · Cloud Platforms (IaaS & PaaS) · AI Compute & Inference · 501-1000 employees · Est. 2022 · Startup · Trust A · Hiring 87, 5 new
HQ: San Francisco, United States · Foundation Models · Cloud Platforms (IaaS & PaaS) · AI Compute & Inference · 501-1000 employees · Est. 2022 · Startup · Trust A · Hiring 87, 5 new
Together AI (Together Computer, Inc.) is a full-stack AI infrastructure and cloud platform headquartered in San Francisco, California. Founded in 2022 by prominent AI researchers and system engineers - including CEO Vipul Ved Prakash, CTO Ce Zhang, Chief Scientist Tri Dao (co-creator of FlashAttention), Chris Ré, and Percy Liang - the company operates as an "AI Native Cloud" designed to train, fine-tune, and deploy open-source generative AI models at scale with high performance and optimized unit economics.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 3 months ago Fading · 31%

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking

≈ $74k – $186k per year (Estimated) · Senior · 5+ years exp · Singapore · Remote (Singapore) · Senior
Python
AI/ML
LoRA
vLLM
ElevenLabs
Fine-tuning
RLHF
Reinforcement Learning
Quantization
SGLang
TensorRT-LLM
Together AI
DPO
SFT
GRPO
Post-training
Pre-training
Speculative Decoding
KV Cache
Cursor
LLM
TensorRT
PEFT
+14
Apply
Open 178 daysTop 25% pay Visa sponsor 6 months ago Long shot · 19%

Forward Deployed Engineer, Strategic Inference

$270k – $300k per year · Senior · 5+ years exp · San Francisco · Remote (United States) · Full-Time · Senior
Python
AI/ML
vLLM
ElevenLabs
Fine-tuning
Reinforcement Learning
Quantization
SGLang
TensorRT-LLM
Together AI
Pre-training
Speculative Decoding
KV Cache
Cursor
LLM
TensorRT
+7
Apply

Boundless

boundless.network
boundless.network · AI Agents · AI Compute & Inference · Hiring 4
AI Agents · AI Compute & Inference · Hiring 4
Boundless is the inference partner that helps AI-native companies scale their AI usage, lower costs, and keep quality high.
No named decision-maker yet.
No careers mailbox known
Open 91 daysTop 25% pay 3 months ago Long shot · 12%

Applied AI/ML Engineer

$175k – $250k per year · Remote (United States) · Full-Time
Python
AI/ML
vLLM
Reinforcement Learning
Quantization
SGLang
TensorRT-LLM
CUDA
DPO
SFT
PPO
GRPO
Post-training
Megatron-LM
LLM Evaluation
Speculative Decoding
KV Cache
PyTorch
LLM
TensorRT
SkyPilot
Ray
FSDP
DevOps
SLURM
GitHub
Kubernetes
+17
Apply

Fuse Energy

fuseenergy.com
fuseenergy.com · HQ: London, United Kingdom · Ride Hailing · Energy & Utilities · Wind Energy · Solar Energy · 501-1000 employees · Est. 2022 · Startup · Trust A · Hiring 67, 5 new
HQ: London, United Kingdom · Ride Hailing · Energy & Utilities · Wind Energy · Solar Energy · 501-1000 employees · Est. 2022 · Startup · Trust A · Hiring 67, 5 new
Fuse Energy is a British household energy supplier headquartered in London, founded by former Revolut executives. It was the first new domestic energy supplier in Great Britain since the 2021 energy crisis and operates its own renewable generation assets.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 4 months ago Fading · 26%

AI Inference Engineer

≈ $74k – $196k per year (Estimated) · London · Remote (United States, United Kingdom) · Full-Time
vLLM
Triton Inference Server
Knowledge Distillation
SGLang
TensorRT-LLM
CUDA
Triton
Speculative Decoding
KV Cache
Model Distillation
TensorRT
DevOps
SLURM
Kubernetes
+5
Apply

Prime Intellect

primeintellect.com
primeintellect.com · HQ: San Francisco, United States · Foundation Models · AI Development Tools · Reinforcement Learning · AI Compute & Inference · 201-500 employees · Est. 2023 · Likely startup · Trust A · Hiring 38, 3 new
HQ: San Francisco, United States · Foundation Models · AI Development Tools · Reinforcement Learning · AI Compute & Inference · 201-500 employees · Est. 2023 · Likely startup · Trust A · Hiring 38, 3 new
Prime Intellect is an artificial intelligence infrastructure company headquartered in San Francisco, California, and founded in 2023. The company provides a decentralized platform for training, evaluating, and deploying large-scale AI models, featuring tools for reinforcement learning, agent development, and a global compute marketplace. It operates globally by aggregating computing resources from various providers to enable researchers and developers to build open-source models and autonomous agents.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 1 hour ago Visa sponsorship 4 months ago Fading · 40%

Member of Technical Staff - Training Platform

$150k – $300k per year · Staff+ · San Francisco · Remote (United States) · Relocation · Full-Time · Staff
TypeScript
Python
JavaScript
Python
SQLAlchemy
FastAPI
Databases
Databricks
AI/ML
LoRA
vLLM
Fine-tuning
RLHF
Function Calling
SGLang
QLoRA
TensorRT-LLM
Perplexity
OpenRouter
Together AI
SFT
Post-training
NCCL
NVLink
RLAIF
LangChain
OpenAI
TensorRT
PEFT
Frontend
Tailwind CSS
Next.js
tRPC
shadcn/ui
React.js
Radix UI
DevOps
Helm
Loki
OpenTelemetry
Datadog
KEDA
GitOps
Cloudflare
kubectl
Google GKE
Google Cloud Run
Prometheus
Grafana
Ansible
Terraform
Rest API
Linux
GCP
Kubernetes
Management
Zapier
+43
Apply

Cerence

cerence.com
cerence.com · HQ: Burlington, United States · Automotive Software · Conversational AI · Speech & Audio AI · 1001-5000 employees · Est. 2019 · NASDAQ: CRNC · Trust C · Hiring 28, 1 new
HQ: Burlington, United States · Automotive Software · Conversational AI · Speech & Audio AI · 1001-5000 employees · Est. 2019 · NASDAQ: CRNC · Trust C · Hiring 28, 1 new
Founded in 2019, Cerence is a global technology company specializing in artificial intelligence and conversational software for the automotive industry. Headquartered in Burlington, Massachusetts, the firm develops voice recognition, natural language understanding, and smart assistant solutions for leading vehicle manufacturers. By integrating intuitive voice controls and connected AI systems into modern automobiles, the organization enhances the overall in-cabin user experience for drivers worldwide.
No named decision-maker yet.
No careers mailbox known
Likely inactiveTop 25% pay 5 months ago Long shot · 8%

Sr. Principal Software Engineer

$185k – $280k per year · Equity · Lead · United States · Remote (United States) · Full-Time · Principal
llama.cpp
vLLM
Quantization
AWQ
GPTQ
TensorRT-LLM
CUDA
Speculative Decoding
KV Cache
LLM
TensorRT
+3
Apply

Yotta Labs

yottalabs.com
yottalabs.com · HQ: Singapore · Cloud Platforms (IaaS & PaaS) · AI Compute & Inference · Trust B · Hiring 4
HQ: Singapore · Cloud Platforms (IaaS & PaaS) · AI Compute & Inference · Trust B · Hiring 4
Yotta Labs is an AI infrastructure company that provides GPU cloud compute and APIs for running AI models. Its platform pools GPU capacity for training and inference workloads, and the company carries out research on AI systems. It hires sales, platform engineering and research staff in Singapore and Hong Kong.
No named decision-maker yet.
Careers mailbox is known
Open 126 daysVerified live · 3 hours ago 5 months ago Long shot · 8%

Research Engineer - AI Systems

≈ $137k – $304k per year (Estimated) · Hong Kong · Singapore · Remote (likely United States, Canada, Hong Kong, Singapore) · Full-Time
C++
Python
AI/ML
vLLM
Quantization
SGLang
TensorRT-LLM
Mixture of Experts
CUDA
Triton
ROCm
AWS Trainium
XLA
PyTorch
LLM
RLHF
TensorRT
DevOps
AWS
+9
Apply

NTT

global.ntt
global.ntt · HQ: Tokyo, Japan · Systems Integrators · IT Consulting & Digital Transformation · Data Centers & Colocation · Mobile Networks · 5000+ employees · Est. 1952 · Trust B · Hiring 637, 61 new
HQ: Tokyo, Japan · Systems Integrators · IT Consulting & Digital Transformation · Data Centers & Colocation · Mobile Networks · 5000+ employees · Est. 1952 · Trust B · Hiring 637, 61 new
NTT is a Japanese telecommunications and technology group whose predecessor was established in 1952 as the state telephone monopoly and privatised in 1985. It is one of the largest telecoms operators in the world, running Japan's fixed and mobile networks through NTT Docomo, a global IT services business through NTT Data, and one of the biggest data centre portfolios on the planet. The group invests heavily in long-horizon research, most visibly the IOWN initiative to rebuild networks and computing around photonics rather than electronics, and it develops the lightweight tsuzumi family of Japanese language models.
Jun Sawada · Chairman · decision-maker
Akira Shimada · President & Chief Executive Officer · decision-maker
Careers mailbox is known
Open 166 daysVerified live · 2 hours ago 6 months ago Long shot · 4%

Senior Principal AI Infrastructure Architect

≈ $73k – $157k per year (Estimated) · Lead · Segrate · Luxembourg City · Remote (Italy) · Bachelor's Degree · Full-Time · Architect
vLLM
Triton Inference Server
Fine-tuning
TensorRT-LLM
Kubeflow
CUDA
Triton
Pre-training
NCCL
InfiniBand
NVLink
ROCm
cuDNN
RAG
TensorRT
DevOps
SLURM
Amazon S3
Kubernetes
OpenShift
Management
Agile
+12
Apply

Zencore

zencore.dev
zencore.dev · HQ: San Francisco, United States · Cloud Consulting & Migration · 51-200 employees · Est. 2013 · Trust C · Hiring 18
HQ: San Francisco, United States · Cloud Consulting & Migration · 51-200 employees · Est. 2013 · Trust C · Hiring 18
Zencore is a cloud consulting firm focused on Google Cloud that helps companies plan and carry out cloud migrations, data platform builds, infrastructure modernization and managed operations. Its engineers and architects work with clients in the United States, the United Kingdom and Latin America. The company is headquartered in San Francisco, California, United States.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveVerified live · 28 min ago 7 months ago Long shot · 8%

Principal Architect, AI/ML

≈ $156k – $293k per year (Estimated) · Lead · Remote (United States) · Master's Degree · Full-Time · Architect
LangGraph
LoRA
vLLM
Vertex AI
Fine-tuning
Quantization
JAX
Langfuse
LangSmith
TensorRT-LLM
Llama
Mistral
Gemini
Google ADK
TPU
LLM Guardrails
XLA
Agentic Workflows
Vertex AI Agent Builder
LangChain
PyTorch
Claude
LLM
Machine Learning
AI Agents
TensorRT
PEFT
DevOps
Google GKE
GCP
Azure
AWS
Kubernetes
Cybersecurity
GDPR
+25
Apply

MLabs

mlabs.city
mlabs.city · HQ: London, United Kingdom · Smart Contracts & Security · Blockchain Infrastructure · 51-200 employees · IT services · Trust A · Hiring 31
HQ: London, United Kingdom · Smart Contracts & Security · Blockchain Infrastructure · 51-200 employees · IT services · Trust A · Hiring 31
MLabs is a software engineering firm specialising in functional programming and formal methods, working largely on blockchain protocols, smart contracts and high-assurance systems. Its engineers work predominantly in Haskell and related languages, which is unusual commercially and gives it a niche in projects where correctness has to be demonstrated rather than tested, particularly in the Cardano ecosystem. Registered in London and operating as a distributed organisation, it takes on protocol development, audit and formal verification work for clients whose systems hold value that a defect would put directly at risk.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 7 months ago Long shot · 16%

Staff Software Engineer - Backend & AI Infra

≈ $182k – $310k per year (Estimated) · Equity · Staff+ · Remote (United States, GMT hours) · Staff
Go
Node JS
TypeScript
Python
JavaScript
Databases
ClickHouse
TimescaleDB
Google BigQuery
Redis
PostgreSQL
AI/ML
Anthropic
Model Context Protocol
LLM
vLLM
TensorRT
TensorRT-LLM
TGI
AI Agents
DevOps
WebSockets
Amazon EKS
Kubernetes
CI/CD
AWS
+15
Apply

Inferact

inferact.ai
inferact.ai · HQ: San Francisco, United States · AI Development Tools · AI Compute & Inference · 51-200 employees · Startup · Trust A · Hiring 32
HQ: San Francisco, United States · AI Development Tools · AI Compute & Inference · 51-200 employees · Startup · Trust A · Hiring 32
Inferact is a startup founded by creators and core maintainers of vLLM, the most popular open-source LLM inference engine. Our mission is to grow vLLM as the world.
No named decision-maker yet.
Careers mailbox is known
Open 283 daysVerified live · 4 hours ago Visa sponsorship 10 months ago Long shot · 6%

Member of Technical Staff, Exceptional Generalist (Remote)

≈ $247k – $466k per year (Estimated) · Staff+ · Remote (United States, PT hours) · Full-Time · Staff
Rust
C++
Python
AI/ML
vLLM
Diffusion Models
SGLang
TensorRT-LLM
Transformers
CUDA
KV Cache
LLM
Quantization
TensorRT
Triton
TPU
PyTorch
DevOps
Kubernetes
+9
Apply
Machines can read this selection · checked 05:35 UTC
Remote TensorRT-LLM Jobs
Frequently asked questions
How many Remote TensorRT-LLM jobs are available on Alion?
There are currently 17 active listings from 16 hiring companies on Alion, refreshed daily.
What salary do Remote TensorRT-LLM jobs pay?
The average salary is around $200,000 per year based on the current listings.
Do Remote TensorRT-LLM jobs offer relocation or visa sponsorship?
Many listings also offer relocation packages or visa sponsorship - use the filters to narrow the list down to what you need.
How do I apply for Remote TensorRT-LLM jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.