Remote TensorRT-LLM Jobs

Remote TensorRT-LLM jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $200,000/year. Work from anywhere: fully remote positions with clear salary, time-zone and visa details. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Executive
Networking
Product
Design
Analytics
Support
Enterprise Apps
Quantum

Cast AI

cast.ai
CAST AI is an AI-driven cloud automation and Kubernetes cost optimization platform built to help enterprises manage, scale, and secure their cloud infrastructure. Founded in 2019 and headquartered in Miami, Florida, the company automates cloud operations across major hyper-scalers including Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure.
cast.ai • HQ: Miami, United States • Information Technology • Virtualization • DevOps
HQ: Miami, United States • Information Technology • Virtualization • DevOps
Open 382 daysVerified live · 2 hours ago 1 year ago

Senior ML Engineer | Kimchi (LLM Inference Optimization)

Equity • Senior • Remote (EU) • Visa sponsorship • Internship • Senior
Python
Databases
ClickHouse
PostgreSQL
AI/ML
CUDA
CUDA Toolkit
LLM
Perplexity
PyTorch
Quantization
SGLang
TensorRT
TensorRT-LLM
TPOT
vLLM
Hugging Face
DevOps
Akamai
ArgoCD
AWS
Azure
GCP
GitLab CI
Grafana
Kubernetes
Loki
Prometheus
GitLab
Apply
Report

Together AI

together.ai
Together AI (Together Computer, Inc.) is a full-stack AI infrastructure and cloud platform headquartered in San Francisco, California. Founded in 2022 by prominent AI researchers and system engineers - including CEO Vipul Ved Prakash, CTO Ce Zhang, Chief Scientist Tri Dao (co-creator of FlashAttention), Chris Ré, and Percy Liang - the company operates as an "AI Native Cloud" designed to train, fine-tune, and deploy open-source generative AI models at scale with high performance and optimized unit economics.
together.ai • HQ: San Francisco, United States • Hardware • Events & Ticketing • Corporate Events • AI Infrastructure • Artificial Intelligence • 501-1000 employees • Est. 2022
HQ: San Francisco, United States • Hardware • Events & Ticketing • Corporate Events • AI Infrastructure • Artificial Intelligence • 501-1000 employees • Est. 2022
$100k – $283k per year (Estimated) • Senior • 5+ years expSingapore • Remote (Singapore) • Full-Time • Senior
Python
AI/ML
Fine-tuning
LLM
LoRA
Quantization
RLHF
SGLang
TensorRT
TensorRT-LLM
Together AI
vLLM
PEFT
DPO
GRPO
Post-training
SFT
Apply
Report

Bjak

bjak.my
Bjak is a Malaysia-based insurtech company founded in 2019. It operates Southeast Asia's largest online insurance platform, letting users compare, buy, and renew insurance policies digitally. The company is headquartered in Petaling Jaya and focuses on making insurance more accessible and convenient.
bjak.my • HQ: Petaling Jaya, Malaysia • Financial Services • FinTech • Insurance • Est. 2019
HQ: Petaling Jaya, Malaysia • Financial Services • FinTech • Insurance • Est. 2019
Verified live · 7 hours ago 21 day ago

Machine Learning Platform Engineer

$116k – $194k per year (Estimated)Zurich • Remote (Switzerland) • Full-Time
Python
AI/ML
JAX
LLM
PyTorch
SGLang
TensorRT
TensorRT-LLM
vLLM
DevOps
Vector
Apply
Report

SambaNova Systems

sambanova.ai
SambaNova Systems is an American artificial intelligence semiconductor and cloud platform company headquartered in Palo Alto, California. Founded in 2017 by Stanford professors Kunle Olukotun and Christopher Ré alongside former Oracle executive Rodrigo Liang, the company builds full-stack hardware and software infrastructure purpose-built for enterprise AI, large-scale model training, and high-speed agentic AI inference.
sambanova.ai • HQ: Palo Alto, United States • Artificial Intelligence • Semiconductors • AI Infrastructure
HQ: Palo Alto, United States • Artificial Intelligence • Semiconductors • AI Infrastructure
Verified live · 3 hours ago 2 months ago

Senior Software Engineer - ML Infrastructure

$144k – $258k per year (Estimated) • Senior • 5+ years exp • Remote (United States) • Bachelor's Degree • Full-Time • Senior
Python
AI/ML
LLM
SGLang
TensorRT
TensorRT-LLM
vLLM
Function Calling
Apply
Report

Rackspace Technology

rackspace.com
Rackspace Technology is a major global multi-cloud solutions, managed infrastructure, and enterprise AI engineering provider headquartered in San Antonio, Texas, USA. Founded in 1998 by Richard Yoo, Pat Condon, and Dirk Elmendorf, the company operates on a B2B managed cloud services, private/public cloud migration, enterprise software integration, and managed infrastructure subscription model led by CEO Amar Maletira.
rackspace.com • HQ: San Antonio, United States • Cybersecurity • Artificial Intelligence • Information Technology • 501-1000 employees • Est. 1998
HQ: San Antonio, United States • Cybersecurity • Artificial Intelligence • Information Technology • 501-1000 employees • Est. 1998
Verified live · 1 day ago 29 days ago

Software Developer IV (Golang & Kubernetes)

$18k – $44k per year (Estimated) • Senior • 9+ years expIndia • Remote (India) • Full-Time • Senior
Go
AI/ML
Claude
Claude Code
Copilot
DeepSeek
Embeddings
Fine-tuning
Gemma
Llama
LLM
LoRA
Mistral
PEFT
Prompt Engineering
Qwen
RAG
Semantic Search
TensorRT
TensorRT-LLM
Triton
Triton Inference Server
vLLM
Transformers
AI Agents
Human-in-the-Loop
LLM Guardrails
OpenAI Codex
Semantic Search
SFT
DevOps
CI/CD
Docker
Git
Kubernetes
Platform Engineering
Vector
GitHub
AWS
Azure
GCP
Grafana
OpenTelemetry
Prometheus
Service Mesh
Apply
Report

d-Matrix

d-matrix.ai
d-Matrix is a semiconductor technology company based in Santa Clara, California, and was founded in 2019. The company develops specialized AI inference hardware and software platforms, including its Corsair platform and 3DIMC architecture, designed to accelerate generative AI workloads in data centers. It operates as a venture-backed enterprise serving global hyperscalers and enterprises with a focus on reducing latency, power consumption, and total cost of ownership for large language models.
d-matrix.ai • HQ: Santa Clara, United States • Data Centers • Information Technology • LLM & Generative AI • Artificial Intelligence • AI Infrastructure • Hardware • Semiconductors • Est. 2019
HQ: Santa Clara, United States • Data Centers • Information Technology • LLM & Generative AI • Artificial Intelligence • AI Infrastructure • Hardware • Semiconductors • Est. 2019
$198k – $370k per year (Estimated) • Staff+ • 10+ years expSanta Clara • Remote (United States) • Visa sponsorship • Bachelor's Degree • Staff
C++
Python
AI/ML
CUDA Toolkit
LLM
ONNX
Quantization
SGLang
TensorRT
TensorRT-LLM
vLLM
JAX
Mixture of Experts
Apply
Report

Avomind

avomind.com
Avomind is a platform connecting graduates and senior alumni from leading academic institutions with fast-growing firms. Our mission is to connect high-caliber candidates with impactful opportunities.... Our global network is built up of partnersh...
avomind.com • HQ: London, United Kingdom • Professional Services • Human Resources • 501-1000 employees • Est. 2019
HQ: London, United Kingdom • Professional Services • Human Resources • 501-1000 employees • Est. 2019
Verified live · 3 hours ago 1 month ago

Principal Machine Learning Engineer

$119k – $284k per year (Estimated) • Lead • Singapore • Remote (Singapore) • Full-Time • Principal
DeepSpeed
Fine-tuning
JAX
Knowledge Distillation
LoRA
PyTorch
QLoRA
Quantization
Ray
PEFT
DPO
FSDP
Megatron-LM
SFT
Diffusion Models
LLM
Multimodal AI
Reinforcement Learning
RLHF
Spark
TensorRT
TensorRT-LLM
vLLM
PPO
Apply
Report

Gina's Tech Jobs

ginastechjobs.com
Gina's Tech Jobs is a technology recruitment agency headquartered in Charlotte, North Carolina, and founded in 1999. The agency places engineers into permanent roles at United States technology employers, with a heavy concentration in machine learning, artificial intelligence, and software engineering positions. It works largely on remote and hybrid searches and represents both established employers and smaller AI companies hiring technical staff.
ginastechjobs.com • HQ: Charlotte, United States • Machine Learning • Artificial Intelligence • IT Consulting • Information Technology • Professional Services • Human Resources • Est. 1999
HQ: Charlotte, United States • Machine Learning • Artificial Intelligence • IT Consulting • Information Technology • Professional Services • Human Resources • Est. 1999
$170k – $200k per year • Lead • San Francisco • Remote (United States) • Full-Time • Senior
DeepSpeed
Diffusion Models
Fine-tuning
JAX
LLM
Multimodal AI
PyTorch
Quantization
Ray
RLHF
Spark
TensorRT
TensorRT-LLM
vLLM
DPO
FSDP
Megatron-LM
PPO
Apply
Report

Yottalabs

yottalabs.com
yottalabs.com • Hong Kong • Singapore
Hong Kong • Singapore
Verified live · 8 hours ago 2 months ago

Research Engineer - AI Systems

$136k – $298k per year (Estimated)Hong KongSingapore • Remote (United States, Canada, Hong Kong, Singapore) • Full-Time
C++
Python
C++
PyTorch C++
AI/ML
CUDA Toolkit
LLM
PyTorch
Quantization
SGLang
TensorRT
TensorRT-LLM
vLLM
AWS Trainium
ROCm
Mixture of Experts
RLHF
DevOps
AWS
Apply
Report

Mirantis

mirantis.com
Mirantis is a B2B open-source cloud computing, container management, and AI infrastructure company headquartered in Campbell, California. Originally known as a core contributor to OpenStack, Mirantis now provides open-cloud software and managed services centered on Kubernetes, multi-cloud platforms, and enterprise AI workloads.
mirantis.com • Calgary • Warsaw • Brussels • Prague • Poznań • DevOps • Information Technology • Cloud Computing • 1001-5000 employees
Calgary • Warsaw • Brussels • Prague • Poznań • DevOps • Information Technology • Cloud Computing • 1001-5000 employees
Open 95 daysVerified live · 3 hours ago 3 months ago

Product Manager - AI Inference & Model Serving

$145k – $248k per year (Estimated) • Equity • Senior • 7+ years expAustin • Remote (United States) • Full-Time • Senior
LLM
SGLang
TensorRT
TensorRT-LLM
vLLM
Triton
DevOps
AWS
Kubernetes
Platform Engineering
Chips/EDA
PoC Library
Apply
Report

Fathom

fathom.ai
Fathom captures, transcribes, and summarizes Zoom, Google Meet, and Microsoft Teams calls. Free for individuals, with AI-powered CRM updates for teams.
fathom.ai • Productivity Software • LLM & Generative AI • Artificial Intelligence • Est. 2020
Productivity Software • LLM & Generative AI • Artificial Intelligence • Est. 2020
Open 117 daysVerified live · 8 hours ago 3 months ago

AI Engineer - Model Performance

$138k – $302k per year (Estimated) • Remote (United States) • Master's Degree • Full-Time
Python
AI/ML
Axolotl
CUDA Toolkit
Fine-tuning
LLM
LoRA
Multimodal AI
Prompt Engineering
QLoRA
Quantization
Ray
Ray Serve
SGLang
TensorRT
TensorRT-LLM
torchtune
vLLM
PEFT
PyTorch
CUDA
DPO
SFT
Speech Recognition
DevOps
GitHub
Management
Notion
Slack
Marketing
HubSpot
Apply
Report

Zencore

zencore.dev
Zencore is a leading cloud consulting and services firm. Above all else we value experience, hard work and the ability to keep things in perspective and have fun as we ensure our customers are delighted with the work we do.
zencore.dev • London • Mexico City • New York • Copenhagen • Berlin • Blockchain & Crypto • Data & Analytics • Information Technology • Est. 2013
London • Mexico City • New York • Copenhagen • Berlin • Blockchain & Crypto • Data & Analytics • Information Technology • Est. 2013
Open 136 days 4 months ago

Principal Architect, AI/ML

$139k – $249k per year (Estimated) • Lead • Remote (United States) • Master's Degree • Full-Time • Architect
AI Agents
Claude
Fine-tuning
Gemini
Google ADK
JAX
LangChain
Langfuse
LangGraph
LangSmith
Llama
LLM
LoRA
Mistral
PyTorch
Quantization
TensorRT
TensorRT-LLM
Vertex AI
vLLM
PEFT
LLM Guardrails
TPU
DevOps
AWS
Azure
GCP
Google GKE
Kubernetes
Cybersecurity
GDPR
Apply
Open 201 day 6 months ago

Principal Architect, AI/ML

$80k – $190k per year (Estimated) • Lead • Remote (United Kingdom) • Master's Degree • Full-Time • Architect
AI Agents
Claude
Fine-tuning
Gemini
Google ADK
JAX
LangChain
Langfuse
LangGraph
LangSmith
Llama
LLM
LoRA
Mistral
PyTorch
Quantization
TensorRT
TensorRT-LLM
Vertex AI
vLLM
PEFT
LLM Guardrails
TPU
DevOps
AWS
Azure
GCP
Google GKE
Kubernetes
Cybersecurity
GDPR
Apply
Report

MLabs

mlabs.city
MLabs is a global software engineering consultancy specializing in high-assurance software engineering, formal verification, and mission-critical systems. Founded in 2018, the company focuses on functional programming languages like Haskell and Rust to build secure, high-performance infrastructure for blockchain, Web3, fintech, and AI projects.
mlabs.city • HQ: London, United Kingdom • Information Technology • Blockchain & Crypto • Software
HQ: London, United Kingdom • Information Technology • Blockchain & Crypto • Software
Verified live · 1 day ago 5 months ago

Staff Software Engineer - Backend & AI Infra

$228k – $379k per year (Estimated) • Equity • Staff+ • Remote (United States) • Staff
Go
Node JS
Python
TypeScript
JavaScript
Databases
ClickHouse
Google BigQuery
PostgreSQL
Redis
TimescaleDB
AI/ML
LLM
Model Context Protocol
Anthropic
TensorRT
TensorRT-LLM
vLLM
AI Agents
TGI
DevOps
Amazon EKS
AWS
CI/CD
Kubernetes
WebSockets
Apply
Report

Cohere

cohere.com
Cohere is a Canadian AI company founded in 2019 and headquartered in Toronto. It builds secure, enterprise-focused large language models and AI tools for businesses and regulated industries. The company is known for emphasizing privacy, private deployment, and "sovereign AI" rather than consumer chat products
cohere.com • HQ: Toronto, Canada • Energy & Utilities • Biotechnology • Natural Language Processing • LLM & Generative AI • Artificial Intelligence • 1001-5000 employees • Est. 2019
HQ: Toronto, Canada • Energy & Utilities • Biotechnology • Natural Language Processing • LLM & Generative AI • Artificial Intelligence • 1001-5000 employees • Est. 2019
Verified live · 12 min ago 8 months ago

Senior ML Systems Engineer, Frameworks & Tooling

$98k – $200k per year (Estimated) • Senior • LondonNew YorkParisSan FranciscoToronto • Remote (United States, France, United Kingdom, Canada) • Full-Time • Senior
Cohere SDK
CUDA Toolkit
JAX
LLM
Ray
CUDA
FSDP
NCCL
DeepSpeed
PyTorch
TensorRT
TensorRT-LLM
vLLM
xFormers
Megatron-LM
DevOps
Docker
Kubernetes
SLURM
HPC
Apply
Report
Remote TensorRT-LLM Jobs
Frequently asked questions
How many Remote TensorRT-LLM jobs are available on Alion?
There are currently 17 active listings from 16 hiring companies on Alion, refreshed daily.
What salary do Remote TensorRT-LLM jobs pay?
The average salary is around $200,000 per year based on the current listings.
Do Remote TensorRT-LLM jobs offer relocation or visa sponsorship?
Many listings also offer relocation packages or visa sponsorship - use the filters to narrow the list down to what you need.
How do I apply for Remote TensorRT-LLM jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.