Updated Oct 17, 2026

Triton Inference Server Jobs - Remote & On-site

Triton Inference Server jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $251,933/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

You searched for “Triton Inference Server Jobs - Remote & On-site”, so this list shows: technical roles only · the stack names Triton Inference Server · known staffing agencies left out. Adjust the filters

Open positions
247
Companies
160
Salary range
$128K – $313K
Average salary
$222K
AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Hire Hangar

hirehangar.com
hirehangar.com • HQ: New York, United States • Recruiting & Staffing • Freelance & Talent Marketplaces • 11-50 employees • Likely startup • Trust A • Hiring 94, 4 new
HQ: New York, United States • Recruiting & Staffing • Freelance & Talent Marketplaces • 11-50 employees • Likely startup • Trust A • Hiring 94, 4 new
Hire Hangar is a global talent sourcing and remote recruitment platform designed to help fast-growing startups and enterprises hire vetted international professionals. The platform combines AI-powered candidate sourcing algorithms with expert human recruiters to screen, assess, and match top-tier global talent across roles in software engineering, growth marketing, customer support, operations, finance, and GTM sales.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 11 hours ago Hiring now · 86%

LLM Infrastructure Engineer

$30k – $48k per year • Buenos Aires • Guayaquil • Santa Cruz • Cairo • Johannesburg • Remote (United States, United Kingdom, Argentina, Colombia, Egypt, UTC-8 – UTC-5 hours) • Contractor • English
Python
AI/ML
Fine-tuning
LLM
Machine Learning
DeepSpeed
vLLM
Triton Inference Server
TensorRT
TensorRT-LLM
PyTorch
Ray
Amazon SageMaker
DevOps
CI/CD
Docker
Kubernetes
Terraform
CloudFormation
AWS
Amazon EKS
Amazon EC2
Amazon S3
Management
Slack
Google Workspace
+15
Apply

Palo Alto Networks

paloaltonetworks.com
paloaltonetworks.com • HQ: Santa Clara, United States • Endpoint Security • Threat Intelligence • Security Operations • Cloud Security • Network Security • 1001-5000 employees • Est. 2005 • Hiring 437, 134 new
HQ: Santa Clara, United States • Endpoint Security • Threat Intelligence • Security Operations • Cloud Security • Network Security • 1001-5000 employees • Est. 2005 • Hiring 437, 134 new
Palo Alto Networks is a cybersecurity company headquartered in Santa Clara, California, selling next-generation firewalls and SASE network security, the Prisma and Cortex platforms for cloud security and security operations, and Unit 42 threat intelligence and incident response services. Founded in 2005 by Nir Zuk and listed on Nasdaq, it reports more than 16,000 employees and over 70,000 customers, with major engineering centres in Israel and India and offices across the Americas, Europe and Asia. It hires software engineers, product managers and designers, solutions consultants, account managers, go-to-market strategists and legal and sourcing staff.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 1 hour ago Visa sponsor 1 day ago Hiring now · 90%

Sr Principal DevOps Engineer (Prisma AIRS)

$178k – $287k per year • Equity • Lead • 10+ years exp • In office (United States) • Bachelor's Degree • Full-Time • Confidential • Principal
Python
Go
AI/ML
Claude
TPU
Red Teaming
Seldon Core
Claude Code
Triton Inference Server
Vertex AI
AWS Bedrock
RAG
KServe
LLMOps
LLM Guardrails
DevOps
Terraform
GCP
Helm
Crossplane
GitLab CI
CI/CD
GitOps
ArgoCD
Kubernetes
Platform Engineering
Progressive Delivery
Linux
GitHub Actions
Prometheus
AWS
Grafana
IAM
+23
Apply

Ontarget Group

ontarget-group.com
ontarget-group.com • HQ: Tbilisi, Georgia • Systems Integrators • IT Consulting & Digital Transformation • Trust E • Hiring 12, 12 new
HQ: Tbilisi, Georgia • Systems Integrators • IT Consulting & Digital Transformation • Trust E • Hiring 12, 12 new
Ontarget Group is a company that provides consulting and implementation services in the field of digital transformation and information technology solutions for businesses. It supports corporate clients with services such as systems integration process optimization and technical project management.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveReposted ×6 1 day ago Fading · 30%

NVIDIA AI Enterprise Engineer / Architect / MLOps

≈ $33k – $75k per year (Estimated) • Staff+ • 8+ years exp • Almaty • Remote (EAEU) • Bachelor's Degree • Full-Time • Architect • English
Python
AI/ML
Fine-tuning
LLM
RAG
NVIDIA NIM
Triton
NVIDIA NeMo
LLM Guardrails
Triton Inference Server
TensorRT
TensorRT-LLM
TensorFlow
PyTorch
RAPIDS
DevOps
Terraform
Ansible
GCP
Helm
VMWare
Azure
AWS
Kubernetes
Linux
+15
Apply

Rockwell Automation

rockwellautomation.com
rockwellautomation.com • HQ: Milwaukee, United States • Artificial Intelligence • Manufacturing • Motors, Drives & Motion Control • Manufacturing & Industrial Software • Industrial Automation • 5000+ employees • Est. 1903 • NYSE: ROK • Trust A • Hiring 434, 69 new
HQ: Milwaukee, United States • Artificial Intelligence • Manufacturing • Motors, Drives & Motion Control • Manufacturing & Industrial Software • Industrial Automation • 5000+ employees • Est. 1903 • NYSE: ROK • Trust A • Hiring 434, 69 new
Rockwell Automation is an American industrial automation company whose origins go back to 1903, and which became a pure automation business after separating from Rockwell International in the 1990s. It supplies the programmable controllers, drives, motion control, safety systems and industrial software that run factory floors, sold under the Allen-Bradley hardware brand and the FactoryTalk software family, largely through a distributor and system integrator channel. Headquartered in Milwaukee and listed on the New York Stock Exchange, it is unusually concentrated on North American manufacturing compared with its European competitors.
Blake Moret · Chairman and Chief Executive Officer · decision-maker
Lynn Stellrecht · Founder · founder
No careers mailbox known
Verified live · 8 hours ago 1 day ago Hiring now · 90%

AI/ML Engineer

≈ $22k – $47k per year (Estimated) • Senior • 5+ years exp • Hybrid (Pune, Bengaluru, India) • Bachelor's Degree • Full-Time • Senior
Python
SQL
Python
Flask
FastAPI
Dask
Databases
Snowflake
Weaviate
Chroma
Milvus
Pinecone
FAISS
Apache Kafka
Google BigQuery
Amazon Redshift
BigQuery
AI/ML
LangChain
Claude
Spark
LlamaIndex
LoRA
Dagster
MLFlow
SHAP
XGBoost
Triton Inference Server
Vertex AI
Fine-tuning
Embeddings
Quantization
Scikit-learn
Prompt Engineering
Knowledge Distillation
Function Calling
AI Agents
LightGBM
PEFT
Llama
Mistral
LIME
Kubeflow
Flink
Evidently AI
Transformers
TensorFlow
Pandas
PyTorch
Gemini
LLM
RAG
Ray
Semantic Search
OpenAI
Anthropic
Hugging Face
Amazon SageMaker
TorchServe
Semantic Search
LLM Guardrails
Interpretability
Agentic Workflows
Multi-Agent Systems
Tool Use
Model Distillation
Machine Learning
DevOps
Terraform
GCP
Prometheus
Azure
CI/CD
Git
AWS
Docker
Kubernetes
Grafana
Platform Engineering
Analytics
A/B Testing
Management
Agile
+69
Apply

Doctolib

doctolib.fr
doctolib.fr • HQ: Levallois-Perret, France • Practice Management Software • Patient Access & Booking • 1001-5000 employees • Est. 2013 • Trust B • Hiring 133, 14 new
HQ: Levallois-Perret, France • Practice Management Software • Patient Access & Booking • 1001-5000 employees • Est. 2013 • Trust B • Hiring 133, 14 new
Doctolib is a health technology company founded in 2013 that runs the leading medical appointment booking platform in France and Germany. Its software also covers practice management, teleconsultation and secure patient records for hospitals and independent practitioners. It became one of the first French unicorns and employs more than two thousand five hundred people.
Stanislas Niox-Chateau · Président de SAS · decision-maker
No careers mailbox known
Verified live · 1 hour ago 1 day ago Likely open · 63%

Senior IA Inference Engineer (x/f/m)

≈ $62k – $120k per year (Estimated) • Senior • 5+ years exp • Hybrid (Paris, France) • Relocation • PhD • Full-Time • Senior • English: C1
Python
JavaScript
Java
Rust
Kotlin
TypeScript
C++
Databases
Google BigQuery
BigQuery
AI/ML
Ray Serve
Qwen
LoRA
vLLM
CUDA Toolkit
MLFlow
Triton Inference Server
Gemma
Quantization
Multimodal AI
SGLang
LiteLLM
TensorRT-LLM
TGI
Llama
Mistral
LLM
Ray
Mixture of Experts
Braintrust
KServe
CUDA
Triton
Anyscale
KV Cache
Machine Learning
TensorRT
PEFT
Frontend
React.js
Mobile
React Native
DevOps
Terraform
GCP
Helm
Datadog
Kustomize
AWS
Docker
Kubernetes
Amazon S3
Azure
Google GKE
Cybersecurity
ISO 27001
SOC 2
GDPR
+45
Apply

Bright Vision Technologies

brightvisiontechnologies.com
brightvisiontechnologies.com • HQ: Bridgewater Township, United States • IT Consulting & Digital Transformation • IT Staffing & Staff Augmentation • 1001-5000 employees • Est. 2020 • Staffing · EOR • Hiring 509, 467 new
HQ: Bridgewater Township, United States • IT Consulting & Digital Transformation • IT Staffing & Staff Augmentation • 1001-5000 employees • Est. 2020 • Staffing · EOR • Hiring 509, 467 new
Bright Vision Technologies is an IT consulting, enterprise technology services, and workforce solutions enterprise. Headquartered in Bridgewater, New Jersey, United States, the minority-owned firm specializes in technology staffing, cybersecurity, application management, and digital product engineering. Founded in 2020, the enterprise delivers specialized staffing and IT services alongside proprietary automation and AI software - including its flagship enterprise talent intelligence platform, Lumina - serving clients across information technology, defense, healthcare, government, and manufacturing sectors.
No named decision-maker yet.
No careers mailbox known
Verified live · 5 hours ago 1 day ago Hiring now · 90%

AI Platform Engineer - Bright Vision Technologies

$100k – $150k per year • Staff+ • 10+ years exp • Remote (United States) • Bachelor's Degree • Staff
Python
Rust
C++
AI/ML
vLLM
TensorRT-LLM
LLM
Ray Serve
CUDA Toolkit
Triton Inference Server
Quantization
TensorRT
Ray
CUDA
Speculative Decoding
KV Cache
Machine Learning
DevOps
Kubernetes
Platform Engineering
Terraform
GCP
Istio
CloudFormation
Linkerd
Azure
CI/CD
GitOps
AWS
Docker
Service Mesh
Bicep
FinOps
+23
Apply
Verified live · 5 hours ago 12 days ago Fading · 28%

AI Systems Performance Specialist - Bright Vision Technologies

$130k – $180k per year • Staff+ • 10+ years exp • Remote (United States) • Bachelor's Degree • Staff
Python
C++
C++
PyTorch C++
AI/ML
DeepSpeed
CUDA Toolkit
Quantization
PyTorch
LLM
TensorBoard
Ray
CUDA
NCCL
Speculative Decoding
Machine Learning
vLLM
Triton Inference Server
TensorRT
TensorRT-LLM
ROCm
CUTLASS
KV Cache
DevOps
GCP
Azure
AWS
FinOps
HPC
+18
Apply

IQ-EQ

iqeq.com
iqeq.com • HQ: Luxembourg City, Luxembourg • Custody & Fund Administration • 5000+ employees • Hiring 75, 28 new
HQ: Luxembourg City, Luxembourg • Custody & Fund Administration • 5000+ employees • Hiring 75, 28 new
IQ-EQ is a global investor services group headquartered in Luxembourg that provides fund administration, corporate governance, asset servicing, and regulatory compliance solutions. Operating across dozens of jurisdictions worldwide, the firm works closely with alternative asset managers, multinational corporations, family offices, and private wealth clients. It combines technical expertise with proprietary technology platforms to help institutions manage complex fund structures, cross-border investments, and global reporting requirements.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 1 day ago Hiring now · 90%

Senior DevOps Engineer (On-prem)

≈ $16k – $33k per year (Estimated) • Senior • Hybrid (Hyderabad, India) • Full-Time • Middle • English
vLLM
CUDA Toolkit
Triton Inference Server
TensorRT
CUDA
DevOps
CI/CD
Configuration Management
Git
Kubernetes
Linux
+2
Apply

Lenovo

lenovo.com
lenovo.com • HQ: Beijing, China • Smartphones • Servers & Data Center Hardware • Laptops • 1001-5000 employees • Est. 1984 • Trust A • Hiring 412, 87 new
HQ: Beijing, China • Smartphones • Servers & Data Center Hardware • Laptops • 1001-5000 employees • Est. 1984 • Trust A • Hiring 412, 87 new
Lenovo Group Limited is a global technology enterprise specializing in personal computing, smart devices, data center infrastructure, and enterprise IT services. Headquartered in Beijing, China, and Morrisville, North Carolina, United States - with its registered office in Hong Kong - the publicly traded corporation operates across three primary business divisions: the Intelligent Devices Group (IDG), the Infrastructure Solutions Group (ISG), and the Solutions and Services Group (SSG). Through an extensive product and services portfolio encompassing ThinkPad and IdeaPad personal computers, Motorola smartphones, ThinkSystem enterprise servers, edge computing hardware, and hybrid cloud solutions, the enterprise provides hardware, software, and managed IT services to commercial clients, public institutions, and retail consumers across more than 180 markets worldwide.
No named decision-maker yet.
No careers mailbox known
Verified live · 17 min ago 1 day ago Hiring now · 88%

Backend Engineer - AI Platform and Cloud Native Services

≈ $130k – $226k per year (Estimated) • Senior • 5+ years exp • Morrisville • Remote (United States) • Bachelor's Degree • Senior
Java
Databases
PostgreSQL
Redis
RabbitMQ
Apache Kafka
AI/ML
Triton Inference Server
LLM
DevOps
Rest API
gRPC
CI/CD
Docker
Kubernetes
+4
Apply
Verified live · 17 min ago 4 days ago Hiring now · 73%

Senior Software Engineer

≈ $34k – $72k per year (Estimated) • Senior • In office (Bucharest, Romania) • Bachelor's Degree • Senior
Java
Java
Spring Boot
Spring Cloud
Databases
Redis
RabbitMQ
PostgreSQL
Apache Kafka
AI/ML
Triton Inference Server
Computer Vision
LLM
DevOps
Rest API
CI/CD
Docker
Kubernetes
IoT
MQTT
+7
Apply
Verified live · 17 min ago 14 days ago Long shot · 21%

Senior Backend Developer

≈ $34k – $72k per year (Estimated) • Senior • In office (Bucharest, Romania) • Bachelor's Degree • Senior
Java
Java
Spring Boot
Spring Cloud
Databases
Redis
RabbitMQ
PostgreSQL
Apache Kafka
AI/ML
Triton Inference Server
Computer Vision
LLM
DevOps
Rest API
CI/CD
Docker
Kubernetes
IoT
MQTT
+7
Apply

Matroid

matroid.com
matroid.com • HQ: Palo Alto, United States • Machine Learning • Industrial AI • Computer Vision • 51-200 employees • Est. 2016 • Startup • Trust B • Hiring 12, 1 new
HQ: Palo Alto, United States • Machine Learning • Industrial AI • Computer Vision • 51-200 employees • Est. 2016 • Startup • Trust B • Hiring 12, 1 new
Matroid is a computer vision software company whose platform lets users build detectors that identify objects, actions, defects and events in images and video. It sells to manufacturers for visual inspection and to security and government customers, and supports vision language and vision foundation models. The company was founded in 2016. The company is headquartered in Palo Alto, California, United States.
No named decision-maker yet.
No careers mailbox known
Verified live · 16 min ago Visa sponsor 1 day ago Likely open · 60%

Deep Learning Engineer, Multimodal Vision Platform

≈ $159k – $299k per year (Estimated) • Middle • 3+ years exp • In office (Palo Alto, United States) • Bachelor's Degree • Full-Time • Middle
Python
AI/ML
Multimodal AI
Computer Vision
PyTorch
Ray
Anomaly Detection
Triton Inference Server
ONNX
TensorRT
Gaussian Splatting
World Models
Robotics
COLMAP
+4
Apply

Penguin Solutions

penguinsolutions.com
penguinsolutions.com • HQ: Milpitas, United States • LLM & Generative AI • Education • Artificial Intelligence • High-Performance Computing • AI Compute & Inference • Servers & Data Center Hardware • 201-500 employees • Est. 1998 • NASDAQ: PENG • Hiring 63, 8 new
HQ: Milpitas, United States • LLM & Generative AI • Education • Artificial Intelligence • High-Performance Computing • AI Compute & Inference • Servers & Data Center Hardware • 201-500 employees • Est. 1998 • NASDAQ: PENG • Hiring 63, 8 new
Penguin Solutions designs and operates artificial intelligence computing clusters. Its services cover system design, memory products and managed infrastructure. The company builds large training environments for enterprises.
No named decision-maker yet.
Careers mailbox is known
Top 25% payVerified live · 4 hours ago Visa sponsor 2 days ago Hiring now · 90%

Senior AI Engineer

$175k – $215k per year • Senior • 7+ years exp • United States • Remote (United States) • Senior
Python
AI/ML
Ray Serve
vLLM
Triton Inference Server
Fine-tuning
Prompt Engineering
Function Calling
AI Agents
TGI
LLM
RAG
Amazon SageMaker
LLMOps
NVIDIA NeMo
LLM Guardrails
Agentic Workflows
Tool Use
LangGraph
LangChain
LlamaIndex
MLFlow
Kubeflow
PyTorch
Ray
Hugging Face
DevOps
GCP
Azure
AWS
Docker
Kubernetes
HPC
Linux
Terraform
Ansible
OpenTelemetry
Prometheus
Grafana
Cybersecurity
OWASP Top 10
+30
Apply
Verified live · 4 hours ago 1 month ago Fading · 30%

Sr. Software Engineer - AI Platform

≈ $19k – $44k per year (Estimated) • Senior • 7+ years exp • In office (Bengaluru, India) • Bachelor's Degree • Senior
Python
AI/ML
vLLM
Triton Inference Server
AI Agents
LLM
RAG
MLFlow
Vertex AI
LangSmith
AWS Bedrock
DevOps
Rest API
CI/CD
Docker
Kubernetes
Platform Engineering
HPC
OpenTelemetry
Azure
AWS
+11
Apply
Verified live · 4 hours ago Visa sponsor 1 month ago Fading · 39%

AI Solution Architect

$130k – $175k per year • Staff+ • 7+ years exp • United States • Remote (United States) • Master's Degree • Architect
Databricks
AI/ML
AI Agents
RAG
Triton Inference Server
Vertex AI
TensorRT
TensorRT-LLM
AWS Bedrock
LLM
Hugging Face
Amazon SageMaker
NVIDIA NeMo
DevOps
HPC
Azure
CI/CD
AWS
Kubernetes
+9
Apply
cmcts.com.vn • HQ: Hanoi, Vietnam • IT Consulting & Digital Transformation • Cloud Consulting & Migration • Enterprise Apps Implementation Partners • Systems Integrators • Est. 2019 • Trust A • Hiring 32, 4 new
HQ: Hanoi, Vietnam • IT Consulting & Digital Transformation • Cloud Consulting & Migration • Enterprise Apps Implementation Partners • Systems Integrators • Est. 2019 • Trust A • Hiring 32, 4 new
Founded in 2019, CMC TS (CMC Technology & Solution) is a leading technology consultancy and digital transformation provider in Vietnam. Headquartered in Hanoi, Vietnam, the enterprise serves corporate clients, financial institutions, and government agencies across the region. Through its integrated cloud computing platforms, cybersecurity solutions, system integration capabilities, and enterprise software development, it enables organizations to modernize IT infrastructure and accelerate digital operations.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 2 days ago Hiring now · 90%

[HN] Middle AI Engineer

Middle • In office (Hanoi, Vietnam) • Full-Time • Middle
Python
C++
C++
TensorFlow C++
PyTorch C++
AI/ML
CUDA Toolkit
Triton Inference Server
Knowledge Distillation
ONNX
TensorRT
TFLite
OpenVINO
TensorFlow
PyTorch
KServe
CUDA
Edge AI
LiteRT
Model Distillation
Machine Learning
DevOps
Helm
CI/CD
Docker
Kubernetes
Linux
Robotics
GStreamer
+17
Apply

Anduril Industries

anduril.com
anduril.com • HQ: Costa Mesa, United States • Defense Manufacturing • C4ISR • Military Drones • Defense AI • 5000+ employees • Est. 2017 • Trust B • Hiring 2067, 115 new
HQ: Costa Mesa, United States • Defense Manufacturing • C4ISR • Military Drones • Defense AI • 5000+ employees • Est. 2017 • Trust B • Hiring 2067, 115 new
Anduril Industries is an American defence technology company founded in 2017 that builds autonomous systems and command software for military and border security customers. Rather than bidding on cost-plus programmes, it develops products with its own capital and sells them as finished systems, from surveillance towers and counter-drone interceptors to underwater vehicles and collaborative combat aircraft. Its Lattice software platform fuses sensor data into a single operating picture and controls the hardware family, and the company is headquartered in Costa Mesa, California with a large manufacturing site in Ohio.
Matt Grimm · Co-Founder & Chief Operating Officer · decision-maker
Trae Stephens · Co-Founder & Executive Chairman · decision-maker
Brian Schimpf · Co-Founder & Chief Executive Officer · decision-maker
Palmer Luckey · Founder · decision-maker
Careers mailbox is known
Top 25% payVerified live · 16 min ago 2 days ago Likely open · 63%

Senior Machine Learning Engineer (Applied Intelligence)

$220k – $292k per year • Equity • Senior • 6+ years exp • In office (Santa Ana, United States) • Bachelor's Degree • Secret • Senior
Python
Databases
Weaviate
Milvus
Pinecone
AI/ML
Computer Vision
TensorFlow
PyTorch
Time Series Forecasting
Feature Store
Machine Learning
MLFlow
Triton Inference Server
Quantization
TensorRT
Kubeflow
LLM
RAG
Feast
Flyte
OCR
DevOps
Docker
Kubernetes
Incident Management
Robotics
Sensor Fusion
+16
Apply

Recho

recho-ai.com
recho-ai.com • HQ: Tokyo, Japan • Call Center Services • Speech & Audio AI • AI Agents • 51-200 employees • Est. 2021 • Startup • Trust C • Hiring 15, 5 new
HQ: Tokyo, Japan • Call Center Services • Speech & Audio AI • AI Agents • 51-200 employees • Est. 2021 • Startup • Trust C • Hiring 15, 5 new
Recho is an AI company that provides voice AI agents for enterprises, with the mission of raising human productivity tenfold through generative AI. Its research team builds in-house speech synthesis and recognition models, and it hires product, platform, infrastructure and SRE engineers, corporate IT staff and enterprise sales. The company is based in Tokyo, Japan.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago Visa sponsorship 2 days ago Likely open · 63%

Senior AI Inference Engineer (LLM & Speech Models)

$64k – $128k per year • Equity • Senior • Hybrid (Chiyoda, Japan, 10am - 7pm) • Relocation • Senior • Japanese • Chinese (Optional) • English
Python
C++
C++
PyTorch C++
AI/ML
vLLM
CUDA Toolkit
Multimodal AI
Speech Recognition
SGLang
PyTorch
LLM
Ray
CUDA
Triton
Text-to-Speech
KV Cache
Cursor
Claude Code
Triton Inference Server
AI Agents
TensorRT
TensorRT-LLM
Devin
NCCL
DevOps
SLURM
Kubernetes
SLI/SLO/SLA
+18
Apply
Verified live · 2 hours ago 4 days ago Likely open · 63%

AI推論基盤エンジニア(シニア/LLM/音声モデル)

$64k – $128k per year • In office (Tokyo, Japan)
Python
C++
C++
PyTorch C++
AI/ML
vLLM
CUDA Toolkit
Triton Inference Server
AI Agents
Speech Recognition
SGLang
TensorRT-LLM
PyTorch
LLM
Ray
CUDA
Triton
Text-to-Speech
NCCL
KV Cache
Cursor
Claude Code
TensorRT
Devin
DevOps
SLURM
Kubernetes
+16
Apply

Vidu AI

vidu.com
vidu.com • HQ: Beijing, China • Generative Image • Generative Video • Trust A • Hiring 80, 6 new
HQ: Beijing, China • Generative Image • Generative Video • Trust A • Hiring 80, 6 new
Vidu is an AI video generation platform that creates videos from text, images and reference material for marketing, social content and animation.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 2 days ago Hiring now · 90%

流式推理后端工程师

Middle • 3+ years exp • In office (Beijing, China) • Full-Time • Middle • Chinese: C1
Java
AI/ML
Triton Inference Server
OpenVINO
DevOps
Git
Apply
Verified live · 2 hours ago 2 months ago Likely open · 49%

大模型Infra工程师 (VLM推理)

In office (Beijing, China) • Full-Time • Chinese: C1
vLLM
CUDA Toolkit
Triton Inference Server
VLM
SGLang
AWQ
GPTQ
TensorRT-LLM
LLM
CUDA
Speculative Decoding
KV Cache
TensorRT
+5
Apply
Verified live · 2 hours ago 2 months ago Fading · 29%

数据Infra工程师 (具身)

In office (Beijing, China) • Full-Time • Chinese: C1
Python
Python
Flask
FastAPI
AI/ML
Spark
vLLM
Triton Inference Server
VLM
TensorRT-LLM
LLM
Ray
ONNX Runtime
TensorRT
+4
Apply

MUSINSA

musinsa.com
musinsa.com • HQ: Seoul, South Korea • Marketplaces • Apparel & Fashion Brands • 1001-5000 employees • Est. 2001 • Trust A • Hiring 67, 7 new
HQ: Seoul, South Korea • Marketplaces • Apparel & Fashion Brands • 1001-5000 employees • Est. 2001 • Trust A • Hiring 67, 7 new
MUSINSA is a Seoul fashion platform that began in 2001 as an online community for sneaker enthusiasts. It has become the largest fashion commerce site in Korea, selling thousands of domestic brands and operating its own label and offline stores. The company also runs media, logistics and brand incubation businesses around its marketplace.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 2 days ago Hiring now · 90%

Data Scientist (Personalization)

In office (Seoul, South Korea) • Full-Time • Korean: C1
Redis
Databricks
ElasticSearch
Apache Kafka
Google BigQuery
BigQuery
AI/ML
MLFlow
Triton Inference Server
Scikit-learn
Flink
PyTorch
LLM
Ray
Hugging Face
DevOps
AWS
Docker
Kubernetes
Analytics
A/B Testing
+10
Apply
Verified live · 2 hours ago 4 months ago Long shot · 10%

Machine Learning Engineer (AdTech/MarTech)

In office (Seoul, South Korea) • Full-Time • Korean: C1
Python
SQL
Python
FastAPI
Databases
Redis
Databricks
ElasticSearch
Apache Kafka
AI/ML
MLFlow
Triton Inference Server
NLP
Kubeflow
TensorFlow
PyTorch
Ray
Hugging Face
Amazon SageMaker
DevOps
Git
AWS
Kubernetes
Amazon EKS
Management
Slack
Confluence
Jira
+15
Apply
bitdeer.com • HQ: Singapore • AI Compute & Inference • Mining & Staking • Cryptocurrencies • 501-1000 employees • Est. 2018 • NASDAQ: BTDR • Trust B • Hiring 148, 18 new
HQ: Singapore • AI Compute & Inference • Mining & Staking • Cryptocurrencies • 501-1000 employees • Est. 2018 • NASDAQ: BTDR • Trust B • Hiring 148, 18 new
Bitdeer Technologies Group is a global technology company specializing in Bitcoin mining, proprietary ASIC hardware manufacturing, and high-performance computing infrastructure. Headquartered in Singapore, the firm operates data center facilities across North America, Europe, and Asia to provide self-mining, cloud hash rate sharing, and colocation hosting services. By expanding into GPU-accelerated cloud platform capabilities, it delivers scalable computing solutions for both cryptocurrency networks and artificial intelligence workloads.
No named decision-maker yet.
No careers mailbox known
Verified live · 3 hours ago 2 days ago Likely open · 63%

Inference Performance Engineer - MaaS

≈ $62k – $134k per year (Estimated) • Senior • 5+ years exp • In office (Singapore) • Full-Time • Senior
Python
SQL
AI/ML
Spark
vLLM
Triton Inference Server
Fine-tuning
Embeddings
SGLang
TensorRT-LLM
LLM
KV Cache
TensorRT
DevOps
Prometheus
Grafana
FinOps
HPC
Web3
Bitcoin
QA
k6
Locust
+11
Apply
Verified live · 3 hours ago 1 month ago Long shot · 24%

Cloud Senior DevOps Engineer

≈ $15k – $41k per year (Estimated) • Senior • 5+ years exp • In office (George Town, Malaysia) • Bachelor's Degree • Full-Time • Senior
Python
Go
AI/ML
Machine Learning
vLLM
Triton Inference Server
TGI
DevOps
Terraform
Ansible
GCP
Helm
Prometheus
Azure
CI/CD
AWS
Docker
Kubernetes
Grafana
Platform Engineering
Self-Healing
Incident Management
HPC
Linux
TCP/IP
DNS
Cybersecurity
ISO 27001
SOC 2
Zero Trust
Web3
Bitcoin
+20
Apply
Verified live · 3 hours ago Visa sponsor 2 months ago Long shot · 22%

AI Cloud Senior DevOps Engineer

≈ $115k – $211k per year (Estimated) • Senior • 5+ years exp • San Jose • Remote (United States) • Bachelor's Degree • Full-Time • Senior
Python
Go
AI/ML
Machine Learning
vLLM
Triton Inference Server
TGI
DevOps
Terraform
Ansible
GCP
Helm
Prometheus
Azure
CI/CD
AWS
Docker
Kubernetes
Grafana
Platform Engineering
Self-Healing
Incident Management
Linux
TCP/IP
DNS
Cybersecurity
ISO 27001
SOC 2
Zero Trust
Web3
Bitcoin
+19
Apply

Norwin Technologies

norwintechnologies.com
norwintechnologies.com • Bengaluru • Pune • Information Security • Cloud Consulting & Migration • 11-50 employees • Est. 2003 • Hiring 18, 12 new
Bengaluru • Pune • Information Security • Cloud Consulting & Migration • 11-50 employees • Est. 2003 • Hiring 18, 12 new
From cloud migration to Zero-Trust security, Norwin builds resilient infrastructure that powers performance, protects data, and scales your business.
No named decision-maker yet.
Careers mailbox is known
≈ $20k – $43k per year (Estimated) • Senior • 8+ years exp • In office (Bengaluru, India) • Senior
Python
AI/ML
Ray Serve
CUDA Toolkit
Triton Inference Server
AI Agents
LLM
RAG
KServe
CUDA
Ray
DevOps
Terraform
GCP
Azure
CI/CD
GitOps
AWS
Kubernetes
Platform Engineering
Linux
+11
Apply
2 months ago Long shot · 9%

Senior Infrastructure/Platform Engineer

≈ $20k – $43k per year (Estimated) • Senior • 8+ years exp • In office (Bengaluru, India) • Senior
Python
AI/ML
Ray Serve
CUDA Toolkit
Triton Inference Server
AI Agents
LLM
RAG
KServe
CUDA
Ray
DevOps
Terraform
GCP
Azure
CI/CD
GitOps
AWS
Kubernetes
Platform Engineering
Linux
+11
Apply

Ant Group

antgroup.com
antgroup.com • HQ: Hangzhou, China • Digital Banks & Neobanks • Financial Software & Embedded Finance • Payment Processing & Gateways • 1001-5000 employees • Est. 2014 • Hiring 754, 265 new
HQ: Hangzhou, China • Digital Banks & Neobanks • Financial Software & Embedded Finance • Payment Processing & Gateways • 1001-5000 employees • Est. 2014 • Hiring 754, 265 new
Ant Group is a leading financial technology enterprise that provides digital payment processing, cloud computing services, and open digital infrastructure. Headquartered in Hangzhou, China, the company operates Alipay along with an extensive ecosystem of digital financial solutions to support institutions, merchants, and consumers globally. Through continuous innovation in blockchain, artificial intelligence, and inclusive finance, the organization enables small and micro businesses to access modern financial services and accelerate digital transformation.
No named decision-maker yet.
No careers mailbox known
Verified live · 2 hours ago 2 days ago Hiring now · 90%

蚂蚁集团-大模型推理与服务框架工程师-杭州/北京

In office (Beijing, China) • Chinese: C1
Python
Rust
C++
AI/ML
Seldon Core
Ray Serve
vLLM
CUDA Toolkit
Triton Inference Server
SGLang
TensorRT-LLM
CUDA
Triton
NCCL
CUTLASS
KV Cache
TensorRT
Ray
DevOps
SLI/SLO/SLA
Linux
+11
Apply
Verified live · 2 hours ago 4 days ago Hiring now · 90%

网商银行-AI-Infra工程师-推训方向

In office (Hangzhou, China) • Chinese: C1
vLLM
CUDA Toolkit
Triton Inference Server
SGLang
TensorRT-LLM
CUDA
NCCL
TensorRT
DevOps
SLI/SLO/SLA
Linux
+2
Apply

EY

ey.com
ey.com • HQ: London, United Kingdom • Management Consulting • Financial Advisory, Valuation & Restructuring • Tax Advisory & Preparation • Audit & Assurance Firms • 5000+ employees • Est. 1989 • Hiring 4519, 1312 new
HQ: London, United Kingdom • Management Consulting • Financial Advisory, Valuation & Restructuring • Tax Advisory & Preparation • Audit & Assurance Firms • 5000+ employees • Est. 1989 • Hiring 4519, 1312 new
Headquartered in London, United Kingdom, EY (Ernst & Young) is a multinational professional services network and one of the "Big Four" accounting firms. The organization provides financial assurance and auditing, tax advisory, management and technology consulting, and strategy and transactions advisory through its EY-Parthenon arm. Operating across more than 150 countries, it delivers risk management, digital transformation, data analytics, and regulatory compliance solutions to multinational corporations, financial institutions, and government entities worldwide.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 2 days ago Hiring now · 90%

DevSecOps and AI Engineer-SENIOR

≈ $25k – $54k per year (Estimated) • Senior • 4+ years exp • In office (Bengaluru, India) • Bachelor's Degree • Senior
Python
SQL
PowerShell
Databases
Weaviate
Chroma
Pinecone
FAISS
RabbitMQ
Apache Kafka
AI/ML
LangChain
Seldon Core
Ray Serve
LlamaIndex
Dagster
MLFlow
Triton Inference Server
Vertex AI
dbt
Prefect
Arize Phoenix
BentoML
Semantic Kernel
Kubeflow
Evidently AI
RAG
KServe
Amazon SageMaker
LLM Guardrails
Ray
Frontend
GraphQL
DevOps
Rest API
gRPC
Terraform
Puppet
Ansible
GCP
Helm
Azure DevOps
GitHub Actions
Jaeger
Loki
New Relic
OpenTelemetry
Podman
Chef
CircleCI
CloudFormation
Datadog
Kustomize
Prometheus
Pulumi
GitLab CI
Azure
CI/CD
GitOps
ArgoCD
Jenkins
AWS
Docker
Kubernetes
Grafana
SaltStack
Shift-Left
Configuration Management
Bicep
Amazon EKS
Google GKE
Azure AKS
AWS Lambda
Progressive Delivery
IAM
Amazon Kinesis
Cybersecurity
Snyk
SonarQube
Trivy
Checkmarx
Gitleaks
TruffleHog
GDPR
Least Privilege
Shift-Left Security
SBOM
Syft
Dependabot
Renovate
Kyverno
Microsoft Entra ID
OWASP
Analytics
ETL/ELT
+81
Apply
cra.cz • HQ: Prague, Czech Republic • Telecom Infrastructure • IoT Connectivity • Data Centers & Colocation • Broadcasting • Est. 1963 • Hiring 6, 4 new
HQ: Prague, Czech Republic • Telecom Infrastructure • IoT Connectivity • Data Centers & Colocation • Broadcasting • Est. 1963 • Hiring 6, 4 new
Ceske Radiokomunikace is a Czech infrastructure operator with roots going back to 1963. It runs the national television and radio broadcasting network along with data centres and internet of things connectivity. The company is one of the largest neutral infrastructure providers in the country.
No named decision-maker yet.
Careers mailbox is known
≈ $44k – $114k per year (Estimated) • Senior • In office (Prague, Czech Republic) • Senior
Python
Databases
PostgreSQL
InfluxDB
AI/ML
vLLM
Triton Inference Server
Prompt Engineering
Helicone
Langfuse
LiteLLM
Ollama
LLM
Hugging Face
DevOps
Prometheus
CI/CD
Docker
Kubernetes
Grafana
Incident Management
+10
Apply
Machines can read this selection · checked 09:51 UTC

Salary range

Seniority Jobs 25% Median 75%
Middle 8 $175K $193K $220K
Senior 30 $190K $242K $273K
Staff 14 $180K $242K $260K
All levels 72 $175K $225K $273K

Based only on the listings that state pay. Gross annual amounts, converted to USD so roles in different currencies stay comparable.

Fully remote 20%
49
Hybrid 15%
36
On site 66%
162
Equity 8%
19

The market right now

Alion currently lists 247 open Triton Inference Server jobs from 160 companies. 43 of them were posted or refreshed in the last seven days. 131 of the employers have posted something in the last three months, which is the pool worth watching if you are starting a search now. 21 of the 247 carry the marks of a stale or abandoned posting - open far beyond the usual time to fill, reposted, or on a board that mostly never closes a role - and are marked as likely inactive; the list can hide them. Every listing links straight to the employer, so you apply on their own board rather than through an intermediary.

What these roles pay

72 of these Triton Inference Server jobs state pay directly. Across them the middle half of the market sits between $175K and $273K a year, with a median of $225K. By level, the median runs middle at $193K, senior at $242K, and staff at $242K. The step from middle to staff is worth about 1.3x on median pay. Figures are gross annual amounts converted to US dollars, so roles in different currencies stay comparable.

Where the work is

The largest concentrations of these roles are China (13), United States (9), South Korea (9), Poland (6), and Spain (6). 20% of the listings are fully remote and a further 15% are hybrid, so a large part of this market is open to you regardless of where you live.

Who is hiring

The employers with the most open Triton Inference Server jobs right now are NVIDIA (19), Point Wild (7), Lenovo (5), Nebius (5), ByteDance (5), and Vidu AI (4). Each company page on Alion carries its size, funding stage, tech stack and every other position it has open, so you can judge the employer before you spend an evening on the application.

What employers ask for

Reading across the current listings, the tools that come up most often are Triton Inference Server (247), Python (187), Kubernetes (167), TensorRT (139), LLM (138), vLLM (132), PyTorch (119), and Machine Learning (105). The counts are how many of these openings name each one, which is a better guide to what is actually being hired for than a generic skills list.

Relocation, visas and equity

Of the current Triton Inference Server jobs, 3 state visa sponsorship, 9 offer a relocation package, and 19 include equity. These are filters on the list above, so you can narrow it to the ones that make a move possible for you.

Triton Inference Server Jobs - Remote & On-site
Frequently asked questions
How many Triton Inference Server jobs are open right now?
There are 247 open Triton Inference Server jobs on Alion from 160 companies. The list was last refreshed on October 17, 2026.
Are all of these Triton Inference Server jobs still being filled?
Probably not all of them. 21 of the 247 show the marks Alion reads as a likely inactive posting: open far longer than employers usually take to fill such a role, reposted several times, or sitting on a board that rarely closes anything. They stay listed with a warning, and the list can hide them with one switch.
What do Triton Inference Server jobs pay?
The median is $225K a year, and the middle half of the market falls between $175K and $273K. This is based on the 72 listings that state pay.
Are any of these roles remote?
49 of the 247 listings (20%) are fully remote, and you can filter the list down to them in one click.
Which companies are hiring?
The most active employers right now are NVIDIA, Point Wild, Lenovo, Nebius, ByteDance, and Vidu AI. Each has its own page on Alion with the rest of its open roles.
Can I get visa sponsorship or relocation?
Yes - of the current listings, 3 state visa sponsorship and 9 offer a relocation package. Both are filters on the jobs page.
How do I apply?
Open any listing and apply on the employer's own board through the link on the page. No account is required to browse or to apply.