Triton Inference Server Jobs - Remote & On-site

Triton Inference Server jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $251,933/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Plaud

plaud.ai
plaud.ai • HQ: San Francisco, United States • Office & Productivity Software • Speech & Audio AI • 501-1000 employees • Est. 2021 • Startup • Trust A • Hiring 53, 5 new
HQ: San Francisco, United States • Office & Productivity Software • Speech & Audio AI • 501-1000 employees • Est. 2021 • Startup • Trust A • Hiring 53, 5 new
Plaud is an AI hardware and software company headquartered in San Francisco that makes AI voice recorders and note-taking devices, with companion apps that transcribe, summarize and organize in-person conversations, phone calls and online meetings. Incorporated in Delaware and with further offices in Singapore, Tokyo, Shenzhen, Seattle and Beijing, it reports more than 2,500,000 users since 2023 and a $300 million revenue run rate reached within three years as a bootstrapped, profitable business. It hires machine learning engineers for speech models, full-stack and security engineers, product and growth managers, hardware designers and regional marketing and PR staff.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 1 hour ago Visa sponsor 5 months ago Long shot · 11%

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco

$195k – $365k per year • Hybrid (San Francisco, United States) • Full-Time
vLLM
Triton Inference Server
SGLang
TensorRT-LLM
LLM
Edge AI
KV Cache
Quantization
Speech Recognition
AWQ
GPTQ
TensorRT
Post-training
Speculative Decoding
DevOps
WebRTC
WebSockets
Kubernetes
Cybersecurity
ISO 27001
SOC 2
GDPR
HIPAA
+13
Apply

Kraken

kraken.com
kraken.com • HQ: San Francisco, United States • Real Estate • Artificial Intelligence • Blockchain & Crypto • Online Brokerage & Trading Platforms • Wealth Management & Financial Advisors • Financial Services • Crypto Exchanges • 501-1000 employees • Est. 2011 • Trust A • Hiring 71, 11 new
HQ: San Francisco, United States • Real Estate • Artificial Intelligence • Blockchain & Crypto • Online Brokerage & Trading Platforms • Wealth Management & Financial Advisors • Financial Services • Crypto Exchanges • 501-1000 employees • Est. 2011 • Trust A • Hiring 71, 11 new
Headquartered in San Francisco, California, Kraken (Payward, Inc.) is a global digital asset exchange and financial technology platform provider. The company offers a financial trading infrastructure supporting spot, margin, and futures trading, crypto staking, institutional custody services, OTC desk execution, and tokenized equities access across hundreds of digital assets and major fiat currencies.
Mark Greenberg · Executive Officer · decision-maker
Robert Moore · Executive Officer · decision-maker
Nicholas Percoco · Executive Officer · decision-maker
Curtis Ting · Executive Officer · decision-maker
No careers mailbox known
Open 165 daysVerified live · 3 hours ago 5 months ago Long shot · 14%

Senior AI Compute Infrastructure Engineer

≈ $82k – $153k per year (Estimated) • Senior • 5+ years exp • Panama • Remote (United Kingdom, Argentina, Brazil, Bulgaria, Canada) • Full-Time • Senior
Python
Rust
C++
AI/ML
Ray Serve
vLLM
Triton Inference Server
TensorRT
Ray
KServe
TorchServe
DeepSpeed
CUDA Toolkit
CUDA
Megatron-LM
FSDP
TPU
NCCL
AWS Trainium
DevOps
Kubernetes
Linux
AWS
+13
Apply

Montauk Capital

montaukcap.com
montaukcap.com • HQ: New York, United States • Power Grid • Venture Capital • 201-500 employees • Est. 2023 • Trust B • Hiring 12, 1 new
HQ: New York, United States • Power Grid • Venture Capital • 201-500 employees • Est. 2023 • Trust B • Hiring 12, 1 new
Montauk Capital is building solutions across the full stack of the Electron Economy, ensuring its success today, tomorrow, and for the future of our planet.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 5 months ago Long shot · 17%

Head of Inference, Perimeter Compute

≈ $190k – $357k per year (Estimated) • Head+ • Hybrid (New York, United States) • Full-Time • Architect
Rust
C++
JavaScript
Node JS
Node JS
Electron
AI/ML
vLLM
CUDA Toolkit
Triton Inference Server
Quantization
SGLang
TensorRT-LLM
Ray
CUDA
Triton
Edge AI
Speculative Decoding
KV Cache
TensorRT
DevOps
Kubernetes
SLI/SLO/SLA
+12
Apply

Integrant

integrant.com
integrant.com • HQ: San Diego, United States • AI Consulting & Integration • Web Development Services • Mobile App Development Services • Custom Software Development • 201-500 employees • Est. 1992 • Trust A • Hiring 26
HQ: San Diego, United States • AI Consulting & Integration • Web Development Services • Mobile App Development Services • Custom Software Development • 201-500 employees • Est. 1992 • Trust A • Hiring 26
Integrant is a custom software development company that specializes in building web, mobile, and enterprise applications alongside AI-driven solutions. Headquartered in San Diego, California, the firm also maintains international development centers to support its technical workforce. It provides software engineering, quality assurance, and IT consulting services tailored primarily to industries such as life sciences, healthcare, and finance.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 6 months ago Fading · 25%

Devops & SysOps Architect

≈ $81k – $190k per year (Estimated) • Staff+ • In office (Cairo, Egypt) • Architect
DeepSpeed
CUDA Toolkit
Triton Inference Server
TensorRT
PyTorch
CUDA
NCCL
InfiniBand
cuDNN
DevOps
Terraform
Ansible
Red Hat
Azure DevOps
Cilium
Istio
Loki
Fluent Bit
Prometheus
SLURM
Azure
CI/CD
GitOps
ArgoCD
Jenkins
AWS
Kubernetes
Platform Engineering
Service Mesh
Thanos
External Secrets
Amazon EKS
Azure AKS
Error Budget
SLI/SLO/SLA
Amazon S3
IAM
HPC
Linux
BGP
Grafana
Cybersecurity
HashiCorp Vault
Zero Trust
Cryptography
Vault
+35
Apply

Sarvam AI

sarvam.ai
sarvam.ai • HQ: Bengaluru, India • LLM & Generative AI • Speech & Audio AI • Foundation Models • Natural Language Processing • 501-1000 employees • Est. 2023 • Startup • Trust A • Hiring 40
HQ: Bengaluru, India • LLM & Generative AI • Speech & Audio AI • Foundation Models • Natural Language Processing • 501-1000 employees • Est. 2023 • Startup • Trust A • Hiring 40
Sarvam AI is a leading Indian artificial intelligence company focused on building full-stack sovereign generative AI infrastructure, foundational large language models (LLMs), and speech technologies tailored for India’s diverse languages and enterprise requirements.
No named decision-maker yet.
Careers mailbox is known
Verified live · 3 hours ago 6 months ago Long shot · 18%

ML Ops Engineer, Chanakya

≈ $19k – $51k per year (Estimated) • Middle • 3+ years exp • In office (Delhi, India) • Full-Time • Middle
Python
AI/ML
vLLM
Triton Inference Server
Fine-tuning
AWQ
GGUF
GPTQ
TGI
LLM
DevOps
GitHub Actions
K3s
Prometheus
CI/CD
ArgoCD
Docker
Kubernetes
Grafana
Analytics
A/B Testing
+10
Apply

Dover Networks

dovernetworks.com
dovernetworks.com • Security Operations • Information Security • Trust B • Hiring 44, 9 new
Security Operations • Information Security • Trust B • Hiring 44, 9 new
Dover Networks delivers cyber operations, training, software development and infrastructure services.
No named decision-maker yet.
Careers mailbox is known
Open 192 daysTop 25% pay 6 months ago Long shot · 7%

Software Engineer (SWE), Level 3 [D.26.0105]

$260k per year • Staff+ • 12+ years exp • In office • Bachelor's Degree • Full-Time • TS/SCI • Principal
vLLM
Triton Inference Server
LiteLLM
Ollama
TensorFlow
Ray
TorchServe
DevOps
Prometheus
CI/CD
GitOps
Docker
Kubernetes
Grafana
Platform Engineering
Istio
Linkerd
Service Mesh
Management
Confluence
Jira
+11
Apply

Deepgram

deepgram.com
deepgram.com • HQ: San Francisco, United States • Machine Learning • Natural Language Processing • Speech & Audio AI • 501-1000 employees • Est. 2015 • Startup • Trust A • Hiring 85, 9 new
HQ: San Francisco, United States • Machine Learning • Natural Language Processing • Speech & Audio AI • 501-1000 employees • Est. 2015 • Startup • Trust A • Hiring 85, 9 new
Deepgram is an AI speech platform that provides real-time and asynchronous automated speech recognition (ASR) and text-to-speech (TTS) APIs. Built on custom deep learning models, its technology delivers fast, accurate, and cost-effective voice transcription, language understanding, and audio synthesis for developers and enterprise businesses. Headquartered in San Francisco, California, the company enables organizations to integrate advanced voice capabilities and intelligence directly into their applications and conversational AI workflows.
Adam Sypniewski · Executive Officer, Director · decision-maker
Scott Stephenson · Executive Officer, Director · decision-maker
Elizabeth de Saint-Aignan · Director
Dave Wilner · Director
Careers mailbox is known
Top 25% payVerified live · 1 hour ago Visa sponsor 6 months ago Long shot · 18%

ML Ops Infrastructure Engineer

$160k – $220k per year • Middle • 4+ years exp • Remote (United States) • PhD • Full-Time • Middle
Python
AI/ML
Triton Inference Server
TensorRT
Feature Store
Text-to-Speech
Deepgram
Vapi
Edge AI
ONNX Runtime
Voice Agents
Mobile
Twilio
DevOps
Terraform
Datadog
Prometheus
Pulumi
CI/CD
Docker
Kubernetes
Cloudflare
Grafana
Canary Release
Self-Healing
Progressive Delivery
Analytics
A/B Testing
+16
Apply

Gatik

gatik.ai
gatik.ai • HQ: Mountain View, United States • Road Transport • Logistics • Autonomous Driving • Est. 2017 • Startup • Trust C • Hiring 67
HQ: Mountain View, United States • Road Transport • Logistics • Autonomous Driving • Est. 2017 • Startup • Trust C • Hiring 67
Gatik is an autonomous trucking company headquartered in Mountain View, California, that runs driverless medium-duty box trucks on short-haul, middle-mile routes between distribution centers and stores for large retailers and grocers. Founded in 2017 by Gautam Narang, Arjun Narang and Apeksha Kumavat, it launched driverless deliveries for Walmart in 2021, works with Loblaw in Ontario and PepsiCo in the US, operates in Texas, Arkansas and Arizona, and raised a $200 million Series D led by the Qatar Investment Authority in 2026. It hires perception and motion planning engineers, robotics and hardware engineers, fleet operations staff, dispatchers and recruiters.
No named decision-maker yet.
No careers mailbox known
Likely inactiveTop 25% pay Visa sponsor 7 months ago Long shot · 4%

Senior AI Infrastructure Engineer

$180k – $240k per year • Senior • 5+ years exp • In office (Santa Clara, United States) • Senior
Python
Rust
Databases
Delta Lake
Apache Kafka
AI/ML
LangGraph
AutoGen
Spark
Airflow
DeepSpeed
MLFlow
Triton Inference Server
Fine-tuning
AI Agents
TensorRT
Kubeflow
PyTorch
CrewAI
Ray
Gaussian Splatting
FSDP
Feature Store
NCCL
InfiniBand
ONNX Runtime
Vision-Language-Action
Agentic Workflows
World Models
LangChain
Model Context Protocol
Physical AI
DevOps
Terraform
Helm
OpenTelemetry
Prometheus
CI/CD
GitOps
Docker
Kubernetes
Grafana
Self-Healing
Argo Workflows
Amazon S3
Analytics
ETL/ELT
A/B Testing
+36
Apply
Likely inactiveTop 25% pay Visa sponsor 7 months ago Long shot · 4%

Senior Cloud Infrastructure Engineer

$180k – $240k per year • Senior • 5+ years exp • In office (Santa Clara, United States) • Senior
Python
Go
Databases
Apache Kafka
AI/ML
LangGraph
AutoGen
Ray Serve
Spark
Airflow
DeepSpeed
Model Context Protocol
MLFlow
Triton Inference Server
AI Agents
PyTorch
CrewAI
Ray
Gaussian Splatting
FSDP
Feature Store
TPU
NCCL
InfiniBand
ONNX Runtime
Vision-Language-Action
Agentic Workflows
World Models
LangChain
DevOps
Terraform
Helm
OpenTelemetry
Prometheus
GitLab CI
CI/CD
GitOps
ArgoCD
Kubernetes
Grafana
Self-Healing
Argo Workflows
IAM
+32
Apply

Satlantis

satlantis.com
satlantis.com • HQ: Leioa, Spain • Satellite Manufacturing • Earth Observation • Est. 2014 • Trust D • Hiring 15
HQ: Leioa, Spain • Satellite Manufacturing • Earth Observation • Est. 2014 • Trust D • Hiring 15
Satlantis is a Basque space company founded in 2014 and specialised in very high resolution Earth observation cameras. Its compact optical payloads fly on small satellites and detect methane emissions and urban change. The company works with the European Space Agency, NASA partners and energy companies.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveVerified live · 11 hours ago Visa sponsorship 7 months ago Long shot · 4%

SENIOR COMPUTER VISION ENGINEER – REMOTE SENSING VACANCY

Senior • 3+ years exp • In office • Bachelor's Degree • Senior
Python
C++
C++
TensorFlow C++
PyTorch C++
AI/ML
Multimodal AI
Computer Vision
TensorFlow
PyTorch
Self-Supervised Learning
Anomaly Detection
Encoder-Decoder
Machine Learning
OpenCV
CUDA Toolkit
MLFlow
Triton Inference Server
Fine-tuning
Transfer Learning
ONNX
TensorRT
Comet ML
Time Series Forecasting
CUDA
Triton
DevOps
GCP
SLURM
Azure
AWS
Kubernetes
HPC
SpaceTech
GDAL
+23
Apply

Claryo

claryo.co
claryo.co • HQ: San Francisco, United States • Supply Chain AI • Computer Vision • 51-200 employees • Est. 2022 • Startup • Hiring 4
HQ: San Francisco, United States • Supply Chain AI • Computer Vision • 51-200 employees • Est. 2022 • Startup • Hiring 4
Claryo is a startup building an AI-driven warehouse intelligence platform that combines computer vision and multi-modal AI systems running in production. Its job ads cover senior and staff software engineers for ML infrastructure and full stack work, a lead developer and a product software engineer. The company is headquartered in San Francisco, California, United States.
Mohamed Amer · Executive Officer, Director · decision-maker
Igor Taber · Director
Dylan Bourgeois · Director
No careers mailbox known
Open 217 daysVerified live · 2 hours ago Visa sponsor 7 months ago Long shot · 8%

Senior Software Engineer - ML Infrastructure

$170k – $190k per year • Senior • 5+ years exp • In office (San Francisco, United States) • Bachelor's Degree • Full-Time • Senior
Python
C++
C++
TensorFlow C++
PyTorch C++
Databases
Apache Kafka
AI/ML
Multimodal AI
Computer Vision
World Models
Machine Learning
DeepSpeed
CUDA Toolkit
Triton Inference Server
Quantization
TensorRT
TensorFlow
PyTorch
CUDA
TorchServe
Flyte
DevOps
gRPC
Robotics
ROS2
+13
Apply

HavocAI Inc.

havocai.com
havocai.com • HQ: Providence, United States • Defense AI • Military & Tactical Robotics • Underwater & Marine Robotics • 201-500 employees • Est. 2024 • Trust B • Hiring 24
HQ: Providence, United States • Defense AI • Military & Tactical Robotics • Underwater & Marine Robotics • 201-500 employees • Est. 2024 • Trust B • Hiring 24
Defense Commercial About HavocAI | All-Domain Collaborative Autonomy About Havoc Havoc is the leader in all-domain collaborative autonomy, powering military- and commercial-grade autonomous systems across sea, air, and land to sense, decide, and act together in complex and contested environments.
Lucas Hoffmann · Executive Officer · decision-maker
Andrew Gregg · Executive Officer, Director · decision-maker
Joseph Turner · Executive Officer, Director · decision-maker
Paul Lwin · Executive Officer, Director · decision-maker
No careers mailbox known
Open 234 daysTop 25% pay Visa sponsor 8 months ago Long shot · 5%

Embedded Perception Engineer

$150k – $185k per year • Equity • Middle • 3+ years exp • Remote (United States) • Bachelor's Degree • Full-Time • Middle
Python
C++
C++
TensorFlow C++
PyTorch C++
AI/ML
Triton Inference Server
Quantization
Multimodal AI
Computer Vision
TensorRT
TensorFlow
PyTorch
CLIP
Triton
ONNX Runtime
Machine Learning
Edge AI
DevOps
Linux
Robotics
Sensor Fusion
ROS2
MOOS-IvP
+12
Apply

RLWRLD

rlwrld.ai
rlwrld.ai • HQ: San Francisco, United States • Robotic Software & Control Systems • Foundation Models • Robotics AI • 51-200 employees • Startup • Trust C • Hiring 38, 2 new
HQ: San Francisco, United States • Robotic Software & Control Systems • Foundation Models • Robotics AI • 51-200 employees • Startup • Trust C • Hiring 38, 2 new
RLWRLD is a physical AI startup that develops robotics foundation models for dexterous, five-finger robot hand manipulation, with its US headquarters in San Francisco and most of its team in Seoul, South Korea. It trains its RLDX model family on motion-capture and factory data collected with manufacturing, logistics and service companies, deploys robots at industrial sites in Japan through a Tokyo office, and raised a seed round of about 60 billion won from venture investors and large corporations. It hires research scientists and engineers, robotics deployment and software engineers, hardware and procurement staff, product managers and interns.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveVerified live · 1 hour ago 9 months ago Long shot · 4%

Cloud Infrastructure Engineer

Middle • 3+ years exp • In office (Seoul, South Korea) • Full-Time • Middle
Weights & Biases
MLFlow
Triton Inference Server
Prefect
Kubeflow
TensorFlow
PyTorch
TorchServe
NCCL
InfiniBand
NVLink
Physical AI
DevOps
GCP
GitHub Actions
Prometheus
SLURM
Azure
AWS
Kubernetes
Grafana
Amazon EKS
Google GKE
Azure AKS
AWS Lambda
IAM
HPC
Linux
+19
Apply

Realm Labs

realmlabs.ai
realmlabs.ai • HQ: Sunnyvale, United States • AI Evaluation & Observability • AI Safety & Alignment • 11-50 employees • Startup • Trust B • Hiring 4
HQ: Sunnyvale, United States • AI Evaluation & Observability • AI Safety & Alignment • 11-50 employees • Startup • Trust B • Hiring 4
RealmGuard Technology Resources AI Failure Index Blog News Research Whitepaper Book Demo About Realm Labs was founded by AI researchers from three traditions that converged on the same problem: adversarial machine learning, AI safety and explainability, and large-scale systems and supply-chain security.
No named decision-maker yet.
No careers mailbox known
Open 276 daysTop 25% pay 9 months ago Long shot · 7%

ML Research Engineer, Trust & Safety

$200k – $260k per year • In office (Sunnyvale, United States) • PhD • Full-Time
Python
AI/ML
Multimodal AI
Transformers
PyTorch
LLM
Hugging Face
LLM Guardrails
Interpretability
LoRA
vLLM
Triton Inference Server
Fine-tuning
NLP
PEFT
Anthropic
DevOps
GCP
Git
AWS
Docker
Unix
+12
Apply
Open 276 daysTop 25% pay 9 months ago Long shot · 7%

Software Engineer, ML Infrastructure

$180k – $250k per year • Senior • 5+ years exp • In office (Sunnyvale, United States) • Full-Time • Senior
vLLM
Triton Inference Server
SGLang
TensorRT
TensorRT-LLM
Transformers
TensorFlow
PyTorch
LLM
KV Cache
CUDA Toolkit
CUDA
NCCL
DevOps
Linux
Kubernetes
+7
Apply

GRNET

grnet.gr
grnet.gr • HQ: Athens, Greece • IT Infrastructure & Networking Services • Research Institutes • Est. 1998 • Trust B • Hiring 8
HQ: Athens, Greece • IT Infrastructure & Networking Services • Research Institutes • Est. 1998 • Trust B • Hiring 8
GRNET is the Greek national infrastructure for research and technology, established in 1998 and based in Athens. It operates the country's academic network, cloud services and high performance computing. The organisation also runs national digital government infrastructure.
No named decision-maker yet.
Careers mailbox is known
Open 280 daysVerified live · 5 hours ago 9 months ago Long shot · 3%

Distributed AI Support Engineer

In office (Athens, Greece) • Greek
Python
Python
Dask
Databases
FAISS
AI/ML
Weights & Biases
Bitsandbytes
DeepSpeed
LoRA
vLLM
CUDA Toolkit
MLFlow
PyTorch Lightning
Triton Inference Server
Fine-tuning
SciPy
Computer Vision
Gradio
PEFT
QLoRA
TensorRT-LLM
Unsloth
Accelerate
Transformers
TensorFlow
PyTorch
LLM
RAG
TensorBoard
Ray
RAPIDS
Torchvision
CUDA
Hugging Face
FSDP
NCCL
TensorRT
DevOps
SLURM
HPC
Analytics
Matplotlib
+30
Apply

WS Audiology

wsa.com
wsa.com • HQ: Lynge, Denmark • Hearing Care & Audiology • 5000+ employees • Est. 2019 • Trust A • Hiring 74, 4 new
HQ: Lynge, Denmark • Hearing Care & Audiology • 5000+ employees • Est. 2019 • Trust A • Hiring 74, 4 new
WS Audiology is a hearing aid manufacturer headquartered in Lynge, north of Copenhagen, Denmark, formed in 2019 by the merger of Sivantos and Widex and now trading under the WSA name. It employs more than 12,000 people in 45 offices, runs research and development facilities in Denmark, Germany, India and Singapore, and serves hearing care professionals and consumers worldwide with hearing aids and hearing health services. This record's board covers the Asia-Pacific region, hiring software, AI and test automation engineers, product managers, device and manufacturing engineers, interns, analysts and customer care coordinators in Singapore, Australia and New Zealand.
No named decision-maker yet.
Careers mailbox is known
Open 315 daysVerified live · 7 hours ago 10 months ago Long shot · 9%

AI Test Architect

≈ $31k – $73k per year (Estimated) • Staff+ • 10+ years exp • In office (Hyderabad, India) • Full-Time • Architect • English
Python
Databases
Chroma
FAISS
AI/ML
LangChain
llama.cpp
OpenCV
LlamaIndex
MLFlow
Fine-tuning
Computer Vision
AI Agents
Ollama
TensorFlow
PyTorch
LLM
RAG
Anomaly Detection
Hugging Face
OCR
Triton Inference Server
Tesseract OCR
Mobile
Espresso
React Native
Fastlane
DevOps
GitLab CI
CI/CD
Jenkins
Docker
Shift-Left
Self-Healing
Azure DevOps
OpenTelemetry
Prometheus
Azure
Ubuntu
Grafana
SLI/SLO/SLA
Cybersecurity
Shift-Left Security
GDPR
HIPAA
QA
Appium
XCUITest
Detox
+35
Apply

Cerebras Systems

cerebras.ai
cerebras.ai • HQ: Sunnyvale, United States • Servers & Data Center Hardware • AI Compute & Inference • AI Chips & Accelerators • Processors, MCUs & AI Chips • 1001-5000 employees • Est. 2016 • NASDAQ: CBRS • Trust B • Hiring 118, 3 new
HQ: Sunnyvale, United States • Servers & Data Center Hardware • AI Compute & Inference • AI Chips & Accelerators • Processors, MCUs & AI Chips • 1001-5000 employees • Est. 2016 • NASDAQ: CBRS • Trust B • Hiring 118, 3 new
Cerebras Systems is an American computer hardware company founded in 2016 and headquartered in Sunnyvale, California that builds accelerators for artificial intelligence at wafer scale. Instead of assembling clusters from many small chips, it manufactures a single processor the size of an entire silicon wafer, the Wafer Scale Engine, which removes most of the communication overhead in large model training and inference. The company sells CS-series systems to research laboratories and enterprises, operates its own inference cloud known for very high token throughput, and has built large supercomputers with partners including the Gulf technology group G42.
Sean Lie · Co-Founder & Chief Technology Officer · decision-maker
Gary Lauterbach · Co-Founder & Chief Technology Officer · decision-maker
Andrew Feldman · Co-Founder & Chief Executive Officer · decision-maker
Jean-Philippe Fricker · Co-Founder & Chief System Architect · founder
Careers mailbox is known
Open 328 daysVerified live · 3 hours ago Visa sponsor 11 months ago Long shot · 9%

Software Engineer, GPU Inference

≈ $200k – $383k per year (Estimated) • Senior • 5+ years exp • In office (Toronto, Canada, Sunnyvale, United States) • Bachelor's Degree • Full-Time • Senior
Python
C++
C++
PyTorch C++
AI/ML
vLLM
Triton Inference Server
Quantization
Multimodal AI
AI Agents
SGLang
TensorRT-LLM
PyTorch
Cerebras
Triton
OpenAI
ROCm
Edge AI
KV Cache
CUDA Toolkit
TensorRT
Mixture of Experts
CUDA
DevOps
CI/CD
Kubernetes
Linux
+16
Apply

OutcomesAI

outcomes.ai
outcomes.ai • Bengaluru • 51-200 employees • Trust B • Hiring 3
Bengaluru • 51-200 employees • Trust B • Hiring 3
AI-enabled Nursing. Human Care at Scale.. OutcomesAI combines AI Voice Agents with licensed nurses to deliver safe, scalable care across health systems, virtual care providers, and pharma.
No named decision-maker yet.
Careers mailbox is known
Open 346 daysVerified live · 1 hour ago 11 months ago Long shot · 6%

Backend / ML-Ops Engineer — Speech Model Deployment & Inference Optimization

≈ $20k – $54k per year (Estimated) • Middle • 4+ years exp • In office (Bengaluru, India) • PhD • Full-Time • Middle
Python
AI/ML
MLFlow
Triton Inference Server
Speech Recognition
TensorRT
LLM
Triton
Text-to-Speech
Edge AI
Quantization
DevOps
CI/CD
Kubernetes
GCP
Prometheus
Azure
AWS
Docker
Grafana
+10
Apply

Fabrion

fabrion.com
fabrion.com • HQ: San Francisco, United States • Supply Chain AI • Industrial AI • 51-200 employees • Startup • Trust B • Hiring 8
HQ: San Francisco, United States • Supply Chain AI • Industrial AI • 51-200 employees • Startup • Trust B • Hiring 8
Transform complex industrial value chains with AI. Fabrion accelerates AI adoption across multi-tier value chains for industrial manufacturers, delivering step-change gains in operating speed and resilience.
No named decision-maker yet.
No careers mailbox known
Open 435 daysVerified live · 3 hours ago Visa sponsor 1 year ago Long shot · 9%

ML Ops Engineer — Agentic AI Lab (Founding Team)

≈ $162k – $311k per year (Estimated) • Senior • 5+ years exp • Hybrid (San Francisco, United States) • Full-Time • Senior
Python
Go
Rust
JavaScript
Databases
Weaviate
Chroma
FAISS
Qdrant
AI/ML
LangGraph
Weights & Biases
LangChain
Ray Serve
DeepSpeed
LlamaIndex
LoRA
vLLM
Dagster
MLFlow
Triton Inference Server
Prefect
Fine-tuning
RLHF
Quantization
AI Agents
LangSmith
QLoRA
TGI
Falcon
Mistral
huggingface_hub
LLM
RAG
Ray
Mixtral
Triton
Hugging Face
Amazon SageMaker
LLMOps
DPO
SFT
FSDP
PEFT
Frontend
Next.js
React.js
DevOps
Terraform
Helm
GitHub Actions
OpenTelemetry
Prometheus
CI/CD
ArgoCD
Docker
Kubernetes
Grafana
Platform Engineering
Amazon EKS
Google GKE
AWS Lambda
SLI/SLO/SLA
GCP
AWS
Cybersecurity
Keycloak
SOC 2
HIPAA
+56
Apply

Pulse

runpulse.com
runpulse.com • HQ: San Francisco, United States • Information Security • Computer Vision • Cybersecurity • Document AI • 201-500 employees • Est. 2024 • Startup • Trust D • Hiring 10
HQ: San Francisco, United States • Information Security • Computer Vision • Cybersecurity • Document AI • 201-500 employees • Est. 2024 • Startup • Trust D • Hiring 10
Pulse converts complex PDFs, scans and spreadsheets into verified structured data for enterprise workflows. It targets documents that defeat ordinary OCR, such as financial statements and dense tables. Customers use the output to feed downstream systems without manual keying.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveTop 25% pay 1 year ago Long shot · 4%

DevOps Engineer

$150k – $210k per year • Middle • 4+ years exp • In office (San Francisco, United States) • Relocation • Full-Time • Middle
Computer Vision
NLP
OCR
Triton Inference Server
DevOps
Terraform
GitHub Actions
AWS
Kubernetes
Platform Engineering
Amazon EKS
Linux
Cybersecurity
HashiCorp Vault
+4
Apply
Likely inactiveVerified live · 2 hours ago 1 year ago Long shot · 3%

Machine Learning Engineer

$160k – $220k per year • In office (San Francisco, United States) • Relocation • Full-Time
Computer Vision
NLP
OCR
Triton Inference Server
Quantization
JAX
Multimodal AI
ONNX
TensorRT
PyTorch
+2
Apply

ByteDance

bytedance.com
bytedance.com • HQ: Beijing, China • Advertising • Digital Media • Recommendation Systems • Video & Photo Sharing • Consumer Internet Groups • 1001-5000 employees • Est. 2012 • Trust A • Hiring 9958, 99 new
HQ: Beijing, China • Advertising • Digital Media • Recommendation Systems • Video & Photo Sharing • Consumer Internet Groups • 1001-5000 employees • Est. 2012 • Trust A • Hiring 9958, 99 new
ByteDance is a Chinese internet technology company founded in Beijing in 2012 that operates some of the world's largest content and commerce platforms. Its portfolio includes the short-video apps TikTok and Douyin, the news aggregator Toutiao, the video editor CapCut, the workplace suite Lark and the Doubao family of AI assistants and models. Recommendation systems trained on user behaviour sit at the centre of every product, and the company has grown into one of the highest-revenue private technology businesses in the world.
Liang Rubo · Co-Founder & Chief Executive Officer · decision-maker
Shou Zi Chew · Chief Executive Officer, TikTok · decision-maker
Zhang Yiming · Co-Founder · founder
No careers mailbox known
Verified live · 1 hour ago Visa sponsor 1 year ago Fading · 32%

Senior Research Engineer / Scientist - Storage for LLM

≈ $231k – $443k per year (Estimated) • Senior • In office (Seattle, United States) • PhD • Full-Time • Senior
Rust
C++
AI/ML
CUDA Toolkit
Triton Inference Server
Embeddings
TensorRT
LLM
CUDA
Triton
Edge AI
KV Cache
DeepSpeed
vLLM
Multimodal AI
SGLang
TGI
Hugging Face
NCCL
InfiniBand
NVLink
Machine Learning
DevOps
gRPC
+14
Apply
Verified live · 1 hour ago Visa sponsor 1 year ago Long shot · 22%

Research Engineer / Scientist - Storage for LLM

≈ $223k – $492k per year (Estimated) • In office (Seattle, United States) • PhD • Full-Time
Rust
C++
AI/ML
CUDA Toolkit
Triton Inference Server
Embeddings
TensorRT
LLM
CUDA
Triton
Edge AI
KV Cache
DeepSpeed
vLLM
Multimodal AI
SGLang
TGI
Hugging Face
NCCL
InfiniBand
NVLink
Machine Learning
DevOps
gRPC
+14
Apply
Machines can read this selection · checked 06:11 UTC
Triton Inference Server Jobs - Remote & On-site
Frequently asked questions
How many Triton Inference Server jobs are available on Alion?
There are currently 74 active listings from 54 hiring companies on Alion, refreshed daily.
What salary do Triton Inference Server jobs pay?
The average salary is around $251,933 per year based on the current listings.
Are remote options available for Triton Inference Server jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for Triton Inference Server jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.