NCCL Jobs - Remote & On-site

NCCL jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $310,278/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Executive
Networking
Product
Design
Analytics
Support
Enterprise Apps
Quantum

Radical Numerics

radicalnumerics.ai
Radical Numerics is an artificial intelligence research lab dedicated to developing general biological intelligence and generative genomics models. Headquartered in San Francisco, California, the company builds multimodal platforms capable of reading, writing, and engineering biological sequences across DNA, RNA, and proteins. Its technology aims to accelerate biopharmaceutical research, enhance early disease diagnostics, and establish robust biodefense capabilities.
radicalnumerics.ai • HQ: San Francisco, United States
HQ: San Francisco, United States
Verified live · 1 day ago 3 months ago

Member of Technical Staff, Distributed Systems

$191k – $388k per year (Estimated) • Staff+ • In office (San Francisco, United States, Tokyo, Japan) • Full-Time • Staff
C++
Python
Rust
C++
PyTorch C++
AI/ML
CUDA
CUDA Toolkit
PyTorch
Triton
Multimodal AI
Megatron-LM
NCCL
DevOps
Kubernetes
SLURM
Apply
Report
Chan Zuckerberg Biohub is a non-profit biomedical research organization headquartered in San Francisco, California, and founded in 2016 by the Chan Zuckerberg Initiative. The organization runs interdisciplinary research programs in imaging, infectious disease, cell biology, and AI driven biology in partnership with Stanford, UC Berkeley, and UC San Francisco. It has grown into a network of institutes with additional sites in Chicago and New York, working toward the stated goal of helping to cure, prevent, or manage all disease by the end of the century.
biohub.org • HQ: San Francisco, United States • Medical AI • Biomedical Engineering • Science & Engineering • Genomics • Health Care • Bioinformatics • Biotechnology • Artificial Intelligence • Est. 2016
HQ: San Francisco, United States • Medical AI • Biomedical Engineering • Science & Engineering • Genomics • Health Care • Bioinformatics • Biotechnology • Artificial Intelligence • Est. 2016
Open 151 dayTop 25% pay 5 months ago

Staff AI Infrastructure Engineer

$241k – $331k per year • Staff+ • 8+ years expRemote/Hybrid (Redwood City, United States) • Relocation • Staff
Bash
C++
Python
Rust
C++
PyTorch C++
AI/ML
PyTorch
CoreWeave
InfiniBand
NCCL
DevOps
ArgoCD
Cilium
eBPF
GitOps
Grafana
Helm
Kubernetes
Prometheus
SLURM
VictoriaMetrics
HPC
Apply
Report

Saviynt

saviynt.com
We're building revolutionary identity and security solutions to help the world's largest companies migrate to the cloud and solve the toughest security challenges in record time. What's our secret? Our people. We're a global group of innovators wh...
saviynt.com • San Francisco • Bengaluru • Milpitas • Delhi • Atlanta • Artificial Intelligence • Cybersecurity • Identity Management • 501-1000 employees
San Francisco • Bengaluru • Milpitas • Delhi • Atlanta • Artificial Intelligence • Cybersecurity • Identity Management • 501-1000 employees
Top 25% payVerified live · 11 hours ago 4 months ago

AI Platform Engineer, Training and Inference

$274k – $304k per year • Remote/Hybrid (Milpitas, United States) • Bachelor's Degree • Full-Time
Python
Databases
pgvector
Qdrant
PostgreSQL
AI/ML
Fine-tuning
LLM
MLFlow
ONNX
PyTorch
Quantization
RAG
Ray
Ray Serve
RLHF
RLlib
SGLang
TensorRT
vLLM
Triton
Flyte
FSDP
GRPO
NCCL
PPO
AWQ
Bitsandbytes
GPTQ
Post-training
DevOps
Google GKE
Vector
GCP
Kubernetes
Amazon S3
QA
k6
Apply
Report

Virtu Financial

virtu.com
Virtu Financial is a market maker and execution services firm operating across asset classes. Its technology provides liquidity on hundreds of venues worldwide. The company also sells analytics and agency execution tools to institutions.
virtu.com • HQ: New York, United States • Venues • Est. 2008
HQ: New York, United States • Venues • Est. 2008
Open 174 daysTop 25% pay 6 months ago

Machine Learning Engineer

$200k – $300k per year • Senior • 5+ years expIn office (New York, United States) • Senior
C++
Java
Python
C++
PyTorch C++
AI/ML
Dagster
Polars
Prefect
PyTorch
NCCL
Time Series Forecasting
DevOps
SLURM
HPC
Apply
Report

Harmonic

harmonic.fm
Built for Artists. Curated by Fans. Create your own record store now.
harmonic.fm • Palo Alto • London • Publishing • Commerce • Marketplaces
Palo Alto • London • Publishing • Commerce • Marketplaces
Open 116 daysTop 25% pay 4 months ago

Research Engineer, Training & Inference

$200k – $450k per year • Senior • 5+ years expIn office (Palo Alto, United States) • Bachelor's Degree • Full-Time • Senior
Python
C++
C++
PyTorch C++
TensorFlow C++
AI/ML
CUDA
CUDA Toolkit
JAX
LLM
PyTorch
Reinforcement Learning
TensorFlow
NCCL
Triton
FSDP
Apply
Report

Blockchain Capital

blockchaincapital.com
Blockchain Capital is one of the earliest dedicated digital asset venture firms, founded in 2013 in San Francisco. It has invested across many funds in exchanges, infrastructure, decentralised finance and consumer applications. The firm was also a pioneer of tokenised fund structures, issuing a security token to represent limited partner interests.
blockchaincapital.com • HQ: San Francisco, United States • Blockchain & Crypto • Est. 2013
HQ: San Francisco, United States • Blockchain & Crypto • Est. 2013
Open 116 daysVerified live · 28 min ago 4 months ago

Senior AI Compute Infrastructure Engineer

$90k – $170k per year (Estimated) • Senior • 5+ years expPanama • Remote (United Kingdom, Argentina, Brazil, Bulgaria, Canada) • Full-Time • Senior
Python
C++
Rust
AI/ML
KServe
Ray
Ray Serve
TensorRT
Triton
Triton Inference Server
vLLM
TorchServe
CUDA
CUDA Toolkit
DeepSpeed
AWS Trainium
FSDP
Megatron-LM
NCCL
TPU
DevOps
Kubernetes
AWS
Apply
Report

Hyperbolic

hyperbolic.ai
Hyperbolic runs an open access cloud that aggregates idle GPUs into affordable capacity for artificial intelligence training and inference. Founded in 2023 by researchers from Berkeley and the University of Washington, it offers both raw compute rental and hosted open model endpoints. The company aims to keep frontier-scale experimentation available outside the large hyperscalers.
hyperbolic.ai • HQ: San Francisco, United States • Artificial Intelligence • Hardware • AI Infrastructure • 51-200 employees • Est. 2023
HQ: San Francisco, United States • Artificial Intelligence • Hardware • AI Infrastructure • 51-200 employees • Est. 2023
Open 137 daysVerified live · 1 hour ago 5 months ago

Forward Deployed Infrastructure Engineer - Eastern US

In office • Full-Time
InfiniBand
NCCL
DevOps
Grafana
Kubernetes
Prometheus
SLURM
Ansible
Terraform
Apply
Report

Perplexity AI

perplexity.ai
Perplexity AI is an American company that builds an answer engine combining live web search with large language models to return sourced, conversational responses instead of a list of links. Its products span a consumer assistant on web and mobile, the Comet browser, enterprise search over internal documents and the Sonar developer API that exposes the same grounded retrieval stack. Founded in 2022 in San Francisco by former researchers and engineers from OpenAI, Meta and Databricks, the company is backed by NVIDIA, IVP, New Enterprise Associates and SoftBank.
perplexity.ai • HQ: San Francisco, United States • AI Agents • Internet Services • Artificial Intelligence • Search Engines • LLM & Generative AI • 1001-5000 employees • Est. 2022
HQ: San Francisco, United States • AI Agents • Internet Services • Artificial Intelligence • Search Engines • LLM & Generative AI • 1001-5000 employees • Est. 2022
Open 140 daysTop 25% pay 5 months ago

Member of Technical Staff (AI Inference Engineer)

$220k – $485k per year • Staff+ • 3+ years expIn office (San Francisco, New York, Palo Alto, United States) • Full-Time • Staff
Python
Rust
AI/ML
CUDA Toolkit
Multimodal AI
Perplexity
CUDA
Triton
JAX
LLM
PyTorch
Quantization
TensorFlow
InfiniBand
NCCL
NVLink
Frontend
Sass
DevOps
API Gateway
Kubernetes
Apply
Open 140 daysVerified live · 2 hours ago 5 months ago

Member of Technical Staff (AI Inference Engineer)

$161k – $354k per year (Estimated) • Staff+ • 3+ years expIn office (London, United Kingdom) • Full-Time • Staff
Python
Rust
AI/ML
CUDA Toolkit
Multimodal AI
Perplexity
CUDA
Triton
JAX
LLM
PyTorch
Quantization
TensorFlow
InfiniBand
NCCL
NVLink
Frontend
Sass
DevOps
API Gateway
Kubernetes
Apply
Report

Dyna Robotics

dynarobotics.com
Dyna Robotics is a robotics foundation model company headquartered in Redwood City, California, and founded in 2024. The company trains general purpose manipulation models that let a single robot arm learn commercial tasks such as folding, packing, and handling from demonstration rather than explicit programming. It targets repetitive physical work in laundries, restaurants, and light manufacturing, and publishes model progress through its DYNA series of releases.
dynarobotics.com • HQ: Redwood City, United States • Multimodal AI • Service & Hospitality Robotics • Robotics AI • Artificial Intelligence • Robotic Software & Control Systems • Robotics • 51-200 employees • Est. 2024
HQ: Redwood City, United States • Multimodal AI • Service & Hospitality Robotics • Robotics AI • Artificial Intelligence • Robotic Software & Control Systems • Robotics • 51-200 employees • Est. 2024
Open 153 daysTop 25% pay 6 months ago

ML Infrastructure Engineer, Training

$220k – $320k per year • Senior • 7+ years expIn office (Redwood City, United States) • Full-Time • Senior
Accelerate
DeepSpeed
Knowledge Distillation
Multimodal AI
PyTorch
Quantization
TensorRT
Triton
FSDP
NCCL
DevOps
AWS
GCP
Kubernetes
SLURM
HPC
Apply
Report

Parspec

parspec.io
Parspec is a technology company that leverages AI to help sales agents and distributors by simplifying the process of discovering and sourcing the best available construction products and materials.
parspec.io • Bengaluru • San Mateo • Commerce • Marketplaces • Artificial Intelligence • Est. 2020
Bengaluru • San Mateo • Commerce • Marketplaces • Artificial Intelligence • Est. 2020
Open 175 daysVerified live · 1 day ago 6 months ago

AI Ops Engineer

$30k – $75k per year (Estimated) • Senior • 5+ years expIn office (Bengaluru, India) • Bachelor's Degree • Full-Time • Senior
Python
Python
Asyncio
FastAPI
Databases
Apache Kafka
pgvector
Pinecone
Weaviate
PostgreSQL
Qdrant
AI/ML
AWS Bedrock
Kubeflow
LiteLLM
LLM
MLFlow
Portkey
Ray
vLLM
AWQ
CUDA
CUDA Toolkit
Embeddings
GPTQ
Hallucination
Langfuse
LoRA
Prompt Engineering
PyTorch
Quantization
SGLang
TensorRT
TensorRT-LLM
Triton
Triton Inference Server
PEFT
Amazon SageMaker
AWS Trainium
LLM Guardrails
LLMOps
NCCL
NVLink
TGI
Multimodal AI
AI Agents
DevOps
AIOps
Amazon EC2
Amazon EKS
ArgoCD
AWS
AWS Lambda
CI/CD
CloudFormation
Docker
GitHub Actions
Grafana
Kubernetes
OpenTelemetry
Prometheus
Terraform
Vector
Karpenter
Platform Engineering
Amazon EventBridge
Amazon S3
API Gateway
IAM
AWS Step Functions
GitHub
Cybersecurity
Least Privilege
Apply
Report

Baseten

baseten.co
Baseten is an AI infrastructure platform designed to help developers and machine learning teams deploy, serve, and scale open-source and custom AI models. The platform provides performant, low-latency inference infrastructure alongside developer tools like Truss, an open-source model packaging framework. Headquartered in San Francisco, California, Baseten enables companies to run state-of-the-art models in production seamlessly without managing underlying cloud infrastructure.
baseten.co • HQ: San Francisco, United States • Hardware • Machine Learning • AI Infrastructure • Artificial Intelligence
HQ: San Francisco, United States • Hardware • Machine Learning • AI Infrastructure • Artificial Intelligence
Top 25% payVerified live · 10 hours ago 7 months ago

Software Engineer - GPU Networking & Distributed Systems

$165k – $330k per year • Remote/Hybrid (San Francisco, New York, United States, Toronto, Montreal, Canada) • Full-Time
C++
Python
Rust
AI/ML
Cursor
LLM
Multimodal AI
Spark
TensorRT
TensorRT-LLM
InfiniBand
NCCL
NVLink
Mixture of Experts
SGLang
vLLM
DevOps
Kubernetes
Apply
Top 25% payVerified live · 10 hours ago 8 months ago

Software Engineer - Training Product

$165k – $330k per year • Senior • 5+ years expRemote/Hybrid (San Francisco, New York, United States) • Full-Time • Senior
Cursor
DeepSeek
Reinforcement Learning
vLLM
PEFT
Axolotl
DeepSpeed
Fine-tuning
LoRA
PyTorch
Synthetic Data
FSDP
Megatron-LM
NCCL
Post-training
SFT
DevOps
Kubernetes
Apply
Open 367 daysTop 25% pay 1 year ago

Software Engineer - Training Infrastructure

$165k – $330k per year • Remote/Hybrid (San Francisco, New York, United States) • Bachelor's Degree • Full-Time
Go
Python
AI/ML
Cursor
Reinforcement Learning
Spark
DeepSpeed
PyTorch
FSDP
Megatron-LM
NCCL
DevOps
AWS
DigitalOcean
GCP
Kubernetes
Apply
Report

HeyGen

heygen.com
HeyGen is a company founded in 2020 that generates presenter videos from text using synthetic avatars and cloned voices. Its translation feature re-voices existing footage in other languages while matching lip movement, which made it popular with marketing and training teams. The company reports fast revenue growth serving businesses that produce large volumes of localised video.
heygen.com • HQ: Los Angeles, United States • Semiconductors • Embedded Systems • Cybersecurity • Est. 2020
HQ: Los Angeles, United States • Semiconductors • Embedded Systems • Cybersecurity • Est. 2020
Open 319 daysVerified live · 2 days ago 11 months ago

Tech Lead, AI Compute Infrastructure

$118k – $282k per year (Estimated) • Lead • 5+ years expIn office (Los Angeles, United States) • Bachelor's Degree • Full-Time • Staff
C++
Python
C++
PyTorch C++
TensorFlow C++
Databases
LanceDB
AI/ML
Accelerate
CUDA
CUDA Toolkit
JAX
Multimodal AI
PyTorch
Ray
Spark
TensorFlow
Scale AI
Diffusion Models
NCCL
DevOps
Kubernetes
HPC
Apply
Open 272 daysVerified live · 2 days ago 9 months ago

Software Engineer, AI Compute Infrastructure

$83k – $235k per year (Estimated) • Senior • 5+ years expIn office (Los Angeles, United States) • Bachelor's Degree • Full-Time • Senior
C++
Python
C++
PyTorch C++
TensorFlow C++
Databases
LanceDB
AI/ML
Accelerate
CUDA
CUDA Toolkit
JAX
Multimodal AI
PyTorch
Ray
Spark
TensorFlow
Scale AI
Diffusion Models
NCCL
DevOps
Kubernetes
HPC
Apply
Report

Cohere

cohere.com
Cohere is a Canadian AI company founded in 2019 and headquartered in Toronto. It builds secure, enterprise-focused large language models and AI tools for businesses and regulated industries. The company is known for emphasizing privacy, private deployment, and "sovereign AI" rather than consumer chat products
cohere.com • HQ: Toronto, Canada • Energy & Utilities • Biotechnology • Natural Language Processing • LLM & Generative AI • Artificial Intelligence • 1001-5000 employees • Est. 2019
HQ: Toronto, Canada • Energy & Utilities • Biotechnology • Natural Language Processing • LLM & Generative AI • Artificial Intelligence • 1001-5000 employees • Est. 2019
Verified live · 3 hours ago 8 months ago

Software Engineer, GPU Infrastructure (HPC)

$116k – $286k per year (Estimated)Remote/Hybrid • Full-Time
Python
AI/ML
JAX
PyTorch
TensorFlow
NCCL
TPU
DevOps
Kubernetes
HPC
Apply
Verified live · 3 hours ago 9 months ago

Senior ML Systems Engineer, Frameworks & Tooling

$98k – $200k per year (Estimated) • Senior • LondonNew YorkParisSan FranciscoToronto • Remote (United States, France, United Kingdom, Canada) • Full-Time • Senior
Cohere SDK
CUDA Toolkit
JAX
LLM
Ray
CUDA
FSDP
NCCL
DeepSpeed
PyTorch
TensorRT
TensorRT-LLM
vLLM
xFormers
Megatron-LM
DevOps
Docker
Kubernetes
SLURM
HPC
Apply
Report

Basis

basis.ai
Basis is a nonprofit applied research organization with two mutually reinforcing goals. Our Mission Basis is a 501(c)(3) nonprofit applied research organization with two mutually reinforcing goals.
basis.ai • HQ: New York, United States • Biotechnology • Information Technology • Artificial Intelligence
HQ: New York, United States • Biotechnology • Information Technology • Artificial Intelligence
Verified live · 2 days ago 10 months ago

ML Systems Engineer, Infrastructure & Cloud

$144k – $315k per year (Estimated)In office (New York, Cambridge, United States) • Full-Time
JAX
PyTorch
Anthropic
FSDP
NCCL
OpenAI
DevOps
AWS
Azure
GCP
Kubernetes
Terraform
Apply
Report

Liquid AI

liquid.ai
Liquid AI is an artificial intelligence company headquartered in Boston, Massachusetts, and founded in 2023 as a spin-off from the MIT Computer Science and Artificial Intelligence Laboratory. The company builds Liquid Foundation Models, an architecture derived from liquid neural networks that aims to match transformer quality at a fraction of the memory and compute. It targets on-device and edge deployment where models must run on phones, vehicles, and embedded hardware rather than in a data center.
liquid.ai • HQ: Boston, United States • AI Infrastructure • Hardware • Machine Learning • Edge AI • LLM & Generative AI • Artificial Intelligence • Est. 2023
HQ: Boston, United States • AI Infrastructure • Hardware • Machine Learning • Edge AI • LLM & Generative AI • Artificial Intelligence • Est. 2023
Open 398 daysVerified live · 4 hours ago 1 year ago

Member of Technical Staff - Distributed Training Engineer

$199k – $404k per year (Estimated) • Staff+ • Remote/Hybrid (San Francisco, United States) • Full-Time • Staff
DeepSpeed
Multimodal AI
PyTorch
FSDP
Megatron-LM
NCCL
Mixture of Experts
Apply
Report

Yottalabs

yottalabs.com
yottalabs.com • Hong Kong • Singapore
Hong Kong • Singapore
Open 407 daysVerified live · 1 day ago 1 year ago

GPU Cloud Platform Engineer

$139k – $249k per year (Estimated) • Senior • 5+ years expHong KongSingapore • Remote (United States, Canada, Hong Kong, Singapore) • Bachelor's Degree • Full-Time • Senior
Go
Python
AI/ML
Ray
AWS Trainium
CUDA Toolkit
Quantization
SGLang
vLLM
CUDA
Triton
Hugging Face
NCCL
NVLink
DevOps
AWS
Azure
Docker
GCP
Grafana
Helm
kubectl
Kubernetes
Prometheus
Rancher
SLURM
gRPC
GitHub
Apply
Report

Magic

magic.dev
Magic is a San Francisco research company founded in 2022 that trains frontier models for software engineering. It focuses on extremely long context windows so a model can hold entire codebases and their history in working memory while making changes. The company raised large rounds from investors including Alphabet's CapitalG and Nat Friedman and builds its own training infrastructure.
magic.dev • HQ: San Francisco, United States • Machine Learning • LLM & Generative AI • Artificial Intelligence • Est. 2022
HQ: San Francisco, United States • Machine Learning • LLM & Generative AI • Artificial Intelligence • Est. 2022
Open 950 daysTop 25% pay 2 years ago

Member of Technical Staff, Kernels

$225k – $550k per year • Staff+ • In office (San Francisco, United States) • Relocation • Visa sponsorship • Full-Time • Staff
Triton
NCCL
Pre-training
TPU
Apply
Report
NCCL Jobs - Remote & On-site
Frequently asked questions
How many NCCL jobs are available on Alion?
There are currently 176 active listings from 78 hiring companies on Alion, refreshed daily.
What salary do NCCL jobs pay?
The average salary is around $310,278 per year based on the current listings.
Are remote options available for NCCL jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for NCCL jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.