1,783,176open jobs
103,722companies
265,518added this week
Browse all
Salary
$200k – $330k per year
Location
In office (San Francisco, Los Angeles)
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 16, 2026. First seen by Alion on Jul 3, 2026. Vast.ai scores C on the Alion truth index.

Overview
Company
Impact
Profile match
Vast.ai is an American cloud computing company founded in 2018 that runs a marketplace for renting GPU compute. Owners of idle graphics hardware, from individual hosts to full data centres, list capacity on the platform, and customers rent it for machine learning training, inference and rendering through a real-time bidding and search model priced below traditional cloud providers. The company is headquartered in Los Angeles, California, United States.

About Us

Vast.ai ’s cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing-reshaping our future for the benefit of humanity.

We are a growing and highly motivated team dedicated to an ambitious technical plan. Our structure is flat, our ambitions are out-sized, and leadership is earned by shipping excellence.

We seek engineers with strong intrinsic drive, a true passion for advancing the state of the art, and a mix of architecture, coding, and communication skills.

LOCATION: On-site at our office in San Francisco or Westwood, Los Angeles.

About the Role

We’re looking for a systems engineer with HPC or parallel programming experience to help scale AI inference. You’ll leverage your knowledge of high-performance systems to optimize GPU performance at the bleeding edge of AI.

  • Full-Time

  • On-site at either our SF or LA offices

Tech Stack

CUDA/C++, GPGPU, Python, Linux

Key Responsibilities

  • Design and optimize GPU kernels and tensor libraries

  • Translate HPC techniques into scalable AI inference solutions

  • Evaluate emerging architectures and resource management approaches

  • Collaborate with technical leadership to improve GPU infrastructure efficiency

Ideal Experience

  • Advanced C++ (C++17/20 preferred)

  • Expertise with at least one parallel framework (CUDA, HIP, SYCL, OpenCL, OpenACC, or similar)

  • Strong background in systems optimization and HPC performance tooling

  • Familiarity with distributed training/inference frameworks (bonus)

Interview Process

After submitting your application, our technical team reviews your credentials. If selected, you'll proceed through the following stages:

  • 15 min - Initial screening (virtual)

  • 45 min - Quick dive into Vast, work history (virtual)

  • 45 min - Systems and architectures (virtual)

  • 1 hour - LLM-assisted coding assessment (virtual)

  • 2 hours - Meet and greet with coding assessment (on-site)

Our goal is to complete the interview process in two weeks.

Benefits

  • Comprehensive health, dental, vision, and life insurance

  • 401(k) with company match

  • Meaningful early-stage equity

  • Onsite meals, snacks, and close collaboration with founders/tech leaders

  • Ambitious, fast-paced startup culture where initiative is rewarded

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,783,176 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Similar stack
Same company
San Francisco
$280k – $310k per year • Remote (United States) • Full-Time
AI/ML
Computer Vision
Machine Learning
Apply
≈ $187k – $383k per year (Estimated) • Equity • In office • Full-Time • 5+ years exp • Bachelor's Degree • Palo Alto
Python
TypeScript
C++
AI/ML
AI Agents
LLM
Apply
$180k – $220k per year • Hybrid • Full-Time • 8+ years exp • Master's Degree • Los Angeles • Oakland • New York • Toronto
Python
SQL
AI/ML
Reinforcement Learning
PyTorch
Machine Learning
Management
Agile
Apply
Lead, AI & Automation 2 hours ago
$110k – $130k per year • Hybrid • 8+ years exp • Bachelor's Degree • Chicago
Python
JavaScript
TypeScript
AI/ML
Prompt Engineering
LLM
OpenAI
Anthropic
Agentforce
Agentic Workflows
DevOps
Rest API
GCP
Azure
AWS
Management
UiPath
Power Automate
Agile
Apply
≈ $95k – $210k per year (Estimated) • In office • Full-Time • Bachelor's Degree • St. George
Python
JavaScript
TypeScript
SQL
C#
Analytics
Power BI
Apply
$150k – $200k per year • Equity 1–2% • In office • Full-Time • 3+ years exp • Los Angeles
Python
JavaScript
TypeScript
AI/ML
AI Agents
LLM
Frontend
Next.js
React.js
DevOps
Docker
Apply
ML Engineer 13 days ago
In office • Full-Time
AI/ML
LangChain
Fine-tuning
Embeddings
Prompt Engineering
NLP
Transformers
TensorFlow
PyTorch
LLM
Hugging Face
Edge AI
Apply
Applications Engineer 13 days ago
$82k – $108k per year • In office • 2+ years exp • Bachelor's Degree • Princeton
Python
C++
AI/ML
OpenCV
NumPy
DevOps
Linux
Apply
≈ $17k – $44k per year (Estimated) • Remote (EAEU) • Full-Time • Moscow
AI/ML
LLM
DevOps
Wi-Fi
Game Dev
Meta Quest SDK
Chips/EDA
PoC Library
IoT
LoRaWAN
Zigbee
Apply
AI/ML & LLM Engineer 13 days ago
≈ $131k – $249k per year (Estimated) • Hybrid • 5+ years exp • Bachelor's Degree • Sterling
Python
Java
SQL
C#
C#
.NET
Databases
PostgreSQL
Chroma
pgvector
Pinecone
FAISS
OpenSearch
AI/ML
LangChain
LlamaIndex
Embeddings
Scikit-learn
Prompt Engineering
Function Calling
NLP
Semantic Kernel
AWS Bedrock
TensorFlow
PyTorch
LLM
RAG
Reranking
Semantic Search
OpenAI
Hugging Face
Amazon SageMaker
LLMOps
Human-in-the-Loop
Semantic Search
LLM Guardrails
Machine Learning
DevOps
Rest API
Azure
CI/CD
Git
AWS
Docker
Kubernetes
AWS Lambda
Amazon S3
Management
Agile
Scrum
Apply
$90k – $150k per year • In office • Full-Time • Los Angeles
Python
Bash
AI/ML
CUDA Toolkit
TensorFlow
PyTorch
LLM
CUDA
DevOps
Docker Compose
VMWare
Debian
Prometheus
Docker
Ubuntu
Grafana
Proxmox VE
KVM
CentOS Stream
Linux
DNS
DHCP
VPN
VLAN
Apply
AI Agent Researcher 3 months ago
$160k – $320k per year • In office • Full-Time • San Francisco • Los Angeles
Python
C++
AI/ML
CUDA Toolkit
AI Agents
LLM
CUDA
Machine Learning
Apply
$200k – $330k per year • In office • Full-Time • San Francisco • Los Angeles
Python
C++
AI/ML
CUDA Toolkit
LLM
CUDA
DevOps
Linux
Apply
Head of Sales 1 month ago
$140k – $185k per year • Equity • In office • Full-Time • 8+ years exp • Los Angeles
Marketing
HubSpot
Apply
$160k – $200k per year • In office • Full-Time • San Francisco • Los Angeles
Python
AI/ML
DeepSpeed
vLLM
CUDA Toolkit
Fine-tuning
SGLang
ComfyUI
OpenRouter
CUDA
Hugging Face
FSDP
NCCL
DevOps
Docker
GitHub
Linux
Management
Discord
Apply
≈ $134k – $248k per year (Estimated) • Equity • Remote (United States) • Full-Time • 10+ years exp • Master's Degree • San Francisco
AI/ML
TensorFlow
Triton
TorchServe
Feature Store
Machine Learning
DevOps
GCP
Platform Engineering
Apply
$131k – $145k per year • Equity • Hybrid • 4+ years exp • Bachelor's Degree • San Francisco
SQL
Apply
≈ $146k – $277k per year (Estimated) • In office • 5+ years exp • Houston • New York • San Francisco • Seattle
Python
AI/ML
Edge AI
DevOps
Prometheus
Grafana
Linux
BGP
OSPF
Apply
$86k – $107k per year • Hybrid • Full-Time • 2+ years exp • Bachelor's Degree • San Francisco • Washington
Cybersecurity
GDPR
Marketing
Salesforce
LinkedIn
SpaceTech
QGIS
Apply
$74k – $92k per year • Hybrid • Full-Time • 2+ years exp • Bachelor's Degree • Arlington • San Francisco • Washington
Cybersecurity
GDPR
Marketing
Salesforce
LinkedIn
SpaceTech
QGIS
Apply
See all jobs
This is one of many
1,783,176 more open roles from verified company boards, updated every day.