1,788,870open jobs
103,847companies
267,983added this week
Browse all
Salary
$200k – $330k per year
Location
In office (San Francisco, Los Angeles)
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 16, 2026. First seen by Alion on Jul 3, 2026. Vast.ai scores C on the Alion truth index.

Overview
Company
Impact
Profile match
Vast.ai is an American cloud computing company founded in 2018 that runs a marketplace for renting GPU compute. Owners of idle graphics hardware, from individual hosts to full data centres, list capacity on the platform, and customers rent it for machine learning training, inference and rendering through a real-time bidding and search model priced below traditional cloud providers. The company is headquartered in Los Angeles, California, United States.

About Us

Vast.ai ’s cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing-reshaping our future for the benefit of humanity.

We are a growing and highly motivated team dedicated to an ambitious technical plan. Our structure is flat, our ambitions are out-sized, and leadership is earned by shipping excellence.

We seek engineers with strong intrinsic drive, a true passion for advancing the state of the art, and a mix of architecture, coding, and communication skills.

LOCATION: On-site at our office in San Francisco or Westwood, Los Angeles.

About the Role

As a systems/GPU engineer, you will play a crucial role in developing new kernels and algorithms that can improve inference for AI models. You will help develop new high-performance tensor libraries and auto-optimization tools. Collaborating directly with our technical founder and diverse team, you will enhance the performance and efficiency of our AI systems. Your ability to research and stay on top of cutting-edge papers will be vital in staying up-to-date with the latest advancements in AI model inference and GPU programming techniques.

  • Full-Time

  • On-site at either our SF or LA offices

Tech Stack

C++/CUDA, GPGPU, Python, Linux

Ideal Experience

  • Expertise in systems engineering across the tech stack

  • Deep understanding of GPU architectures

  • Strong holistic background in neural network performance and tooling

  • Published research at top AI conferences

Key Responsibilities

  • Develop or extend parallel generic GPU libraries and kernels

  • Help design and deploy market-based resource management systems

  • Quickly investigate and summarize options for new system architectures

  • Prototype and evaluate novel state-of-the-art methods/models

  • Investigate and learn new frameworks and tools

Interview Process

After submitting your application, our technical team reviews your credentials. If selected, you'll proceed through the following stages:

  • 15 min - Initial screening (virtual)

  • 45 min - Quick dive into Vast, work history (virtual)

  • 45 min - Systems and architectures (virtual)

  • 1 hour - LLM-assisted coding assessment (virtual)

  • 2 hours - Meet and greet with coding assessment (on-site)

Our goal is to complete the interview process in two weeks.

Benefits

  • Comprehensive health, dental, vision, and life insurance

  • 401(k) with company match

  • Meaningful early-stage equity

  • Onsite meals, snacks, and close collaboration with founders/tech leaders

  • Ambitious, fast-paced startup culture where initiative is rewarded

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,788,870 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Similar stack
Same company
San Francisco
$110k – $204k per year • Equity • Hybrid • Full-Time • Frisco • Toronto
AI/ML
AI Agents
AWS Bedrock
LLM
AWS Bedrock AgentCore
DevOps
AWS
Progressive Delivery
Apply
≈ $95k – $209k per year (Estimated) • In office • Full-Time • 1+ year exp • Master's Degree • Pittsburgh
Python
Verilog
C++
SystemVerilog
MATLAB
DevOps
Linux
Apply
≈ $101k – $182k per year (Estimated) • Equity • Remote (United States) • Full-Time • 6+ years exp • Chicago
Python
AI/ML
Fine-tuning
Embeddings
Scikit-learn
Prompt Engineering
AI Agents
TensorFlow
Pandas
NumPy
PyTorch
LLM
RAG
Hallucination
LLMOps
Multi-Agent Systems
Machine Learning
DevOps
GCP
Azure
AWS
Apply
$90k – $320k per year • Remote (United States)
Apply
$200k – $280k per year • Hybrid • 6+ years exp • Bachelor's Degree • Mountain View
AI/ML
Fine-tuning
Reinforcement Learning
AI Agents
TensorFlow
PyTorch
LLM
Knowledge Graph
Machine Learning
DevOps
GitHub
Cybersecurity
GDPR
Management
ServiceNow
Microsoft Teams
Apply
≈ $176k – $317k per year (Estimated) • In office • 10+ years exp • Bachelor's Degree • San Jose
AI/ML
Fine-tuning
LocalAI
LLM
Apply
≈ $76k – $191k per year (Estimated) • In office • Full-Time • 5+ years exp • PhD • Seoul
AI/ML
AI Agents
LLM
Agentforce
Machine Learning
Management
Outlook
Agile
Marketing
Salesforce
Apply
$160k – $220k per year • Hybrid • Full-Time • 3+ years exp • San Francisco
Python
Python
FastAPI
Databases
PostgreSQL
AI/ML
LLM
DevOps
AWS
Docker
Apply
≈ $122k – $229k per year (Estimated) • Remote (United States) • Contractor • 5+ years exp • United States
Python
JavaScript
TypeScript
AI/ML
LangGraph
LangChain
Model Context Protocol
AI Agents
LLM
OpenAI
Anthropic
A2A
DevOps
Rest API
GCP
Azure
AWS
TCP/IP
DNS
Cybersecurity
PKI
Apply
$47k – $66k per year (gross) • In office • Full-Time • 1+ year exp • Singapore
Python
Java
SQL
C++
C++
PyTorch C++
AI/ML
OpenCV
CUDA Toolkit
Embeddings
Computer Vision
Transformers
PyTorch
LLM
RAG
Semantic Search
Image Segmentation
CUDA
Semantic Search
Machine Learning
DevOps
Linux
Robotics
Localization
Apply
$90k – $150k per year • In office • Full-Time • Los Angeles
Python
Bash
AI/ML
CUDA Toolkit
TensorFlow
PyTorch
LLM
CUDA
DevOps
Docker Compose
VMWare
Debian
Prometheus
Docker
Ubuntu
Grafana
Proxmox VE
KVM
CentOS Stream
Linux
DNS
DHCP
VPN
VLAN
Apply
$200k – $330k per year • In office • Full-Time • San Francisco • Los Angeles
Python
C++
AI/ML
CUDA Toolkit
OpenCL
LLM
CUDA
DevOps
HPC
Linux
Apply
AI Agent Researcher 3 months ago
$160k – $320k per year • In office • Full-Time • San Francisco • Los Angeles
Python
C++
AI/ML
CUDA Toolkit
AI Agents
LLM
CUDA
Machine Learning
Apply
Head of Sales 1 month ago
$140k – $185k per year • Equity • In office • Full-Time • 8+ years exp • Los Angeles
Marketing
HubSpot
Apply
$160k – $200k per year • In office • Full-Time • San Francisco • Los Angeles
Python
AI/ML
DeepSpeed
vLLM
CUDA Toolkit
Fine-tuning
SGLang
ComfyUI
OpenRouter
CUDA
Hugging Face
FSDP
NCCL
DevOps
Docker
GitHub
Linux
Management
Discord
Apply
≈ $134k – $248k per year (Estimated) • Equity • Remote (United States) • Full-Time • 10+ years exp • Master's Degree • San Francisco
AI/ML
TensorFlow
Triton
TorchServe
Feature Store
Machine Learning
DevOps
GCP
Platform Engineering
Apply
$131k – $145k per year • Equity • Hybrid • 4+ years exp • Bachelor's Degree • San Francisco
SQL
Apply
≈ $146k – $277k per year (Estimated) • In office • 5+ years exp • Houston • New York • San Francisco • Seattle
Python
AI/ML
Edge AI
DevOps
Prometheus
Grafana
Linux
BGP
OSPF
Apply
$86k – $107k per year • Hybrid • Full-Time • 2+ years exp • Bachelor's Degree • San Francisco • Washington
Cybersecurity
GDPR
Marketing
Salesforce
LinkedIn
SpaceTech
QGIS
Apply
$74k – $92k per year • Hybrid • Full-Time • 2+ years exp • Bachelor's Degree • Arlington • San Francisco • Washington
Cybersecurity
GDPR
Marketing
Salesforce
LinkedIn
SpaceTech
QGIS
Apply
See all jobs
This is one of many
1,788,870 more open roles from verified company boards, updated every day.