1,996,346open jobs
118,671companies
248,415added this week
Browse all
Salary
$160k – $200k per year
Location
In office (San Francisco, Los Angeles)
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 27, 2026. First seen by Alion on Aug 17, 2026. Vast.ai scores C on the Alion truth index.

Overview
Company
Impact
Profile match
Vast.ai is an American cloud computing company founded in 2018 that runs a marketplace for renting GPU compute. Owners of idle graphics hardware, from individual hosts to full data centres, list capacity on the platform, and customers rent it for machine learning training, inference and rendering through a real-time bidding and search model priced below traditional cloud providers. The company is headquartered in Los Angeles, California, United States.

About Vast.ai

Vast.ai runs one of the largest GPU marketplaces in the world. Over 20,000 GPUs, from RTX 4090s up to B300s, rented by more than 25,000 customers a month who train, fine-tune, and serve AI models on them. We are profitable, the team is flat, and we ship quickly. Your application goes straight to the hiring team.

The role

This is an engineering job that happens in public. You will be our heaviest user.

Most of your week goes to renting GPUs on Vast and building things on them. Serving open source models with vLLM and SGLang. Fine-tuning. Running ComfyUI pipelines. Keeping live inference endpoints up, including token endpoints on markets like OpenRouter. Writing the example repos, Docker templates, and benchmarks that other developers copy.

The rest of your week is spent showing your work. Short videos, technical write-ups, answers in Discord and on Reddit, hackathons. You are not building the Vast product. You are using it harder than any of our customers, in the open, and reporting back everything that breaks.

If you want a content calendar and a campaign plan, this is the wrong job. If you already spin up GPUs on weekends because you want to see whether the new model actually runs, keep reading.

What you'll do

  • Run real workloads on Vast every week. Deploy, fine-tune, and serve open source models, and keep live endpoints running.

  • Build public example repos, Docker templates, and benchmarks that developers can clone and use.

  • Turn what you build into teaching: guides, short videos, talks, livestreams.

  • Be the most technically credible voice in our Discord, on Reddit, and on X.

  • Represent Vast at hackathons and conferences, roughly one trip a month.

  • Report the friction, the breakage, and the missing docs straight to engineering and product.

What we need to see

  • You can take an open source model from Hugging Face to a running endpoint on rented GPUs with nobody helping you. Linux, Docker, Python, SSH.

  • You can debug the GPU stack. Driver and CUDA mismatches, out of memory errors, and multi-GPU configuration including NCCL and topology issues do not scare you.

  • Public proof of work you have shipped. A GitHub profile, technical writing, or live projects. We will ask you to walk us through code you wrote and explain the parts that went wrong.

  • You work without a roadmap and prefer it that way. Nobody here will hand you a task list.

  • You can explain a hard thing clearly, in writing and out loud.

Nice to have

  • Content or side projects that found a real audience.

  • Previous developer relations, community, or customer-facing work. Useful here, but it is a bonus and not the job.

  • vLLM or SGLang internals, distributed training with FSDP or DeepSpeed, CUDA.

  • Time at a cloud, GPU, AI infrastructure, or developer tools company.

First 90 days

  • Ship several public example projects on Vast, including at least one live serving endpoint.

  • Publish benchmarks or guides that developers actually use and pass around.

  • Become the recognizable technical voice in our community channels.

  • Represent Vast at a sponsored hackathon.

Compensation & benefits

$160,000 to $200,000 base, plus equity and bonus. Health, dental, vision, and life insurance. 401(k) with company match. Meals on site. Travel and conference budget. This role is on site in San Francisco or Los Angeles.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,996,346 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Product
Similar stack
Same company
San Francisco
$140k – $210k per year • Equity • In office • Full-Time • 5+ years exp • Bachelor's Degree • Pleasanton
AI/ML
Cursor
AI Agents
Apply
$244k – $365k per year • Equity • Hybrid • Full-Time • 15+ years exp • Bachelor's Degree • Atlanta • Boulder • Pleasanton • San Francisco
Apply
$105k – $195k per year • Equity • Hybrid • Full-Time • 6+ years exp • New York
AI/ML
Model Context Protocol
LLM
Cybersecurity
SOC 2
Least Privilege
SBOM
DLP
Apply
$58k – $101k per year • Hybrid • Full-Time • 4+ years exp • Bachelor's Degree • Health
Apply
≈ $134k – $238k per year (Estimated) • Remote (United States) • Nationals only • Full-Time • 5+ years exp • High School Diploma • United States
DevOps
CI/CD
Management
Scrum
Apply
≈ $125k – $257k per year (Estimated) • In office • 5+ years exp • Bachelor's Degree • Newark
Python
C#
C++
Databases
MS SQL
Design
AutoCAD
Apply
Engineer II 5 days ago
$85k – $125k per year • In office • Bachelor's Degree • Saint Louis
Python
C#
C++
Apply
Engineer II 5 days ago
≈ $68k – $124k per year (Estimated) • In office • 4+ years exp • Bachelor's Degree • Newark
Python
C#
C++
Apply
Engineer I 5 days ago
≈ $59k – $107k per year (Estimated) • In office • 2+ years exp • Bachelor's Degree • Ashland
Python
C#
C++
Apply
≈ $68k – $125k per year (Estimated) • In office • 4+ years exp • Bachelor's Degree • Columbus
Python
C#
C++
Apply
$170k – $240k per year • In office • Full-Time • 3+ years exp • Los Angeles
Python
SQL
C++
Databases
PostgreSQL
Redis
AI/ML
AI Agents
DevOps
Rest API
Terraform
AWS
Docker
Linux
Apply
Head of Sales 1 month ago
$140k – $185k per year • Equity • In office • Full-Time • 8+ years exp • Los Angeles
Marketing
HubSpot
Apply
Controller 2 months ago
$200k – $275k per year • In office • Full-Time • 10+ years exp • Los Angeles
SQL
Management
Stripe
Apply
$90k – $150k per year • In office • Full-Time • Los Angeles
Python
Bash
AI/ML
TensorFlow
PyTorch
LLM
CUDA
DevOps
Docker Compose
VMWare
Debian
Prometheus
Docker
Ubuntu
Grafana
Proxmox VE
KVM
CentOS Stream
Linux
DNS
DHCP
VPN
VLAN
Apply
$90k – $150k per year • In office • Full-Time • Los Angeles
Python
Bash
AI/ML
TensorFlow
PyTorch
LLM
CUDA
DevOps
Docker Compose
VMWare
Debian
Prometheus
Docker
Ubuntu
Grafana
Proxmox VE
KVM
CentOS Stream
Linux
DNS
DHCP
VPN
VLAN
Apply
≈ $144k – $307k per year (Estimated) • In office • San Francisco
DevOps
GCP
AWS
GitHub
Apply
≈ $128k – $250k per year (Estimated) • In office • 5+ years exp • Bachelor's Degree • San Francisco
Apply
Head of Product 1 day ago
$175k – $300k per year • In office • Full-Time • 6+ years exp • San Francisco
Apply
≈ $123k – $246k per year (Estimated) • In office • 6+ years exp • Bachelor's Degree • San Francisco
DevOps
GCP
Apply
$101k – $115k per year • In office • Full-Time • 2+ years exp • Bachelor's Degree • McLean • San Francisco • Richmond • Chicago • New York
SQL
AI/ML
Machine Learning
Apply
See all jobs
This is one of many
1,996,346 more open roles from verified company boards, updated every day.