Technical Product Manager, Infrastructure
About Us
Vast.ai's cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing-reshaping our future for the benefit of humanity.
We are a growing and highly motivated team dedicated to an ambitious technical plan. Our structure is flat, our ambitions are out-sized, and leadership is earned by shipping excellence.
About the Role
Vast.ai is seeking a Technical Product Manager to drive the backend our GPU cloud marketplace runs on. This is the software behind every live GPU rental (over 700k transactions a month): the daemon on every host's machines, the orchestration that powers each instance, and the infrastructure and test systems that let us ship it all at high velocity.
The Scale: With over 20k GPUs, our AI cloud platform powers thousands of bleeding-edge training runs and critical production workloads for 120k+ developers all over the planet. This is a product with real scale, real data, and real users from day one. The work you ship moves tangible revenue in weeks, not quarters.
The Challenge: We don't own the GPUs. Thousands of independent hosts price and operate them, and no two machines are alike. Your job is to make that heterogeneous, decentralized supply behave like the top-tier cloud our customers expect: fast, secure, and reliable.
What You'll Own
You'll drive the infrastructure, security, and reliability roadmap: sequencing competing priorities, turning non-functional requirements into specs engineering can build, and seeing them through until they ship. You'll own the metrics that prove it worked: platform uptime, fleet reliability, cost-to-serve. Initial focus areas:
Scalability & performance. Keep the core systems fast and ahead of demand as the marketplace grows, from database performance to end-to-end latency.
Security, trust & compliance. Harden the platform against attacks and abuse, and build the compliance roadmap enterprise customers need.
Observability & infra tooling. Give every engineer a clear view of platform health, and every host a clear view of their fleet. Own the metrics, tracing, and tooling behind it.
Ideal Experience
3+ years as a backend engineer AND 3+ years in product management
Hands-on experience with several of: security, scalability, reliability at scale, infrastructure tooling, distributed systems, observability, abuse/fraud prevention, compliance
Industry experience in one or more of the following areas: software infrastructure, developer tooling (APIs, SDKs, CLIs), AI/ML, cloud computing, GPUs, or two-sided marketplaces
Experience at a fast-paced startup or rapid-growth team
You Are
AI-native. You work with AI agents every day, and you want to build the compute layer the AI era runs on.
Deeply technical. You came up as an engineer, and you reason about scalability, security, and efficiency as product concerns, not afterthoughts.
Persuasive across the stack. You can make a technical tradeoff legible to c-suite and a thankless migration compelling to the team doing it.
Biased toward action. You'd rather ship the fix today than present the plan next week.
Tech Stack
Python, C++, SQL/PostgreSQL, Redis, Linux, Docker, AWS, Terraform, REST APIs, LLMs/AI agents
Interview Process
Initial screening (virtual)
Deep dive on the role and your experience (virtual)
Live product and technical assessment (virtual)
In person panel interview + product and technical assessment (on-site)
Annual Salary Range
$170,000-$240,000 base depending on experience, plus equity. We're profitable, venture-backed, and growing, so the equity is a stake in a real company with a real valuation, not a lottery ticket.
Benefits
Comprehensive health, dental, vision, and life insurance
401(k) with company match
Meaningful early-stage equity
Onsite meals, snacks, and close collaboration with founders/tech leaders
Ambitious, fast-paced startup culture where initiative is rewarded
Ample AI agent budget
LOCATION: On-site at our office in Los Angeles (Westwood).