1,710,093open jobs
102,087companies
255,163added this week
Browse all
Salary
$150k – $195k per year
Location
In office (Palo Alto)
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 16, 2026. First seen by Alion on Aug 14, 2026. DeepInfra scores C on the Alion truth index.

Overview
Company
Impact
Profile match
DeepInfra is a company founded in 2022 that runs a low-cost inference cloud for open machine learning models. Developers call hosted language, embedding, speech and image models through a simple interface and pay per token or per second without managing graphics hardware. Its focus on cheap serving of open-weight models made it popular with startups building on Llama, Mistral and Qwen.

About DeepInfra

DeepInfra is building the foundation for companies to use modern AI in production - simply, reliably, and at scale. Our team has deep experience building large systems that serve hundreds of millions of users, and we're bringing that same level of rigor to a rapidly evolving AI inference space. Our mission is to make advanced AI available to people and teams everywhere.

We're an early, tight-knit team where you can influence product direction, try bold ideas, and drive meaningful work forward quickly. If you want to join a fast-growing company at a defining moment, we'd love to talk.

DeepInfra is backed by leading investors including A.Capital, Felicis, 500 Global, Georges Harik, Samsung Next, Supermicro, Upper90, Peak6, SVAngel and Nvidia.

Why this role matters

As DeepInfra's enterprise pipeline grows, our customers need a technical partner who can run rigorous evals, defend benchmarks, and speak fluently to both engineering and procurement - someone who can own the technical win from first call through production.

This is a pioneering role. You'll work closely with Sales, our co-founders, and the engineering team on the deals that matter most. You'll own the technical win end to end: running head-to-head bake-offs against leading AI providers, tuning deployments on the latest hardware, and turning what you learn into reusable assets that make every future deal faster to close. As our first FDE, you'll also define what the function looks like as GTM scales.

What You'll Do

  • Own the technical win and the POC timeline, working closely with Sales and Engineering, from call one.
  • Design and run reproducible benchmark harnesses (TTFT, ITL, throughput/GPU, p95/p99) and quality-parity evals.
  • Run head-to-head bake-offs against leading AI providers - and win them.
  • Tune model-to-hardware deployments on B200/B300/GB300 NVL72.
  • Build cost-per-token models and write migration plans.
  • Handle enterprise security and compliance review, and get deployments to launch readiness.
  • Own account health post-signature, driving usage reviews and expansion.
  • Turn what you learn into reusable benchmark reports, reference architectures, and AE enablement material.

What You Bring

  • Customer-facing engineering with an owned technical outcome at an infrastructure or ML platform company.
  • Strong Python skills.
  • Dual-audience presence with commercial instinct - credible with a skeptical staff engineer, clear with a CFO, and able to tell a technical objection from a procurement one.

Bonus

  • Hands-on experience with inference internals: vLLM, SGLang, or TRT-LLM, batching, KV cache math, quantization.
  • Experience with agentic or coding-assistant workloads at scale.
  • Prefix-cache-heavy long context workloads.
  • Diffusion image/video, ASR/TTS, or multi-LoRA serving.
  • Open-source contributions to vLLM or SGLang.
  • Deep NVLink/InfiniBand topology knowledge.

Why DeepInfra

  • Define DeepInfra's Forward Deployed Engineering function from day one and have a direct impact on its direction.
  • Work directly with co-founders and the inference team on the deals that matter most.
  • Join a small, high-performing team where your work ships quickly and reaches customers around the world.
  • Help shape how enterprises adopt some of the world's leading open-source AI models.

How we work

Three traits define the people who thrive here, and this role leans on all three.

Initiative. We take ownership and step in where we can add value. Whether it’s starting something new, improving what exists, or helping move ideas forward, we aim to be proactive and thoughtful in how we contribute.

Drive. We’re energized by hard problems. Building AI infrastructure is complex, and we lean into that. We care about doing things well, moving fast, and continuously improving - because solving meaningful challenges is what motivates us.

Grit. Things don’t always work on the first try - and that’s expected. We stay persistent, adapt quickly, and learn as we go. We take setbacks seriously, but not personally, and use them to get better.

Compensation

The base pay range for this role is $150,000 - $195,000 per year.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,710,093 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Solutions
Similar stack
Same company
Palo Alto
$101k – $210k per year • Hybrid • 10+ years exp • Bachelor's Degree • Iselin
C
C
SDL
Management
Agile
UML
Apply
$200k – $300k per year • In office • Full-Time • 3+ years exp • San Francisco
Python
AI/ML
Machine Learning
DevOps
Terraform
GCP
Helm
Azure
AWS
Docker
Kubernetes
IAM
Linux
Apply
≈ $100k – $194k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Fort Lauderdale
Apply
≈ $194k – $425k per year (Estimated) • In office • Sunnyvale
Management
Agile
Scrum
Apply
$100k – $160k per year • In office • Full-Time • 3+ years exp • San Francisco
Python
JavaScript
TypeScript
Databases
Supabase
AI/ML
Claude
ChatGPT
Model Context Protocol
AI Agents
Frontend
Next.js
React.js
DevOps
GitHub
Apply
≈ $72k – $161k per year (Estimated) • In office • Bachelor's Degree • Berkeley Heights
Python
SQL
AI/ML
Copilot
Claude
ChatGPT
Claude Code
AI Agents
LLM Guardrails
Machine Learning
Analytics
Microsoft Excel
Apply
$160k – $200k per year • Equity • In office • Full-Time
Databases
Vespa
AI/ML
AI Agents
RAG
Machine Learning
Marketing
Spotify
LinkedIn
Apply
$292k – $371k per year • Equity • In office • Full-Time
Databases
Vespa
AI/ML
AI Agents
RAG
Machine Learning
Marketing
Spotify
LinkedIn
Apply
≈ $34k – $92k per year (Estimated) • In office • Internship • Paris
Python
AI/ML
Aider
Analytics
Power BI
Apply
Project Manager 1 day ago
In office • Full-Time • 1+ year exp • Bachelor's Degree
AI/ML
AI Agents
Management
Asana
Monday.com
Google Workspace
Microsoft Office
Apply
$90k – $110k per year • In office • Full-Time • Palo Alto
Marketing
LinkedIn
Apply
$180k – $210k per year • In office • Full-Time • 10+ years exp • Palo Alto
Python
Bash
AI/ML
InfiniBand
DevOps
Ansible
Prometheus
Kubernetes
Grafana
Proxmox VE
KVM
OpenStack
Linux
BGP
Apply
In office • Internship • Bachelor's Degree • Sofia
Python
C++
C++
TensorFlow C++
PyTorch C++
AI/ML
CUDA Toolkit
SciPy
Multimodal AI
Diffusers
Transformers
TensorFlow
NumPy
PyTorch
CUDA
OpenAI
NCCL
Edge AI
Machine Learning
DevOps
Git
Management
Agile
Apply
In office • Full-Time • Bachelor's Degree • Sofia
Python
C++
C++
TensorFlow C++
PyTorch C++
AI/ML
CUDA Toolkit
SciPy
Multimodal AI
Diffusers
Transformers
TensorFlow
NumPy
PyTorch
CUDA
NCCL
Edge AI
DevOps
Git
Management
Agile
Apply
≈ $17k – $36k per year (Estimated) • In office • Full-Time • 2+ years exp • Sofia
Python
AI/ML
Function Calling
Speech Recognition
LLM
Text-to-Speech
Structured Outputs
Prompt Caching
Tool Use
DevOps
Rest API
Loki
Prometheus
Grafana
Apply
$134k – $150k per year • In office • 5+ years exp • Bachelor's Degree • Palo Alto
Apply
$120k – $150k per year • In office • Contractor • 2+ years exp • Palo Alto
JavaScript
TypeScript
AI/ML
Claude Code
Frontend
Redux
Tailwind CSS
React.js
React Query
CSS Modules
Design
Figma
Apply
$190k – $250k per year • Hybrid • Full-Time • 4+ years exp • Palo Alto
Cybersecurity
GDPR
Apply
$190k – $260k per year • Hybrid • Full-Time • 4+ years exp • Palo Alto
Cybersecurity
GDPR
Apply
$40k – $46k per year • In office • Part-Time • High School Diploma • Palo Alto
Apply
See all jobs
This is one of many
1,710,093 more open roles from verified company boards, updated every day.