DeepInfra
deepinfra.com
As featured in
View 9 jobs
Follow
Overview
News
Technologies
Salaries
Products
People
Growth
Jobs
Financials
Overview
DeepInfra is a company founded in 2022 that runs a low-cost inference cloud for open machine learning models. Developers call hosted language, embedding, speech and image models through a simple interface and pay per token or per second without managing graphics hardware. Its focus on cheap serving of open-weight models made it popular with startups building on Llama, Mistral and Qwen.
News
Inside the Fast-Rising AI Inference Market: Five Questions Answered by an AI Research Analyst
ABI Research Principal Analyst Larbi Belkhit answers five critical questions about the AI inference market, covering key trends, companies, and challenges.
Read more
Report
Forbes Jul 2026 Vera CPU Is Strategic For Nvidia, Not A Side Show Karl Freund on why NVIDIA's Vera CPU is a deliberate play for the 200B server CPU market, purpose-built for agentic AI rather than a side project. Read article
Vera CPU Is Strategic For Nvidia, Not A Side Show
Read more
Report
DeepInfra Expands AI Inference Capacity with First International Data Center in Toronto
New cluster increases available GPU capacity for enterprises running large-scale AI inference applications
Read more
Report
DeepInfra Raises $107M Series B to Scale Inference Infrastructure
Low pay-as-you-go pricing. No long-term contracts. Simple APIs. Scale to trillions of tokens. 100+ AI models.
Read more
Report
Pro access
Upgrade to see all 20 mentions
Upgrade to a paid plan to read every media mention of this company - funding news, awards, product launches and press releases from all the outlets writing about it.
Every media mention and press release
Funding news, awards and product launches
Fresh coverage from every outlet writing about the company
Upgrade now
Cancel anytime. Secure checkout. Instant activation.
Technologies
Tech DNA
Python
C++
CUDA
PyTorch
TensorFlow
LLM
LoRA
PEFT
AI/ML
Python
C++
CUDA
CUDA Toolkit
Diffusers
Multimodal AI
PyTorch
TensorFlow
Transformers
Edge AI
NCCL
PyTorch C++
TensorFlow C++
Git
NumPy
SciPy
OpenAI
LLM
LoRA
Quantization
SGLang
vLLM
PEFT
AI Agents
InfiniBand
NVLink
Speech Recognition
Text-to-Speech
GitHub
Stack modernity
82/100
How modern this stack is, based on technology relevance, AI adoption and the share of legacy tools.
In-demand technologies
Python
9 jobs
Required
$173k
-4% vs market
C++
7 jobs
Required
$150k
-25% vs market
CUDA Toolkit
7 jobs
Required
$150k
-43% vs market
Multimodal AI
7 jobs
Required
$150k
-47% vs market
Diffusers
7 jobs
Required
$150k
-36% vs market
Transformers
7 jobs
Required
$150k
-28% vs market
TensorFlow
7 jobs
Required
$150k
-27% vs market
Git
7 jobs
Required
$150k
+25% vs market
Salary medians are calculated from this company's open jobs and compared with the market.
Industry adoption
Python
20%
AI Agents
13%
LLM
13%
Git
8%
GitHub
8%
PyTorch
7%
Share of companies in the same industry that use each technology.
Stack changes
GitHub
Aug 2026
OpenAI
Aug 2026
NCCL
Aug 2026
Edge AI
Aug 2026
Text-to-Speech
Aug 2026
Speech Recognition
Aug 2026
NVLink
Aug 2026
InfiniBand
Aug 2026
Technologies recently added to or removed from this company's stack - a signal of tech migrations and new initiatives.
NVIDIA
Qualcomm
Jobgether
Thomson Reuters
Adobe
Crusoe
Salary insights
Compensation ranges based on this company's open jobs
Median
$173k
Typical range
$150k – $195k
Open positions
2
1
Jobs
Junior
100%
| Level | Jobs | Median | Typical range |
|---|---|---|---|
| Junior | 1 | $150k | $150k |
Highest paying role
Forward Deployed Engineer
$195k
Normalized to USD per year
Growth
Hiring Momentum
38/100
Slowing
Open positions
9
0 opened / 0 closed in 30 days
ATS activity
Every ~1 days
Today
Hiring Dynamics
0%
Hiring Focus
The percentage next to each role is its share of the company's job openings over the last 90 days; the arrow shows the shift versus the previous period.
Backend
100%
Activity Timeline
Added Transformers to stack
Aug 2026
Added TensorFlow C++ to stack
Aug 2026
Added TensorFlow to stack
Aug 2026
Added SciPy to stack
Aug 2026
Added PyTorch C++ to stack
Aug 2026
Added PyTorch to stack
Aug 2026
Added NumPy to stack
Aug 2026
Added Multimodal AI to stack
Aug 2026
Added Git to stack
Aug 2026
Added Diffusers to stack
Aug 2026
Added CUDA Toolkit to stack
Aug 2026
Added CUDA to stack
Aug 2026
Jobs
$150k – $195k per year • In office • Full-Time • Palo Alto
Python
LLM
LoRA
Quantization
SGLang
vLLM
PEFT
AI Agents
InfiniBand
NVLink
Speech Recognition
Text-to-Speech
Apply
Remote • Internship • Bachelor's Degree
C++
Python
PyTorch C++
TensorFlow C++
AI/ML
CUDA
CUDA Toolkit
Diffusers
Multimodal AI
NumPy
PyTorch
SciPy
TensorFlow
Transformers
Edge AI
NCCL
OpenAI
DevOps
Git
Apply
In office • Internship • Bachelor's Degree • Palo Alto
C++
Python
PyTorch C++
TensorFlow C++
AI/ML
CUDA
CUDA Toolkit
Diffusers
Multimodal AI
NumPy
PyTorch
SciPy
TensorFlow
Transformers
Edge AI
NCCL
OpenAI
DevOps
Git
Apply
Remote • Full-Time • Bachelor's Degree
C++
Python
PyTorch C++
TensorFlow C++
AI/ML
CUDA
CUDA Toolkit
Diffusers
Multimodal AI
NumPy
PyTorch
SciPy
TensorFlow
Transformers
Edge AI
NCCL
DevOps
Git
Apply
Remote • Full-Time • 3+ years exp • Bachelor's Degree
C++
Python
PyTorch C++
TensorFlow C++
AI/ML
CUDA
CUDA Toolkit
Diffusers
Multimodal AI
PyTorch
TensorFlow
Transformers
Edge AI
NCCL
DevOps
Git
Apply
In office • Full-Time • Bachelor's Degree • Sofia
C++
Python
PyTorch C++
TensorFlow C++
AI/ML
CUDA
CUDA Toolkit
Diffusers
Multimodal AI
NumPy
PyTorch
SciPy
TensorFlow
Transformers
Edge AI
NCCL
DevOps
Git
Apply
≈ $110k – $218k per year (Estimated) • In office • Full-Time • 1+ year exp • Bachelor's Degree • Palo Alto
C++
Python
PyTorch C++
TensorFlow C++
AI/ML
CUDA
CUDA Toolkit
Diffusers
Multimodal AI
PyTorch
TensorFlow
Transformers
Edge AI
NCCL
DevOps
Git
Apply
≈ $74k – $152k per year (Estimated) • In office • Full-Time • 2+ years exp • Palo Alto
Python
GitHub
Apply
$140k – $150k per year • In office • Full-Time • Bachelor's Degree • Palo Alto
C++
Python
PyTorch C++
TensorFlow C++
AI/ML
CUDA
CUDA Toolkit
Diffusers
Multimodal AI
NumPy
PyTorch
SciPy
TensorFlow
Transformers
Edge AI
NCCL
DevOps
Git
Apply