Overview
News
Technologies
Salaries
Products
People
Growth
Offices
Jobs
Financials

Funding and backers

Team
17
US Form 5500 (plan participants) · Dec 2024
Hiring now
4
open roles
Backers
1
Fusion Fund
Momentum
15/100
in the news
Last sign of life
1 mo ago
a posting or a news item
The story so fareach stage dated by its source: the company's releases, the press, registers, filings
Jul 24, 2025 On the Hacker News front page A GPU Calculator That Helps Calculate What GPU to Use · 108 points
Tractionpublic signals, read monthly
Web presence
top 5%
of 133.2M domains by links, Common Crawl
Hacker News stories
1
best: 108 points
Backed byfrom the funds' portfolios and accelerator catalogs
Investors in similar startupsfunds that back the companies most like this one
Similar startupsby what they do, their industry and backers
OpenRelay provides hosted model inference and dedicated GPU VMs, with per-token and usage-based pricing.
Access flexible GPU infrastructure for inference, fine-tuning, rendering, simulation, and media workloads. Theta EdgeCloud combines managed…
The fastest inference for open models. Agents search kernel, engine, and decode configurations against your real traffic, giving you 2-3x…
Prem AIVenture round $5.5M · 10 mo ago • Founded 2023 • 11-50 employees
Prem delivers sovereign AI that is verifiable, private, and compounding: frontier models on encrypted GPUs, and sovereign agents that turn…
Kog LabsFounded 2023 • 11-50 employees • 2 roles
Kog Labs builds a co-designed inference stack for real-time AI agents on standard datacenter GPUs, spanning model architecture, inference…
CerebriumSeed $8.5M · 15 mo ago • Founded 2021 • 11-50 employees
Deploy voice agents, video models, and LLMs on serverless GPUs with sub-second cold starts. Pay-per-second pricing. No Kubernetes.

How Inference hires

Truth index
B 75/100
Ghost roles
0%
Stale roles
100%
Reposted roles
0%

Inference scores B on the Alion truth index (A is best, E worst), measured over 4 open roles re-checked against its own hiring board: 0% look like ghost listings, 100% have gone stale and 0% are the same role posted again. It measures how much of what this employer publishes turns into a real, finite search - not the employer as a workplace. How the index is computed

Visa sponsorship

  • United States · Filed H-1B visas in the last two years

Visa details by country

Overview

Models. Agents. GPUs. Whatever you need — we've got it. Ghost agent VMs, Maestro model routing, Engine wholesale GPUs, and Academy, on one platform.

News

News Ventureburn 2 months ago
NVIDIA-Backed Groq Raises $350 Million To Build the World's Leading AI Inference Cloud
Groq raises $350 Million at $3.5B backed by Nvidia. The AI chip startup now focuses on inference after licensing its core tech to Nvidia.
Read more
Report
News nextplatform 2 months ago
Cerebras Overclocks WSE-3 Waferscale Engine To Boost Inference Oomph In
Everybody has been expecting for Cerebras Systems, one of the second-generation of AI hardware start ...
Read more
Report
News Baseten 2 months ago
Inference Engineering Baseten Books
Inference Engineering by Philip Kiely is your guide to the hardware, software, techniques, and infrastructure required to run AI models in production.
Read more
Report
News SiliconANGLE 2 months ago
Inference chip startup Etched raises $700M more at $21B valuation
Inference chip startup Etched raises $700M more at $21B valuation - SiliconANGLE
Read more
Report
News StorageReview.com 2 months ago
Sandisk Tapes Out Its First HBF Memory Die, Targets 2027 for Inference Product Samples
Sandisk taped out its first HBF memory die and now lists first High Bandwidth Flash inference product samples as coming in 2027.
Read more
Report
News markets.businessinsider.com 2 months ago
Defiance Launches AINF: An ETF Dedicated to AI Inference Chips
MIAMI, Aug. 18, 2026 (GLOBE NEWSWIRE) -- Defiance ETFs, a leader in thematic and income ETFs, today announced the launch of the Defiance Inferen...
Read more
Report
News Groq 2 months ago
Groq Closes $350 million Series A, Building the World's Leading AI Inference Cloud
Groq is the premier neocloud for fast inference. One fully integrated platform for infrastructure, inference, and control. Millions of developers run trillions of tokens on Groq every week.
Read more
Report
Show more news

Tech stack

Technologies named in job postings at Inference over the last 12 months, by layer, with the share of postings for each.
Technologies in use
38
Postings analysed
3
Stack modernity
84/100AI adopter
Languages
C#
C++
Python
Frameworks & libraries
PyTorch
DeepSpeed
Transformers
CUDA
Cloud & platforms
.NET
GitHub
Hugging Face
CUDA Toolkit
AI & ML
GPT-5
LLM
LoRA
PEFT
Sign in to see how your skills match this stack Sign In
Full Inference tech stack 38 technologies · by team · pay by technology · changes · similar stacks

Salary insights

Compensation ranges based on this company's open jobs
Median
$320k
Typical range
$180k – $350k
Open positions
4
4 Jobs
Junior 25%
Middle 25%
Senior 50%
Level Jobs Median Typical range
Junior 1 $320k $320k
Middle 1 $350k $350k
Senior 2 $250k $180k – $320k
Highest paying role Machine Learning Researcher $350k
Normalized to USD per year

Growth

Hiring Momentum
58/100
Growing
Open positions
4
0 opened / 0 closed in 30 days
ATS activity
Every ~4 hours
Today
Hiring Dynamics +100%
Hiring Focus
The percentage next to each role is its share of the company's job openings over the last 90 days; the arrow shows the shift versus the previous period.
AI/ML
50% ▼
Backend
50% ▼
Activity Timeline
Added Rest API to stack Sep 2026
Added Machine Learning to stack Sep 2026
Added Speculative Decoding to stack Sep 2026
Added Model Distillation to stack Sep 2026
Added KV Cache to stack Sep 2026
Added ETL/ELT to stack Aug 2026
Added SFT to stack Aug 2026
Added Post-training to stack Aug 2026
Added Megatron-LM to stack Aug 2026
Added Hugging Face to stack Aug 2026
Added GPT-5 to stack Aug 2026
Added GitHub to stack Aug 2026

Offices

Where the company hires and what each office is for
Cities
1
Hiring now
1
Countries
1
Busiest office
San Francisco
San Francisco United States
HQ
4 open roles 100% engineering $293k Avg Salary
hires for AI/ML, Backend
seen since Jul 2025 job postings

Jobs

$220k – $320k per year • Hybrid • Full-Time • 2+ years exp • San Francisco
Python
C#
C++
.NET
C++
PyTorch C++
AI/ML
LoRA
vLLM
CUDA Toolkit
Embeddings
Quantization
Knowledge Distillation
SGLang
TensorRT
PEFT
TensorRT-LLM
PyTorch
LLM
CUDA
GPT-5
Speculative Decoding
KV Cache
Model Distillation
DevOps
Docker
Kubernetes
GitHub
Apply
$250k – $350k per year • Hybrid • Full-Time • 3+ years exp • San Francisco
C#
.NET
AI/ML
DeepSpeed
RLHF
Reinforcement Learning
Multimodal AI
Knowledge Distillation
TRL
Transformers
PyTorch
LLM
Hugging Face
DPO
SFT
Post-training
Megatron-LM
GPT-5
Model Distillation
DevOps
GitHub
Apply
$220k – $320k per year • Hybrid • Full-Time • 2+ years exp • San Francisco
C#
.NET
AI/ML
DeepSpeed
Multimodal AI
Knowledge Distillation
Axolotl
Transformers
PyTorch
LLM
Hugging Face
SFT
Post-training
GPT-5
Model Distillation
DevOps
GitHub
Analytics
ETL/ELT
Apply
$120k – $180k per year • Hybrid • Full-Time • 5+ years exp • San Francisco
Go
JavaScript
TypeScript
C#
.NET
gRPC for .NET
AI/ML
DeepSeek
Llama
LLM
Frontend
Tailwind CSS
Next.js
D3.js
React.js
tRPC
Recharts
visx
Lighthouse
DevOps
Rest API
gRPC
Terraform
WebSockets
CI/CD
Docker
Design
Figma
QA
Chrome DevTools
Apply