LiteLLM
litellm.ai
Actively hiring
AI Compute & Inference
AI Development Tools
LLM & Generative AI
As featured in
View 8 jobs
Follow
Overview
News
Technologies
Salaries
Products
People
Growth
Offices
Jobs
Financials
Funding and backers
Hiring now
10
open roles
Backers
1
Y Combinator
Momentum
40/100
a new city, in the news, rising traction
Last sign of life
this month
a posting or a news item
The story so fareach stage dated by its source: the company's releases, the press, registers, filings
Aug 8, 2023
Launched on Hacker News Show HN: LiteLLM -Open-Source Library for Anthropic,Azure,OpenAI, etc. API Calls
Jan 2023
Went through Y Combinator
2023
Founded
Tractionpublic signals, read monthly
Backed byfrom the funds' portfolios and accelerator catalogs
Y Combinator Investors in similar startupsfunds that back the companies most like this one
Similar startupsby what they do, their industry and backers
Nexos.ai is the all-in-one AI platform. Workspace for teams, AI Gateway for developers. 200+ models, no-code Agents, and maximum value from…
Manufact is a software company that builds and maintains mcp-use, an open-source SDK for building Model Context Protocol servers, clients…
Featherless is a serverless AI inference platform that makes tens of thousands of open-source AI models instantly available through a…
Ollama is a software company that makes it easy to run open models and automate work with them while keeping data safe. It began as an…
Portkey is a software company that helps organisations democratise and productionize generative AI across their teams. It builds a gateway…
Ai& runs frontier open-weight models - Kimi, DeepSeek and GLM - on GPU infrastructure it owns and operates in Japan. One API compatible…
Overview
LiteLLM is an open-source AI gateway and Python SDK that gives developers a single OpenAI-compatible interface to more than 100 large language model providers. Built by BerriAI, it handles model routing, fallbacks, spend tracking, budgets and rate limits, and can be self-hosted, including in air-gapped environments. The company is headquartered in San Francisco, California, United States.
News
Zero Data Leakage & 100% Shadow AI Blocking The Complete Guide to Building the Ultimate Local AI Proxy with 'LiteLLM Presidio' to Cut 600 Hours of Annual Audit WorkAI業務自動化たくみ
1. Introduction: Turning the 'Biggest Barrier' to Enterprise AI Adoption into a Dramatic StrengthChatGPT, Claude, Cursor, GitHub Copilot... While generative AI tools that bring overwhelming productivity are permeating the workplace, what keeps IT departme
Read more
Report
LiteLLM proxy
LiteLLM proxy in front of the vLLM backends: virtual keys, health-check routing, a hardened systemd unit, and the nginx config that makes SSE streaming survive.
Read more
Report
Free LLM Pricing API - AI Model Costs, Specs & Benchmarks
Free public API for AI model pricing, specs, benchmarks and cost calculation across 1000+ LLMs from OpenAI, Anthropic, Google, AWS Bedrock, Azure and Mistral. JSON in one request, no API key, CORS-enabled. OpenAPI 3 spec included. Ships a LiteLLM drop-in
Read more
Report
LiteLLM Breach Exposes 2,500 Firms in 40-Minute Attack
LiteLLM supply chain attack exposed 2,500+ companies and 434,000 CI/CD pipelines in 40 minutes. FBI warns threat still live.
Read more
Report
CloudSEK Links March LiteLLM Supply Chain Breach to 2,500 Organizations
Threat-intelligence firm CloudSEK said in a report published August 11, 2026 that it has identified more than 2,500 organizations potentially exposed by the March 2026 supply-chain compromise of LiteLLM, the open-source...
Read more
Report
International Cyber Digest (@IntCyberDigest) on X
BREAKING: Security researchers have uncovered all of those who fell victim to the LiteLLM supply chain attack by obtaining its archive: 153GB holding 433,909 files from 2,488 organisations.According to Hudson Rock and CloudSEK, victims include Nvidia, AWS
Read more
Report
Malicious LiteLLM Releases Tied to Trivy Hack May Have Exposed 2,100+ Organizations
Malicious LiteLLM PyPI releases stole cloud and SSH keys, Kubernetes tokens, and other secrets, potentially exposing 2,500+ organizations.
Read more
Report
Benchmarking AI Gateways: GoModel vs LiteLLM vs Portkey vs Bifrost enterpilot Blog
A reproducible AI gateway benchmark comparing GoModel, LiteLLM, Portkey, and Bifrost on latency, throughput, memory, CPU, cold start, and image size.
Read more
Report
Show more news
Tech stack
Technologies named in job postings at LiteLLM over the last 12 months, by layer, with the share of postings for each.
Technologies in use
34
Postings analysed
19
Stack modernity
75/100AI adopter
Languages
Python53%
Rust11%
Frameworks & libraries
FastAPI21%
Flask5%
OpenTelemetry5%
Databases
PostgreSQL16%
Redis16%
Cloud & platforms
GitHub32%
OpenAI32%
Datadog11%
Anthropic5%
AI & ML
LLM53%
Sign in to see how your skills match this stack
Sign In
Full LiteLLM tech stack
34 technologies · by team · pay by technology · changes · similar stacks
Salary insights
Compensation ranges based on this company's open jobs
Median
$220k
Typical range
$120k – $260k
Open positions
9
4
Jobs
Junior
75%
Senior
25%
| Level | Jobs | Median | Typical range |
|---|---|---|---|
| Junior | 3 | $210k | $180k – $250k |
| Senior | 1 | $170k | $170k |
Highest paying role
Product Engineer
$260k
Normalized to USD per year
All salaries at LiteLLM
By role, level and city, against the market · 9 jobs with pay
Growth
Hiring Momentum
60/100
Growing
Open positions
10
0 opened / 1 closed in 30 days
Median time-to-fill
40 days
faster than 32% of the market
ATS activity
Every ~4 hours
Today
Hiring Dynamics
+100%
Hiring Focus
The percentage next to each role is its share of the company's job openings over the last 90 days; the arrow shows the shift versus the previous period.
Solutions
21% ▼
Backend
14% ▼
Security
14% ▼
Product
14% ▼
Support
14% ▼
AI/ML
7% ▼
Activity Timeline
New location: United States
Sep 2026
Added OWASP to stack
Sep 2026
Added Xero to stack
Sep 2026
Added QuickBooks to stack
Sep 2026
Added GitLab to stack
Sep 2026
Added LLM Guardrails to stack
Aug 2026
Added Red Teaming to stack
Aug 2026
Added IAM to stack
Aug 2026
Added GitHub to stack
Aug 2026
Added Model Context Protocol to stack
Aug 2026
Added OpenAI to stack
Aug 2026
Added Anthropic to stack
Aug 2026
Offices
Where the company hires and what each office is for
Cities
1
Hiring now
1
Countries
1
Busiest office
San Francisco
San Francisco
United States
HQ
6 open roles 7 posted in 90 days 33% engineering $217k Avg Salary
hires for AI/ML, Backend, Product
Jobs
$150k – $210k per year • In office • Full-Time • United States
LiteLLM
Apply
$150k – $220k per year • In office • Full-Time • San Francisco
LiteLLM
Management
Slack
Apply
$150k – $250k per year • In office • Full-Time • United States
LiteLLM
Management
Slack
Apply
$150k – $220k per year • In office • Full-Time • San Francisco
Python
Model Context Protocol
LiteLLM
LLM
LLM Guardrails
DevOps
Kubernetes
GitHub
Apply
$200k – $250k per year • In office • Full-Time • 1+ year exp • San Francisco
Python
FastAPI
Databases
PostgreSQL
Redis
AI/ML
Model Context Protocol
LiteLLM
LLM
OpenAI
Anthropic
Apply
≈ $15k – $40k per year (Estimated) • Remote (India) • Full-Time
LiteLLM
Apply
$200k – $260k per year • In office • Full-Time • Bachelor's Degree • San Francisco
Python
FastAPI
AI/ML
LiteLLM
LLM
Apply
Apply