1,785,023open jobs
103,769companies
265,772added this week
Browse all
Salary
$200k – $260k per year
Location
In office (San Francisco)
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 16, 2026. First seen by Alion on Jul 10, 2026.

Overview
Company
Impact
Profile match
LiteLLM is an open-source AI gateway and Python SDK that gives developers a single OpenAI-compatible interface to more than 100 large language model providers. Built by BerriAI, it handles model routing, fallbacks, spend tracking, budgets and rate limits, and can be self-hosted, including in air-gapped environments. The company is headquartered in San Francisco, California, United States.
Backed by Y Combinator

Product Engineer

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.

We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.

About the Role

This isn't a traditional product management role, and it isn't a traditional software engineering role.

You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.

If you enjoy owning a problem end-to-end-from idea to production-you'll thrive here.

Responsibilities

  • Build new product features from concept to production.

  • Work directly with customers to understand pain points and validate solutions.

  • Ship quickly while maintaining a high quality bar.

  • Prototype new ideas and iterate based on user feedback.

  • Own major product areas and continuously improve them over time.

  • Design backend APIs and services using Python and FastAPI.

  • Build intuitive developer experiences across our API, dashboard, and CLI.

  • Collaborate directly with the founders on product direction and technical decisions.

  • Help define and build LiteLLM's second major product.

What We're Looking For

  • Bachelor's or Master's degree in Computer Science or a related field.

  • Strong software engineering fundamentals.

  • Experience building production software, preferably with Python.

  • Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).

  • Strong product intuition and curiosity about how customers use software.

  • Excellent written and verbal communication.

  • High ownership-you naturally identify problems and solve them without waiting to be asked.

  • Comfortable operating in ambiguity and making decisions with incomplete information.

  • Excited by shipping quickly and learning from real users.

Bonus Points

  • Experience at an early-stage startup.

  • Experience building developer tools or infrastructure products.

  • Open source contributions.

  • You've built and launched your own product.

  • Familiarity with AI infrastructure, LLMs, or developer platforms.

Why Join LiteLLM?

  • Work directly with the founders every day.

  • Build products used by thousands of engineering teams around the world.

  • Own meaningful product decisions-not just implementation.

  • Move incredibly fast and see your work in production immediately.

  • Help define the future of AI infrastructure and developer tooling.

  • Competitive salary, equity, health, dental, and vision benefits.

About LiteLLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,785,023 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
San Francisco
≈ $121k – $244k per year (Estimated) • Hybrid • 8+ years exp • Bachelor's Degree • Boston
Python
TypeScript
DevOps
GitHub Actions
CI/CD
AWS
Apply
Software Engineer 1 hour ago
≈ $99k – $210k per year (Estimated) • Hybrid • Full-Time • Olivette
JavaScript
TypeScript
SQL
C#
C#
.NET
Entity Framework Core
Databases
MS SQL
AI/ML
AI Agents
Frontend
Angular
Mobile
MVVM
DevOps
Rest API
CI/CD
Git
Apply
Software Engineer 1 hour ago
≈ $123k – $225k per year (Estimated) • In office • Secret • Full-Time • 5+ years exp • Bachelor's Degree • Las Cruces
Python
Java
SQL
PowerShell
C++
Ada
DevOps
GitLab CI
CI/CD
Git
Configuration Management
GitLab
Windows
Cybersecurity
Wireshark
Management
Jira
Agile
Waterfall
Apply
$300k per year • Remote (United States, ET hours) • Contractor • 5+ years exp
Go
AI/ML
Physical AI
DevOps
AWS
Apply
$220k – $405k per year • In office • Full-Time • 4+ years exp • San Francisco • London • Seattle • New York • Toronto
Python
Go
Rust
AI/ML
Perplexity
DevOps
AWS
Kubernetes
Platform Engineering
Cybersecurity
Okta
Microsoft Entra ID
Apply
Data Analyst 9 days ago
≈ $20k – $52k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Kyiv
Python
SQL
Analytics
Power BI
Management
Agile
Apply
≈ $51k – $110k per year (Estimated) • Hybrid • Full-Time • 5+ years exp • Barcelona • Kyiv
Python
JavaScript
C++
Apply
≈ $43k – $90k per year (Estimated) • In office • Manchester
Python
PowerShell
DevOps
Azure
AWS
Cybersecurity
Microsoft Sentinel
Microsoft Defender
Microsoft Defender for Cloud
Microsoft Entra ID
SIEM
Apply
≈ $47k – $132k per year (Estimated) • Hybrid • Bachelor's Degree • Brazil
Python
Go
Java
Kotlin
ABAP
ABAP
SAP BTP
Databases
DynamoDB
AI/ML
Embeddings
Function Calling
RAG
Hallucination
Human-in-the-Loop
Structured Outputs
Tool Use
DevOps
Helm
CI/CD
AWS
Docker
Kubernetes
Amazon EKS
Amazon EC2
Cybersecurity
Least Privilege
Management
Agile
Apply
$160k – $200k per year • In office • Full-Time • 12+ years exp • Bachelor's Degree • United States
Python
SQL
Databases
Snowflake
AI/ML
dbt
Feature Store
DevOps
AWS
Analytics
Matillion
Apply
Business Manager 1 month ago
$80k – $120k per year • In office • Full-Time • United States
AI/ML
LiteLLM
Management
QuickBooks
Xero
Apply
Account Executive 2 months ago
$150k – $180k per year • In office • Full-Time • 2+ years exp • San Francisco
AI/ML
LiteLLM
DevOps
Datadog
GitLab
Apply
$150k – $210k per year • In office • Full-Time • United States
AI/ML
LiteLLM
Apply
$150k – $220k per year • In office • Full-Time • San Francisco
AI/ML
LiteLLM
Management
Slack
Apply
$150k – $250k per year • In office • Full-Time • United States
AI/ML
LiteLLM
Management
Slack
Apply
$148k – $204k per year • Hybrid • 6+ years exp • Bellevue • Chicago • Toronto • San Francisco
Python
Go
Java
AI/ML
LLM
LLM Guardrails
Agentic Workflows
Machine Learning
DevOps
Rest API
GitHub Actions
GitLab CI
CI/CD
Jenkins
Git
Shift-Left
Cybersecurity
Okta
Shift-Left Security
Apply
≈ $134k – $248k per year (Estimated) • Equity • Remote (United States) • Full-Time • 10+ years exp • Master's Degree • San Francisco
AI/ML
TensorFlow
Triton
TorchServe
Feature Store
Machine Learning
DevOps
GCP
Platform Engineering
Apply
$131k – $145k per year • Equity • Hybrid • 4+ years exp • Bachelor's Degree • San Francisco
SQL
Apply
≈ $146k – $277k per year (Estimated) • In office • 5+ years exp • Houston • New York • San Francisco • Seattle
Python
AI/ML
Edge AI
DevOps
Prometheus
Grafana
Linux
BGP
OSPF
Apply
$86k – $107k per year • Hybrid • Full-Time • 2+ years exp • Bachelor's Degree • San Francisco • Washington
Cybersecurity
GDPR
Marketing
Salesforce
LinkedIn
SpaceTech
QGIS
Apply
See all jobs
This is one of many
1,785,023 more open roles from verified company boards, updated every day.