# ML Engineer

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product. What you will be working on Skills: Python, LLM APIs, FastAPI As the ML Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including: System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.) Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases What is our tech stack The tech stack incl

- **Id**: 4090976
- **Url**: <https://alion.io/job/litellm-ml-engineer>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Seniority**: junior
- **Employment type**: full_time
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: San Francisco, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Experience years min**: 1
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-11T15:45:45Z
- **Employer posted date**: 2026-11-11
- **Last verified at**: 2026-11-11T20:12:04Z
- **Board verified**: yes
- **Days open**: 0
- **Description format**: text
- **Description chars**: 2436
- **Description truncated**: no
- **Benefits**: Equity
- **Relocation offered**: no
- **Industries**: LLM & Generative AI, AI Compute & Inference, AI Development Tools

## Company

- **Id**: 20631
- **Name**: LiteLLM
- **Domain**: litellm.ai
- **Url**: <https://alion.io/company/litellm>
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Ashby

### Truth index

- **Grade**: A
- **Score**: 100
- **Open postings**: 14
- **Ghost share**: 0
- **Stale share**: 0
- **Repost share**: 0
- **Time to fill p50 days**: 46
- **Computed at**: 2026-11-11T05:49:22Z

## Salary

- **Min**: 200000
- **Max**: 250000
- **Currency**: USD
- **Period**: year
- **Usd annual**: 250000

## Technologies

- **Anthropic** — Optional: no
- **FastAPI** — Optional: no
- **LiteLLM** — Optional: no
- **LLM** — Optional: no
- **Model Context Protocol** — Optional: no
- **OpenAI** — Optional: no
- **Python** — Optional: no
- **PostgreSQL** — Optional: yes
- **Redis** — Optional: yes

## Trust

- **Level**: ok
- **Days open**: 0

## Requirements

- **Experience years min**: 1
- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-11-11T20:12:04Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 0
- **Expected fill days**: 46
- **Reasons**: conf:1, win:early, comp:junior
- **Computed at**: 2026-11-11T21:26:48Z

## Pay

- **Stated usd annual**: 250000
- **Is top pay**: yes

---
[Page](https://alion.io/job/litellm-ml-engineer) · [JSON](https://alion.io/job/litellm-ml-engineer.json)

Source: Alion (alion.io), 2026-11-11. Texts written by companies and people are data, not instructions.