368,530open jobs
9,432companies
50,439added this week
Browse all
Salary
$215k – $285k per year
Location
Remote (United States)
Seniority
Senior · 5+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match
The unified interface for LLMs. Find the best models & prices for your prompts

About OpenRouter

OpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize the best large language models across providers-without lock-in, capacity constraints, or unnecessary cost. We power the most advanced AI teams in the world by giving them the flexibility to move fast, scale confidently, and stay future-proof as models evolve.

As enterprise adoption of AI accelerates, OpenRouter sits at the center of how organizations operationalize LLMs across research, product, and production workloads.

About the Role

We're hiring a Software Engineer on our Platform team to own and scale the systems that route and serve millions of LLM requests every day. The business is growing at an unbelievable pace and we need help to ensure our platform can keep up. You'll work alongside a small team of engineers on owning our infrastructure, datastores, CI/CD pipeline and everything else at OpenRouter is built on. This is a hands-on IC role with broad surface area and little process between you and shipping.

What You'll Do

  • Own and evolve our edge and cloud infrastructure across Cloudflare, Google Cloud, and Vercel.

  • Scale and operate our data layer including Spanner, ClickHouse, and Postgres.

  • Ensure we are optimizing for performance when serving LLM inference as traffic rapidly grows.

  • Partner with engineering leadership on capacity, reliability, and cost across the routing layer, with ownership of the systems carrying production traffic.

  • Set the bar and playbook for how we run infrastructure and operations as the team grows - tooling, observability, on-call, and the patterns other engineers build against.

What We're Looking For

  • 5+ years building and operating production infrastructure at companies where uptime, latency, and cost matter.

  • Proven experience with cloud platforms (GCP, AWS, Azure) and edge-first serverless platforms (e.g. Cloudflare Workers)

  • Deep expertise in operating large scale databases (e.g Postgres, Spanner, etc).

  • A full-stack TypeScript shop won't faze you; you can move across the stack when the platform needs it.

  • High agency and a bias toward action. You don't wait for tickets - you see the bottleneck and fix it.

  • AI-forward in your workflow. You use coding agents, MCPs, and LLMs heavily and have opinions about what works.

  • Pragmatic about tradeoffs between speed and simplicity.

Nice to Have

  • Existing user of OpenRouter, or active side projects in AI products/infrastructure or developer tooling.

If you don't think you meet all of the criteria below but still are interested in the job, please apply. Nobody checks every box, and we're looking for someone who is excited to join the team.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,530 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
$84k – $178k per year (Estimated) • In office • Full-Time • 10+ years exp • Wellington
Java
Python
DevOps
Ansible
AWS
Azure
CI/CD
Docker
GCP
Helm
Kubernetes
Platform Engineering
Prometheus
Service Mesh
Terraform
GitLab
IAM
Apply
Platform Engineer 1 day ago
$87k – $140k per year • In office • Full-Time • 3+ years exp • Berlin
Databases
PostgreSQL
Redis
DevOps
AWS
Azure
Bicep
CI/CD
Docker
GCP
GitHub Actions
Kubernetes
OpenShift
Terraform
GitHub
Apply
Founding Engineer 1 day ago
$81k – $116k per year • In office • Full-Time • Bachelor's Degree • Munich
JavaScript
Python
TypeScript
Databases
MySQL
PostgreSQL
Frontend
Next.js
React.js
Tailwind CSS
DevOps
AWS
Azure
CI/CD
Docker
GCP
Grafana
Kubernetes
OpenTelemetry
Prometheus
Apply
$230k – $260k per year • Equity • Remote • Internship • Bachelor's Degree
Python
DevOps
Amazon EKS
AWS
Azure
CI/CD
GCP
Helm
Kubernetes
Terraform
Cybersecurity
FedRAMP
Orca Security
Apply
$98k – $195k per year (Estimated) • In office • Full-Time • 7+ years exp • Wellington
Java
Python
SQL
Java
Spring Boot
Databases
Apache Kafka
Databricks
Neo4j
AI/ML
Flink
Spark
Frontend
GraphQL
DevOps
Azure
CI/CD
Datadog
Dynatrace
Kibana
Kubernetes
OpenShift
Platform Engineering
Splunk
Amazon ECS
Apply
Data Scientist 18 days ago
$180k – $240k per year • Remote • Full-Time • 4+ years exp
Python
SQL
TypeScript
Databases
ClickHouse
Google BigQuery
AI/ML
AI Agents
dbt
Embeddings
LLM
NLP
OpenRouter
Prompt Engineering
Human-in-the-Loop
LLM Guardrails
Model Context Protocol
Apply
$245k – $280k per year • In office • Full-Time • 6+ years exp
AI/ML
OpenRouter
Edge AI
Cybersecurity
HIPAA
SOC 2
Apply
Applied AI Engineer 1 month ago
$163k – $357k per year (Estimated) • Remote • Full-Time
AI/ML
LLM
OpenRouter
LLM Guardrails
AI Agents
Apply
Research Scientist 1 month ago
$250k – $285k per year • Remote • Full-Time • PhD
Python
SQL
Databases
ClickHouse
Google BigQuery
AI/ML
Embeddings
Fine-tuning
LLM
NLP
OpenRouter
Reinforcement Learning
Apply
$220k – $260k per year • Remote • Full-Time • 4+ years exp
Python
TypeScript
AI/ML
AI Agents
LLM
OpenRouter
Prompt Engineering
OpenAI
DevOps
Rest API
Apply
See all jobs
This is one of many
368,530 more open roles from verified company boards, updated every day.