624,530open jobs
30,918companies
85,628added this week
Browse all
Salary
$130k – $261k per year (Estimated)
Location
Remote/Hybrid (San Francisco, United States)
Seniority
Middle · 4+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match

About FriendliAI

FriendliAI is the fastest inference cloud for agents, built to run frontier open-weight models at scale in production. It delivers up to 7x faster output token speed, up to 90% lower inference costs, and 99.99% uptime across the most demanding agent workloads - long-context inference, real-time streaming, and accurate tool calling.

We are a small, fast-moving team doing work that matters at one of the most exciting moments in the history of technology. With our world-class inference stack, we are building the platform teams can actually rely on.

About the Role

We're seeking a Full-Stack Software Engineer to design, build, and scale our web platform, which serves as the core interface for deploying multimodal models, observing workloads, and building agent workflows. You'll own how customers experience the platform end-to-end- signing up, authenticating, managing access across an organization, and understanding what they're being billed for - from the services and data models through to the interface. In this role, you'll work closely with product, infrastructure, and design teams to create high-performance, developer-friendly, and enterprise-ready tools.

We are looking for a hands-on engineer who is eager to work across the surfaces of our application - authentication and access control, billing and usage, and the model deployment and inference features customers use every day. The ideal candidate has built backend systems where correctness matters, is comfortable carrying a feature all the way to the UI, cares deeply about developer workflows, and is excited to help define the future of AI adoption.

Key Responsibilities

  • Design, build, and maintain web applications and tools for AI model deployment, monitoring, and performance optimization

  • Own authentication, organization management, and billing end-to-end.

  • Develop clean, scalable, and robust APIs powering AI agents, workflows, and user-facing systems

  • Collaborate with infrastructure engineers to integrate backend systems with deployment and orchestration pipelines

  • Drive code quality through automated testing, CI/CD, and code reviews

  • Contribute to architecture and design decisions that shape our platform's long-term direction

  • Identify and resolve technical debt and improve system reliability in production systems

Qualifications

  • 4+ years of industry experience in backend or full-stack engineering, with meaningful time spent on backend systems

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent

  • Production experience with authentication and authorization - SSO/OAuth2/OIDC, RBAC, API keys, and multi-tenant isolation

  • Experience building billing or usage-metering systems: usage-based or subscription pricing, entitlements, quotas, or payment integration

  • Fluent in Python and TypeScript; proficient with React/Next.js

  • Strong backend experience with FastAPI or similar Python frameworks

  • Proficiency in designing data models, writing SQL, and working with PostgreSQL; familiarity with OLAP systems such as ClickHouse

  • Strong API design experience across gRPC/REST/GraphQL in production systems

  • Solid foundation in cloud-native development

  • Familiarity with OpenTelemetry tracing, metrics, and structured logging

Preferred Experience

  • Experience with payment processors (e.g., Stripe) and usage-based or subscription SaaS billing

  • Familiarity with enterprise identity requirements - SAML, SCIM provisioning, or providers like Auth0/WorkOS

  • Familiarity with LLM-based workflows, tool invocation, or agentic systems

  • Familiarity with Kubernetes for container orchestration, including deploying, scaling, and managing containerized applications in production environments

  • Have worked in a startup or fast-paced environment with ownership

  • Built developer-facing SDKs/CLIs

  • Passion for developer experience and enabling AI adoption

Benefits

  • Flexible working hours

  • Daily lunch and dinner provided; unlimited snacks and beverages

  • Supportive and highly collaborative work environment

  • Health check-up support and top-tier equipment/hardware support

  • A front-row seat to the generative AI infrastructure revolution

  • Competitive compensation, startup equity, health insurance, and other benefits.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
624,530 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
San Francisco
QA Engineer 1 day ago
$14k – $42k per year (Estimated) • In office • Bengaluru
Python
JavaScript
TypeScript
SQL
DevOps
CI/CD
Git
Management
Jira
QA
Selenium
Playwright
Postman
Apply
Remote/Hybrid • 8+ years exp
Python
JavaScript
TypeScript
Python
Flask
FastAPI
Django
Databases
Snowflake
AI/ML
LangChain
LlamaIndex
LLM
RAG
Frontend
GraphQL
React.js
DevOps
Helm
Prometheus
WebSockets
Docker
Kubernetes
Cortex
QA
Cypress
Playwright
Pytest
Apply
$26k – $61k per year (Estimated) • Remote/Hybrid • 7+ years exp • Bachelor's Degree • Pune
Python
SQL
Scala
Databases
Snowflake
Apache Kafka
AI/ML
Cursor
Spark
Claude Code
OpenAI Codex
DevOps
GitHub Actions
CI/CD
Jenkins
AWS
Kubernetes
Amazon EKS
AWS Lambda
Amazon S3
IAM
Amazon CloudWatch
Amazon Kinesis
Apply
$23k – $69k per year (Estimated) • Remote/Hybrid • Full-Time • 3+ years exp • Sofia
Python
Java
Java
Spring Boot
Databases
PostgreSQL
Apache Kafka
AI/ML
Copilot
Cursor
DevOps
Rest API
GCP
OpenShift
Azure
CI/CD
AWS
Kubernetes
Management
Agile
Apply
Emulation Engineer 1 day ago
$25k – $59k per year (Estimated) • In office • Full-Time • 5+ years exp • Bengaluru
Python
C++
SystemC
DevOps
QEMU
Chips/EDA
Synopsys ZeBu
Cadence Palladium
Siemens Veloce
Apply
$208k – $386k per year (Estimated) • Remote/Hybrid • Full-Time • 10+ years exp • San Francisco
AI/ML
vLLM
Multimodal AI
Function Calling
AI Agents
SGLang
TensorRT-LLM
LLM
KV Cache
Tool Use
Apply
In office • Full-Time • 4+ years exp • Bachelor's Degree • Seoul
Python
JavaScript
TypeScript
SQL
Python
FastAPI
Databases
PostgreSQL
ClickHouse
AI/ML
Multimodal AI
Function Calling
AI Agents
LLM
Tool Use
Frontend
GraphQL
Next.js
React.js
DevOps
gRPC
OpenTelemetry
CI/CD
Kubernetes
Cybersecurity
Auth0
Management
Stripe
Apply
$166k – $299k per year (Estimated) • Remote/Hybrid • Full-Time • 5+ years exp • Bachelor's Degree • San Francisco
Python
AI/ML
Function Calling
NCCL
InfiniBand
Tool Use
DevOps
Terraform
Ansible
Helm
Cilium
Istio
etcd
GitOps
AWS
Kubernetes
Service Mesh
eBPF
Apply
$38k – $100k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Seoul
Python
AI/ML
Function Calling
NCCL
InfiniBand
Tool Use
DevOps
Terraform
Ansible
Helm
Cilium
Istio
etcd
GitOps
AWS
Kubernetes
Service Mesh
eBPF
Apply
Account Executive 3 months ago
$130k – $274k per year (Estimated) • Remote/Hybrid • Full-Time • 5+ years exp • San Francisco
AI/ML
Multimodal AI
LLM
Hugging Face
Edge AI
DevOps
AWS
Apply
$115k – $180k per year • Remote/Hybrid • Full-Time • 4+ years exp • San Francisco • Seattle • Raleigh • New York
Apply
$97k – $124k per year • In office • Full-Time • 1+ year exp • San Francisco
Design
Canva
Management
Slack
Google Workspace
Apply
$200k – $240k per year • Remote/Hybrid • San Francisco
AI/ML
AI Agents
LLM
RAG
Apply
$152k – $301k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Dallas • Austin • San Francisco • Fort Worth • Los Angeles
Marketing
Salesforce
Apply
$285k – $335k per year • Equity • In office • Full-Time • 10+ years exp • San Francisco
DevOps
VMWare
containerd
Kubernetes
KVM
QEMU
Hyper-V
Apply
See all jobs
This is one of many
624,530 more open roles from verified company boards, updated every day.