368,657open jobs
9,442companies
50,883added this week
Browse all
Salary
$165k – $330k per year
Location
Remote/Hybrid (San Francisco, New York, United States, Toronto, Montreal, Canada)
Employment
Full-Time
Overview
Company
Impact
Profile match
Baseten is an AI infrastructure platform designed to help developers and machine learning teams deploy, serve, and scale open-source and custom AI models. The platform provides performant, low-latency inference infrastructure alongside developer tools like Truss, an open-source model packaging framework. Headquartered in San Francisco, California, Baseten enables companies to run state-of-the-art models in production seamlessly without managing underlying cloud infrastructure.

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE

As a Cloud Platform Engineer, you'll envision and build robust systems and processes that ensure our infrastructure is scalable, reliable, and efficient. This can range from automating deployments and monitoring systems to optimizing performance and managing incidents.

We all work closely with our users, learning from their past struggles in operationalizing ML, onboarding them onto our platform, and turning our learnings into ideas for improving Baseten.

EXAMPLE INITIATIVES

You'll get to work on these types of projects as part of our Infrastructure team:

RESPONSIBILITIES

  • Build and maintain scalable infrastructure to support the deployment and operation of machine learning models.

  • Establish standards and best practices for reliability and performance across the infrastructure.

  • Automate processes when relevant, particularly for managing CI/CD pipelines.

  • Own products and projects end-to-end, functioning as both an engineer and a project manager, with a focus on user empathy, project specification, and end-to-end execution.

  • Collaborate with cross-functional teams to understand project requirements and translate them into technical solutions.

  • Mentor junior team members and contribute to knowledge sharing within the organization.

  • Navigate ambiguity and exercise good judgment on tradeoffs and tools needed to solve problems, avoiding unnecessary complexity.

  • Demonstrate pride, ownership, and accountability for your work, expecting the same from your teammates.

REQUIREMENTS

  • Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.

  • Extensive experience with Kubernetes.

  • Experience in building and maintaining scalable infrastructure.

  • Experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Pulumi) and CI/CD tooling (e.g., GitHub Actions, GitLab CI, Circle CI, Jenkins).

  • Relevant OSS observability experience (Prometheus, ELK stack, Grafana stack, Opentelemetry) is a plus.

  • Ability to own projects end-to-end, from project specification to execution.

  • No prior machine learning experience required, but should be open to learning about it.

BENEFITS

  • Competitive compensation, including meaningful equity.

  • 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

  • Paid parental leave

  • Fertility and family-building stipend through Carrot

  • Company-facilitated 401(k)

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,657 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
San Francisco
SR AI ENGINEER, SMAI 7 hours ago
In office • Full-Time • 2+ years exp • Bachelor's Degree • Taoyuan
JavaScript
Python
SQL
TypeScript
Python
FastAPI
AI/ML
AI Agents
Function Calling
LLMOps
Prompt Engineering
Quantization
RAG
Streamlit
Frontend
Angular
React.js
DevOps
AWS
Azure
CI/CD
Docker
GCP
GitHub
GitHub Actions
Kubernetes
OpenShift
Apply
$142k – $213k per year • Remote/Hybrid • Full-Time • 6+ years exp • Bachelor's Degree • Jersey City
Java
Python
SQL
TypeScript
JavaScript
Java
Spring Boot
Python
Asyncio
FastAPI
AI/ML
AI Agents
Claude
Claude Code
Copilot
Cursor
Devin
Fine-tuning
Gemini
Google ADK
Hybrid Search
Knowledge Graph
LangChain
LangGraph
RAG
Frontend
Angular
DevOps
CI/CD
Docker
Kubernetes
Rest API
Apply
$73k – $183k per year (Estimated) • Remote/Hybrid • Full-Time • 6+ years exp • Zug
Python
Python
FastAPI
Databases
PostgreSQL
Redis
AI/ML
AI Agents
AWS Bedrock
AWS Bedrock AgentCore
LLM
DevOps
Amazon EKS
AWS
AWS CDK
CI/CD
Datadog
Kubernetes
OpenTelemetry
Platform Engineering
Apply
$136k – $253k per year • Equity • Remote/Hybrid • Full-Time • 10+ years exp • Frisco • New York • Toronto • Ann Arbor
Python
SQL
Java
Java
Flyway
AI/ML
AWS Bedrock
Claude
LLM
Anthropic
AWS Bedrock AgentCore
LLM Guardrails
LLMOps
DevOps
Amazon EKS
AWS
CI/CD
Datadog
Docker
Kubernetes
Apply
$16k – $38k per year (Estimated) • In office • Full-Time • 3+ years exp • India
SQL
Databases
Azure SQL Database
DevOps
AWS
Azure
CI/CD
GitHub
Kubernetes
Terraform
Apply
$165k – $330k per year • Remote/Hybrid • Full-Time • San Francisco • Toronto • New York • Montreal
AI/ML
Cursor
DeepSeek
LLM
SGLang
TensorRT
TensorRT-LLM
vLLM
Management
Notion
Apply
$190k – $240k per year • Remote/Hybrid • Full-Time • San Francisco • New York
JavaScript
TypeScript
AI/ML
Cursor
Frontend
Next.js
React Three Fiber
React.js
Three.JS
Design
Figma
Apply
Product Designer 5 days ago
$225k – $290k per year • Remote/Hybrid • Full-Time • San Francisco • New York
JavaScript
TypeScript
AI/ML
Cursor
Frontend
React.js
DevOps
Git
Apply
AI Engineer 12 days ago
$220k – $260k per year • Remote/Hybrid • Full-Time • 5+ years exp • San Francisco
Python
AI/ML
Claude
Claude Code
Cursor
Fine-tuning
LangChain
LLM
LoRA
Reinforcement Learning
Spark
Synthetic Data
PEFT
LLM Guardrails
OpenAI Codex
Post-training
SFT
AI Agents
Model Context Protocol
Apply
$170k – $220k per year • Remote/Hybrid • Full-Time • 8+ years exp • San Francisco • New York
Go
AI/ML
Cursor
LLM
Post-training
Apply
$170k – $220k per year • Equity 1–2.8% • In office • Full-Time • 3+ years exp • San Francisco
Python
SQL
Python
Django
AI/ML
AI Agents
Context Engineering
LLM
LLM Evaluation
RAG
Apply
$173k – $314k per year • In office • Full-Time • 12+ years exp • Bachelor's Degree • San Francisco
Apex
JavaScript
Node JS
Python
SQL
TypeScript
Apex
Lightning Web Components
AI/ML
Agentforce
AI Agents
Claude
Claude Code
Copilot
Cursor
LLM
RAG
DevOps
AWS
Azure
CI/CD
Docker
GCP
GitHub
Grafana
gRPC
Kubernetes
New Relic
Prometheus
Splunk
Marketing
Salesforce
QA
Cypress
JMeter
k6
Locust
Playwright
Postman
Rest-Assured
Selenium
Apply
Senior ML Engineer 1 hour ago
$149k – $224k per year • In office • Full-Time • 5+ years exp • Master's Degree • San Francisco • Washington • Palo Alto
Python
Python
pySpark
Databases
Apache Kafka
AI/ML
AI Agents
Agentforce
Airflow
Anomaly Detection
Feature Store
Flink
Ray
Red Teaming
Spark
DevOps
CI/CD
Docker
Kubernetes
Cybersecurity
MITRE ATT&CK
Marketing
Salesforce
Apply
In office • Internship • 1+ year exp • Bachelor's Degree • San Francisco
Go
JavaScript
Ruby
Scala
Apply
$360k – $530k per year • In office • Full-Time • Bachelor's Degree • San Francisco
MATLAB
Python
MATLAB
Simulink
AI/ML
OpenAI
Robotics
Digital Twin
Apply
See all jobs
This is one of many
368,657 more open roles from verified company boards, updated every day.