1,772,011open jobs
103,500companies
265,560added this week
Browse all
Salary
$165k – $330k per year
Location
Hybrid (San Francisco, New York, United States)
Seniority
Architect
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 16, 2026. First seen by Alion on Feb 25, 2026. Baseten scores B on the Alion truth index.

Overview
Company
Impact
Profile match
Baseten is an American company founded in 2019 that runs machine learning models in production for companies that would rather not operate GPU infrastructure themselves. Its position is inference rather than training: it handles model packaging, autoscaling, cold start latency and multi-cloud capacity, which are the unglamorous problems that determine whether a model-powered product is fast and affordable enough to ship. Headquartered in San Francisco and backed at a multi-billion dollar valuation, it serves companies deploying open and custom models, and it competes with both the hyperscalers and the model providers' own hosted endpoints.

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

As a Solutions Architect at Baseten you will partner closely with Sales and customers to translate business needs into technical solutions, run technical discovery, and guide repeatable deployments and proofs of value for customers. This role is a great fit for entrepreneurial, customer-facing technical professionals who want a front-row view into how modern companies adopt AI at scale, and who enjoy working across technical discovery, solution design, demos, deployment scoping, and hands-on customer implementations, in close partnership with Sales and Engineering.

RESPONSIBILITIES

  • Partner with Sales on customer discovery calls (most often second calls, occasionally first calls for large accounts).

  • Lead demos and technical scoping to align on success criteria, architecture, and deployment approach.

  • Own benchmarking and repeatable deployments, including:

  • Handling standard deployment patterns and configurations across many modalities - LLMs, embeddings, image and video generation, Voice AI, etc.

  • Advising on tradeoffs like H100s vs B200s and latency-optimized vs throughput-optimized setups.

  • Driving consistent “playbook” style deployments for common models and use cases.

  • Become a power user of different runtimes such as vLLM, SGLang, and TRT-LLM and all the common configurations and tradeoffs between them

  • Drive POC and project execution, including:

  • Scoping POCs and keeping stakeholders aligned on timeline, deliverables, and next steps.

  • Acting as the “ringleader” or project manager for POCs.

  • Pulling in Forward Deployed Engineering (FDE) support when deeper or more complex technical work is needed.

REQUIREMENTS

  • AI/ML background and the ability to credibly discuss AI/ML topics with technical stakeholders.

  • Strong customer-facing communication skills, including the ability to run structured discovery and clarify ambiguous requirements.

  • Technical depth to scope solutions, without needing to write production code.

  • Ability to script and prototype as needed, including comfort “vibe coding” to move quickly in technical workflows.

NICE TO HAVE

  • Experience running or supporting benchmarks for ML inference deployments.

  • Familiarity with infrastructure tradeoffs relevant to inference performance and cost (for example GPU selection and latency versus throughput tuning).

  • Experience serving as a cross-functional technical lead for customer POCs, including coordination across Sales and Engineering.

BENEFITS

  • Competitive compensation, including meaningful equity

  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

  • Paid parental leave

  • Fertility and family-building stipend through Carrot

  • (U.S. only) Company-facilitated 401(k)

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,772,011 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Solutions
Similar stack
Same company
San Francisco
≈ $104k – $218k per year (Estimated) • In office • 5+ years exp • Bachelor's Degree • Manassas
AI/ML
Copilot
DevOps
CI/CD
Bamboo
Bitbucket
Analytics
Power BI
Management
Confluence
Jira
ServiceNow
Agile
Scrum
ITIL
Apply
$160k – $256k per year • In office • 5+ years exp • Bachelor's Degree • Santa Clara
Verilog
AI/ML
AI Agents
Chips/EDA
Synopsys Fusion Compiler
Ansys RedHawk
Ansys Totem
Synopsys 3DIC Compiler
Cadence Integrity 3D-IC
Cadence Clarity 3D Solver
Apply
≈ $122k – $237k per year (Estimated) • In office • Bachelor's Degree • Austin
Chips/EDA
Synopsys VCS
Cadence Xcelium
Cadence JasperGold
Synopsys Verdi
Apply
≈ $173k – $341k per year (Estimated) • Equity • Hybrid • 8+ years exp • PhD • San Francisco
AI/ML
Model Context Protocol
AI Agents
LLM
LLM Guardrails
Tool Use
DevOps
Terraform
PagerDuty
Pulumi
CI/CD
GitOps
ArgoCD
Kubernetes
Cloudflare
Progressive Delivery
Incident Management
Apply
≈ $158k – $310k per year (Estimated) • Equity • Hybrid • 8+ years exp • PhD • New York
AI/ML
Model Context Protocol
AI Agents
LLM
LLM Guardrails
Tool Use
DevOps
Terraform
PagerDuty
Pulumi
CI/CD
GitOps
ArgoCD
Kubernetes
Cloudflare
Progressive Delivery
Incident Management
Apply
$100k – $150k per year • Remote (likely United States) • Full-Time • 3+ years exp
AI/ML
vLLM
SGLang
Post-training
Apply
≈ $89k – $266k per year (Estimated) • Hybrid • 9+ years exp • Tel Aviv
Python
Java
Databases
Weaviate
Milvus
Pinecone
FAISS
AI/ML
LangGraph
LangChain
LlamaIndex
Vertex AI
Embeddings
Prompt Engineering
Function Calling
AI Agents
AWS Bedrock
LLM
RAG
Google ADK
OpenAI
Anthropic
Amazon SageMaker
LLM Guardrails
Multi-Agent Systems
Tool Use
DevOps
GCP
Azure
AWS
Kubernetes
Apply
Senior AI Engineer 5 days ago
≈ $45k – $115k per year (Estimated) • In office • Full-Time • 10+ years exp • Sarajevo
Python
Databases
Weaviate
Pinecone
FAISS
Qdrant
AI/ML
Copilot
LlamaIndex
Embeddings
Prompt Engineering
AI Agents
LLM
RAG
Semantic Search
Context Engineering
Semantic Search
DevOps
Azure
Management
Agile
Scrum
Apply
≈ $29k – $51k per year (Estimated) • Hybrid • 5+ years exp • Bachelor's Degree • Bengaluru
Python
SQL
Databases
Databricks
Delta Lake
AI/ML
MLFlow
Embeddings
Scikit-learn
NLP
TensorFlow
Pandas
NumPy
PyTorch
LLM
Feature Store
Machine Learning
DevOps
Azure
Apply
≈ $18k – $35k per year (Estimated) • In office • Internship • Warsaw
PHP
PHP
WordPress
AI/ML
Cursor
Claude Code
AI Agents
OpenAI Codex
Lovable
Replit
Apply
$145k – $290k per year • Remote (EMEA, United States) • Full-Time
AI/ML
Cursor
vLLM
Embeddings
SGLang
LLM
Baseten
Machine Learning
Management
Notion
Apply
$200k – $400k per year • Hybrid • Full-Time • 1+ year exp • San Francisco • New York
AI/ML
Cursor
vLLM
JAX
SGLang
TensorRT
TensorRT-LLM
PyTorch
LLM
Ray
SFT
Post-training
InfiniBand
Baseten
Machine Learning
DevOps
SLURM
Kubernetes
Chips/EDA
PoC Library
Apply
$165k – $330k per year • Hybrid • Full-Time • 2+ years exp • Bachelor's Degree • San Francisco • New York • Toronto • Montreal • Seattle
Python
AI/ML
Cursor
Spark
ComfyUI
Whisper
Baseten
Machine Learning
DevOps
Docker
Management
Notion
Apply
GRC Manager 9 days ago
$150k – $250k per year • Hybrid • Full-Time • 5+ years exp • San Francisco • Toronto • New York • Montreal • Seattle
AI/ML
Cursor
Baseten
Machine Learning
DevOps
GCP
AWS
Cybersecurity
ISO 27001
SOC 2
GDPR
HIPAA
FedRAMP
Management
Notion
Apply
$200k – $275k per year • Hybrid • Full-Time • San Francisco
AI/ML
Cursor
Fine-tuning
Reinforcement Learning
Knowledge Distillation
Function Calling
LLM
Synthetic Data
DPO
SFT
PPO
GRPO
Post-training
LLM Evaluation
Baseten
KV Cache
Agentic Workflows
Tool Use
Model Distillation
Reward Modeling
Machine Learning
Apply
≈ $134k – $248k per year (Estimated) • Equity • Remote (United States) • Full-Time • 10+ years exp • Master's Degree • San Francisco
AI/ML
TensorFlow
Triton
TorchServe
Feature Store
Machine Learning
DevOps
GCP
Platform Engineering
Apply
$131k – $145k per year • Equity • Hybrid • 4+ years exp • Bachelor's Degree • San Francisco
SQL
Apply
≈ $146k – $277k per year (Estimated) • In office • 5+ years exp • Houston • New York • San Francisco • Seattle
Python
AI/ML
Edge AI
DevOps
Prometheus
Grafana
Linux
BGP
OSPF
Apply
$86k – $107k per year • Hybrid • Full-Time • 2+ years exp • Bachelor's Degree • San Francisco • Washington
Cybersecurity
GDPR
Marketing
Salesforce
LinkedIn
SpaceTech
QGIS
Apply
$74k – $92k per year • Hybrid • Full-Time • 2+ years exp • Bachelor's Degree • Arlington • San Francisco • Washington
Cybersecurity
GDPR
Marketing
Salesforce
LinkedIn
SpaceTech
QGIS
Apply
See all jobs
This is one of many
1,772,011 more open roles from verified company boards, updated every day.