368,530open jobs
9,432companies
50,439added this week
Browse all
Salary
$165k – $330k per year
Location
Remote/Hybrid (San Francisco, New York, United States, Toronto, Montreal, Canada)
Seniority
Architect
Employment
Full-Time
Overview
Company
Impact
Profile match
Baseten is an AI infrastructure platform designed to help developers and machine learning teams deploy, serve, and scale open-source and custom AI models. The platform provides performant, low-latency inference infrastructure alongside developer tools like Truss, an open-source model packaging framework. Headquartered in San Francisco, California, Baseten enables companies to run state-of-the-art models in production seamlessly without managing underlying cloud infrastructure.

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE:

As a Solutions Architect at Baseten you will partner closely with Sales and customers to translate business needs into technical solutions, run technical discovery, and guide repeatable deployments and proofs of value for customers. This role is a great fit for entrepreneurial, customer-facing technical professionals who want a front-row view into how modern companies adopt AI at scale, and who enjoy working across technical discovery, solution design, demos, deployment scoping, and hands-on customer implementations, in close partnership with Sales and Engineering.

RESPONSIBILITIES:

  • Partner with Sales on customer discovery calls (most often second calls, occasionally first calls for large accounts).

  • Lead demos and technical scoping to align on success criteria, architecture, and deployment approach.

  • Own benchmarking and repeatable deployments, including:

  • Handling standard deployment patterns and configurations across many modalities - LLMs, embeddings, image and video generation, VoiceAI, etc.

  • Advising on tradeoffs like H100s vs B200s and latency-optimized vs throughput-optimized setups.

  • Driving consistent “playbook” style deployments for common models and use cases.

  • Become a power user of different runtimes such as vllm, sglang, and TRT-LLM and all the common configurations and tradeoffs between them

  • Drive POC and project execution, including:

  • Scoping POCs and keeping stakeholders aligned on timeline, deliverables, and next steps.

  • Acting as the “ringleader” or project manager for POCs.

  • Pulling in Forward Deployed Engineering (FDE) support when deeper or more complex technical work is needed.

REQUIREMENTS:

  • AI/ML background and the ability to credibly discuss AI/ML topics with technical stakeholders.

  • Strong customer-facing communication skills, including the ability to run structured discovery and clarify ambiguous requirements.

  • Technical depth to scope solutions, without needing to write production code.

  • Ability to script and prototype as needed, including comfort “vibe coding” to move quickly in technical workflows.

NICE TO HAVE:

  • Experience running or supporting benchmarks for ML inference deployments.

  • Familiarity with infrastructure tradeoffs relevant to inference performance and cost (for example GPU selection and latency versus throughput tuning).

  • Experience serving as a cross-functional technical lead for customer POCs, including coordination across Sales and Engineering.

BENEFITS

  • Competitive compensation, including meaningful equity.

  • 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

  • Paid parental leave

  • Fertility and family-building stipend through Carrot

  • Company-facilitated 401(k)

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,530 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
San Francisco
AI Engineer 1 day ago
$25k – $103k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Gurgaon
Python
SQL
Databases
Databricks
Microsoft Fabric
AI/ML
AI Agents
Embeddings
Gemini
Hallucination
LangChain
LangGraph
LLM
Multimodal AI
Prompt Engineering
PyTorch
RAG
Semantic Search
Spark
TensorFlow
Hugging Face
LLM Guardrails
LLMOps
OpenAI
Semantic Search
DevOps
AWS
Azure
CI/CD
Apply
$16k – $36k per year (Estimated) • Remote • Full-Time • Moscow
AI/ML
ChatGPT
Claude
Claude Code
Cursor
LLM
Model Context Protocol
Apply
up to $48k per year (net) • Remote/Hybrid • Moscow
Node JS
Python
TypeScript
JavaScript
Node JS
Nest.JS
Python
Django
FastAPI
Databases
Apache Kafka
pgvector
Pinecone
PostgreSQL
Qdrant
RabbitMQ
Redis
AI/ML
Chain-of-Thought
Claude
Claude Code
Copilot
Cursor
LangChain
LlamaIndex
LLM
Prompt Engineering
RAG
Anthropic
Function Calling
OpenAI
Structured Outputs
Frontend
GraphQL
Next.js
React.js
Redux
Redux Toolkit
Zustand
Mobile
State Management
DevOps
AWS
CI/CD
Docker
GCP
GitHub Actions
GitLab CI
Grafana
Kubernetes
Prometheus
Yandex Cloud
GitHub
GitLab
Apply
$77k – $215k per year (Estimated) • In office • Contractor • 3+ years exp • Singapore
JavaScript
Python
TypeScript
Python
Django
FastAPI
Databases
PostgreSQL
Redis
AI/ML
AI Agents
LangGraph
LLM
Prompt Engineering
LangChain
Edge AI
Frontend
Angular
React.js
Vue.js
Apply
$71k – $170k per year (Estimated) • In office • Full-Time • Netanya
Python
TypeScript
AI/ML
Accelerate
Fine-tuning
LangChain
LLM
NLP
Prompt Engineering
PyTorch
RAG
Edge AI
Hugging Face
AI Agents
DevOps
AWS
Azure
Docker
GCP
Kubernetes
Apply
$165k – $330k per year • Remote/Hybrid • Full-Time • San Francisco • Toronto • New York • Montreal
AI/ML
Cursor
DeepSeek
LLM
SGLang
TensorRT
TensorRT-LLM
vLLM
Management
Notion
Apply
$190k – $240k per year • Remote/Hybrid • Full-Time • San Francisco • New York
JavaScript
TypeScript
AI/ML
Cursor
Frontend
Next.js
React Three Fiber
React.js
Three.JS
Design
Figma
Apply
Product Designer 5 days ago
$225k – $290k per year • Remote/Hybrid • Full-Time • San Francisco • New York
JavaScript
TypeScript
AI/ML
Cursor
Frontend
React.js
DevOps
Git
Apply
AI Engineer 12 days ago
$220k – $260k per year • Remote/Hybrid • Full-Time • 5+ years exp • San Francisco
Python
AI/ML
Claude
Claude Code
Cursor
Fine-tuning
LangChain
LLM
LoRA
Reinforcement Learning
Spark
Synthetic Data
PEFT
LLM Guardrails
OpenAI Codex
Post-training
SFT
AI Agents
Model Context Protocol
Apply
$170k – $220k per year • Remote/Hybrid • Full-Time • 8+ years exp • San Francisco • New York
Go
AI/ML
Cursor
LLM
Post-training
Apply
$223k – $424k per year (Estimated) • In office • Bachelor's Degree • San Francisco
AI/ML
AI Agents
LLM
Recommender Systems
Apply
$160k – $283k per year • Equity • In office • 5+ years exp • San Francisco
AI/ML
AI Agents
Apply
$83k – $188k per year (Estimated) • In office • 2+ years exp • San Francisco
Python
AI/ML
AI Agents
LLM Guardrails
Model Context Protocol
DevOps
Terraform
Cybersecurity
Crowdstrike
GDPR
Least Privilege
Okta
SentinelOne
Management
Google Workspace
Slack
Apply
$171k – $273k per year • In office • Full-Time • 8+ years exp • PhD • San Francisco • Washington
AI/ML
A2A
Agentforce
AI Agents
Model Context Protocol
DevOps
AWS
GCP
Marketing
Salesforce
Apply
Security GRC Analyst 2 hours ago
$119k – $268k per year (Estimated) • Remote/Hybrid • 4+ years exp • Bachelor's Degree • San Francisco
AI/ML
Ignite
PyTorch
Cybersecurity
ISO 27001
NIST CSF
SOC 2
Apply
See all jobs
This is one of many
368,530 more open roles from verified company boards, updated every day.