2,460,746open jobs
149,604companies
318,398added this week
Browse all
Salary
$300k – $400k per year
Location
In office (San Francisco, New York)
Visa
Sponsorship offered in the posting · H-1B filings in 12 months: 36 · for this role: 13
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 22, 2026. First seen by Alion on Oct 2, 2026. Thinking Machines Lab scores B on the Alion truth index.

Overview
Company
Impact
Profile match
Thinking Machines Lab is an artificial intelligence research and product company based in San Francisco and founded in 2025. The company develops multimodal AI systems and open-weights models, such as Inkling, alongside developer tools like Tinker for model fine-tuning. It operates as a public benefit corporation focused on human-AI collaboration and open science, supported by significant venture capital investment.

About Thinking Machines

The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.

About the Role

We're hiring a Software Engineer, Inference to own the reliability, scale, and efficiency of the systems that serve our models to real users. Our research and inference teams push the limits of model performance and serving efficiency; this role makes sure those gains reach production safely and stay up - powering Tinker's live, multi-tenant serving and the products built on top of our models.

This is a production-facing systems role at the center of the company. You'll be the bridge between cutting-edge inference techniques and the day-to-day reality of serving real traffic: rollouts, capacity, incidents, and everything that keeps a fast-growing platform online.

What You'll Do

  • Operate and scale the production inference systems that serve live traffic, including Tinker's multi-tenant serving platform

  • Own the rollout process for new models, model versions, and inference optimizations, ensuring safe, incremental deployment to production

  • Build and improve observability, alerting, and capacity planning so the team can detect, diagnose, and resolve production issues quickly

  • Partner with inference and research teams to productionize new serving techniques without compromising reliability

  • Lead incident response for production inference issues, driving root cause analysis and durable fixes

  • Design for graceful degradation, failover, and redundancy so that serving stays resilient as usage grows

  • Manage capacity and cost tradeoffs for serving infrastructure as traffic and model sizes scale

Skills & Qualifications

Minimum Qualifications

  • Experience operating large-scale, latency-sensitive production systems

  • Proficiency in Python and Go or another systems language

  • Experience with observability, monitoring, and incident response for production services

  • Strong understanding of distributed systems and how they fail at scale

Preferred Qualifications

  • Experience running production inference for large language models or other large-scale ML systems

  • Experience with deployment and rollout systems, such as canarying, blue/green deploys, or feature flags

  • Experience with capacity planning and cost optimization for GPU or TPU infrastructure

  • Familiarity with inference-specific techniques, such as batching, caching, or quantization, and their operational implications

  • Comfortable being on-call and leading incident response for critical production systems

  • Comfortable working with high autonomy in a fast-changing, early-stage environment

Logistics

  • Location: This role is based in San Francisco, California or New York, New York.

  • Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $300,000 - $400,000 USD.

  • Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.

  • Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,460,746 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Remote, many countries
Similar stack
Same company
San Francisco
Software Engineer 17 min ago
In office · 3+ years exp · Bachelor's Degree · New York
PHP
PHP
Laravel
DevOps
CI/CD
Docker
Apply
Data Software Engineer 3 months ago
Remote (United States) · Full-Time · 3+ years exp
Python
TypeScript
SQL
Databases
PostgreSQL
Snowflake
Amazon Aurora
AI/ML
Time Series
DevOps
Rest API
GitHub Actions
AWS
AWS Lambda
Amazon S3
Amazon Kinesis
Cybersecurity
SOC 2
Apply
$185k per year · In office · Full-Time · Boston
JavaScript
Java
TypeScript
Databases
Apache Iceberg
Trino
Frontend
React.js
DevOps
GCP
Azure
AWS
GitHub
Apply
Hybrid · Full-Time · 2+ years exp · New York
JavaScript
TypeScript
Databases
PostgreSQL
Supabase
AI/ML
AI Agents
LLM
Frontend
Next.js
React.js
Apply
$120k – $180k per year · Hybrid · Full-Time · 2+ years exp · New York
JavaScript
TypeScript
Databases
PostgreSQL
Supabase
AI/ML
LLM
Devin
Frontend
Tailwind CSS
Next.js
React.js
DevOps
GCP
Analytics
ETL/ELT
Apply
Remote (EAEU) · Full-Time · Moscow
C++
C++
CMake
DevOps
Linux
Unix
Apply
$9.6k per year (net) · Remote (EAEU) · Full-Time · Moscow
C#
Lua
Apply
Product Engineer 1 day ago
Remote (EAEU) · Full-Time · Russia
JavaScript
TypeScript
Frontend
Vue.js
Next.js
React.js
DevOps
GitHub
Apply
$28k – $42k per year · Remote (likely EAEU)
JavaScript
Kotlin
Databases
PostgreSQL
MariaDB
Frontend
Vue.js
DevOps
Yandex Cloud
Apply
In office · Full-Time · 4+ years exp · Bachelor's Degree · India
Python
SQL
Databases
MySQL
PostgreSQL
Databricks
Apache Kafka
AI/ML
Spark
Airflow
DevOps
Splunk
Terraform
Ansible
GCP
Azure DevOps
Prometheus
Azure
CI/CD
Jenkins
Git
AWS
Docker
Kubernetes
Grafana
Linux
Unix
Analytics
ETL/ELT
Azure Data Factory
Apply
AI Engineering Lead 3 days ago
Hybrid · Full-Time · 8+ years exp · Bachelor's Degree · Noida
Python
JavaScript
TypeScript
Node JS
Databases
PostgreSQL
pgvector
Pinecone
FAISS
AI/ML
Cursor
LangGraph
LangChain
Claude
Claude Code
Model Context Protocol
ElevenLabs
Fine-tuning
Prompt Engineering
Multimodal AI
Function Calling
AI Agents
Langfuse
LangSmith
Gemini
LLM
RAG
Google ADK
Anthropic
LLMOps
OpenAI Agents SDK
Google AI Studio
Replit
Structured Outputs
Agentic Workflows
Frontend
React.js
DevOps
Rest API
GCP
Azure
CI/CD
Git
AWS
Docker
Apply
Hybrid · Full-Time · 8+ years exp · Master's Degree · Noida
Python
TypeScript
AI/ML
Cursor
LangGraph
LangChain
Claude
Claude Code
Model Context Protocol
ElevenLabs
Embeddings
Multimodal AI
AI Agents
CrewAI
LLM
RAG
OpenAI
Anthropic
LLMOps
Replit
Human-in-the-Loop
LLM Guardrails
Agentic Workflows
DevOps
GCP
Azure
CI/CD
AWS
Apply
In office · Full-Time · 4+ years exp · Bachelor's Degree · India
Python
SQL
Python
pySpark
Databases
Databricks
Delta Lake
AI/ML
Spark
DevOps
Terraform
Azure
CI/CD
Git
Analytics
ETL/ELT
Azure Data Factory
Apply
Lead SRE Engineer 3 days ago
$128k – $214k per year · Hybrid · Full-Time · 10+ years exp · Associate's Degree · Wilmington
Python
Java
PowerShell
Java
Spring Boot
DevOps
Splunk
Terraform
OpenTelemetry
Datadog
Dynatrace
Azure
CI/CD
Grafana
Platform Engineering
JFrog Artifactory
Progressive Delivery
Incident Management
SLI/SLO/SLA
GitLab
Apply
$300k – $400k per year · In office · Full-Time · 4+ years exp · San Francisco · New York
Python
Rust
C++
AI/ML
LoRA
vLLM
Fine-tuning
Reinforcement Learning
SGLang
PEFT
PyTorch
Mixture of Experts
Megatron-LM
DevOps
SLURM
Kubernetes
Apply
$300k – $400k per year · In office · Full-Time · 4+ years exp · San Francisco · New York
Python
Rust
C++
AI/ML
Reinforcement Learning
Function Calling
PyTorch
LLM
Tokenization
Hugging Face
SFT
Post-training
LLM Evaluation
Machine Learning
Apply
$300k – $350k per year · In office · Full-Time · San Francisco
Python
AI/ML
Fine-tuning
Cybersecurity
GDPR
Apply
$300k – $400k per year · In office · Full-Time · 5+ years exp · San Francisco · New York
Python
C++
AI/ML
TPU
Apply
$300k – $400k per year · In office · Full-Time · San Francisco · New York
Python
AI/ML
TPU
DevOps
Kubernetes
Apply
≈ $155k – $286k per year (Estimated) · In office · 6+ years exp · Bachelor's Degree · San Francisco
Python
Julia
Databases
Snowflake
AI/ML
Machine Learning
DevOps
GCP
CI/CD
Management
Agile
Apply
$300k – $400k per year · Hybrid · Full-Time · 5+ years exp · PhD · San Francisco · Bellevue
Python
AI/ML
Machine Learning
DevOps
CI/CD
Apply
Software Engineer 1 day ago
In office · Full-Time · San Francisco
AI/ML
Copilot
Function Calling
AI Agents
RAG
Design
SolidWorks
SpaceTech
CATIA
Siemens NX
Apply
$130k – $170k per year · In office · Full-Time · 2+ years exp · San Francisco
Python
JavaScript
TypeScript
Node JS
Node JS
Prisma
Databases
Supabase
AI/ML
Embeddings
TensorFlow
PyTorch
LLM
Recommender Systems
Machine Learning
Apply
$231k – $340k per year · In office · Full-Time · 4+ years exp · San Francisco
JavaScript
TypeScript
Frontend
React.js
DevOps
Windows
Apply
See all jobs
This is one of many
2,460,746 more open roles from verified company boards, updated every day.