2,455,751open jobs
150,314companies
310,047added this week
Browse all
Salary
$150k – $295k per year
Location
In office (Santa Clara)
Seniority
Staff · 6+ years exp
Visa
H-1B filings in 12 months: 47 · for this role: 32
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 21, 2026. First seen by Alion on Nov 20, 2026. Baseten scores B on the Alion truth index.

Overview
Company
Impact
Profile match
Baseten is an American company founded in 2019 that runs machine learning models in production for companies that would rather not operate GPU infrastructure themselves. Its position is inference rather than training: it handles model packaging, autoscaling, cold start latency and multi-cloud capacity, which are the unglamorous problems that determine whether a model-powered product is fast and affordable enough to ship. Headquartered in San Francisco and backed at a multi-billion dollar valuation, it serves companies deploying open and custom models, and it competes with both the hyperscalers and the model providers' own hosted endpoints.

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

As a Data Center Hardware Operations Site Lead at Baseten, you'll own the physical infrastructure behind our GPU fleet at one of our data center sites. You'll plan and lead the installation, cabling, and turn-up of new GPU clusters, keep existing clusters healthy through break/fix and upgrades, and decommission hardware when it's time. You'll work closely with our DC facilities, network, and hardware systems engineering teams across the full bare metal server lifecycle.

This is a senior, fully on-site role with a lot of ownership. You'll be the technical and project lead for your site and its first point of escalation when something goes wrong, whether that's a failed switch or a cooling alarm. You'll direct the day-to-day work of the FTE and contractor staff at your site, and partner with Site Leads at our other locations and our data center infrastructure lead to keep standards consistent across the fleet.

EXAMPLE INITIATIVES

The GPU clusters you deploy and maintain power work like this:

RESPONSIBILITIES

  • Lead the physical deployment of new GPU clusters at your site, including rack and stack, cabling, and turn-up in partnership with the network and hardware systems engineering teams.

  • Plan white space for new and existing data halls with DC Facilities, including cabinet positions, fiber tray design, rack elevations, and the power, cooling, and network capacity needed for high-density GPU racks.

  • Support new data hall bring-up through site walks, drawing review, and construction-to-operations turnover.

  • Own break/fix and hardware lifecycle at your site, from diagnosing failures and coordinating RMAs to executing upgrades, switch refreshes, and decommissioning with minimal disruption to production.

  • Work with the network team to test and turn up new cross connects and remediate links that are taking errors.

  • Act as the site's first point of escalation for facility issues such as power, cooling, or leak alarms, working with DC Facilities to assess impact on hardware and coordinate a response.

  • Write, review, and execute MOPs and SOPs for hardware work at your site, and run regular inspections and audits of installed equipment.

  • Manage and schedule FTE and contractor labor at your site, including low voltage cabling vendors deploying structured cabling.

  • Own logistics and inventory at your site, including receiving, spares management, and keeping DCIM asset location data accurate.

  • Define and maintain site standards and safety practices with peer Site Leads and the data center infrastructure lead, and mentor HW Ops team members at your site.

REQUIREMENTS

  • Bachelor's degree in a technical field or equivalent practical experience.

  • 6+ years of experience in data center operations, with at least 2 years in a lead or supervisory role.

  • Hands-on experience racking, stacking, and cabling servers and network gear at scale, including copper and fiber.

  • Experience across the full bare metal server lifecycle: installation, break/fix, upgrades, and decommissioning.

  • Comfort on the Linux command line for hardware diagnostics, using tools like ipmitool, dmesg, and lspci.

  • Working knowledge of data center networking, enough to troubleshoot optics, transceivers, and link errors.

  • Working knowledge of data center mechanical and electrical systems, including power distribution (UPS, PDUs, RPPs, busway), cooling (CRAH/CRAC units, containment, liquid cooling), and BMS/EPMS alarms, enough to recognize issues and escalate them with clear technical context.

  • A track record of leading data center projects end to end, such as cluster deployments or data hall builds.

  • Experience directing contractors and vendors and coordinating work across facilities, network, and engineering teams.

  • Sound judgment and quick prioritization under pressure, including knowing when to escalate.

  • Ability to work on-site at [location], lift up to 50 lbs, work in elevated locations, and participate in an on-call rotation supporting 24/7 operations.

NICE TO HAVE

  • Experience deploying and maintaining large NVIDIA GPU clusters (HGX/DGX platforms such as H100, H200, or B200).

  • Hands-on experience with direct liquid cooling, including CDUs, rear door heat exchangers, and leak response.

  • Construction and commissioning experience, such as reviewing submittals or witnessing tests for new data halls.

  • Experience with high-performance interconnects such as InfiniBand or RoCE.

  • Experience with Cisco IOS, Juniper Junos, or similar network operating systems.

  • Experience with DCIM tools such as NetBox.

  • Scripting in Python or Bash to automate diagnostics or inventory tasks.

  • Certifications such as CompTIA Server+ or Network+.

  • Prior experience standing up a new site from scratch.

BENEFITS

  • Competitive compensation, including meaningful equity

  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Flexible PTO policy

  • Paid parental leave

  • Fertility and family-building stipend through Carrot

  • (U.S. only) Company-facilitated 401(k)

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,455,751 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

DevOps
Remote, many countries
Similar stack
Same company
Santa Clara
In office · Full-Time · Austin
Python
Go
TypeScript
Frontend
GraphQL
DevOps
Kong
AWS
API Gateway
Cybersecurity
Kyverno
Auth0
OWASP
Apply
$140k – $165k per year · Equity · Remote (United States) · Full-Time · Norfolk
Python
Databases
Databricks
Delta Lake
DevOps
Terraform
Azure DevOps
Azure
CI/CD
Git
AWS
GitHub
Apply
$117k – $178k per year · Hybrid · Full-Time · 10+ years exp · Bachelor's Degree · United States
Python
Go
Java
TypeScript
Databases
DynamoDB
OpenSearch
Amazon Aurora
DevOps
Splunk
Terraform
Helm
GitHub Actions
VMWare
AWS CDK
CloudFormation
Prometheus
GitLab CI
CI/CD
ArgoCD
Jenkins
AWS
Kubernetes
Grafana
Platform Engineering
Service Mesh
Amazon EKS
AWS Lambda
Amazon EC2
FinOps
SLI/SLO/SLA
Amazon S3
IAM
Amazon ECS
Amazon CloudWatch
API Gateway
DNS
Cybersecurity
Wazuh
ISO 27001
SOC 2
HIPAA
Defense in Depth
Least Privilege
SIEM
MedTech
ISO 13485
21 CFR Part 11
Apply
$132k – $206k per year · Hybrid · Full-Time · 10+ years exp · Bachelor's Degree · Rockville
Python
Go
Java
TypeScript
Databases
DynamoDB
OpenSearch
Amazon Aurora
DevOps
Splunk
Terraform
Helm
GitHub Actions
VMWare
AWS CDK
CloudFormation
Prometheus
GitLab CI
CI/CD
ArgoCD
Jenkins
AWS
Kubernetes
Grafana
Platform Engineering
Service Mesh
Amazon EKS
AWS Lambda
Amazon EC2
FinOps
SLI/SLO/SLA
Amazon S3
IAM
Amazon ECS
Amazon CloudWatch
API Gateway
DNS
Cybersecurity
Wazuh
ISO 27001
SOC 2
HIPAA
Defense in Depth
Least Privilege
SIEM
MedTech
ISO 13485
21 CFR Part 11
Apply
$117k – $178k per year · In office · Full-Time · 10+ years exp · Bachelor's Degree · Rockville
Python
Perl
Databases
MySQL
PostgreSQL
Oracle
MariaDB
DevOps
Terraform
Ansible
Red Hat
OpenShift
VMWare
Debian
CI/CD
Git
AWS
Docker
Kubernetes
Ubuntu
Configuration Management
CentOS Stream
Linux
Windows
DNS
Cybersecurity
CIS Benchmarks
CVE
Active Directory
LDAP
Management
ITIL
Apply
DevOps Engineer 1 day ago
Remote (EAEU) · 3+ years exp · Minsk
Python
SQL
PowerShell
Bash
Databases
MySQL
PostgreSQL
DevOps
Terraform
Docker Compose
Azure DevOps
GitHub Actions
Azure
CI/CD
AWS
Docker
Kubernetes
Bicep
Bitbucket
GitLab
Windows
Apply
Hybrid · Full-Time · Tbilisi
DevOps
Loki
OpenTelemetry
Prometheus
Git
Grafana
Alertmanager
Error Budget
SLI/SLO/SLA
Apply
Hybrid · Full-Time · Almaty
DevOps
Loki
OpenTelemetry
Prometheus
Git
Grafana
Alertmanager
Error Budget
SLI/SLO/SLA
Apply
up to $44k per year · Remote (EAEU) · Freelance · Moscow
JavaScript
PHP
Databases
PostgreSQL
Apache Kafka
Frontend
Next.js
React.js
DevOps
Prometheus
GitLab CI
CI/CD
GitOps
Kubernetes
Ubuntu
Nginx
Grafana
CentOS Stream
GitLab
Linux
Cybersecurity
HashiCorp Vault
Management
Jira
Apply
up to $51k per year (net) · Remote (EAEU) · Moscow
Python
Bash
DevOps
Terraform
Ansible
Zabbix
Loki
Debian
Prometheus
CI/CD
Docker
Kubernetes
Ubuntu
Grafana
Chaos Engineering
KVM
QEMU
OpenStack
SLI/SLO/SLA
Linux
VLAN
BGP
Apply
In office · Full-Time · 8+ years exp · Bachelor's Degree · Santa Clara
Python
AI/ML
AI Agents
DevOps
CI/CD
Configuration Management
Linux
Windows
Apply
$195k – $377k per year · In office · Full-Time · 12+ years exp · PhD · Santa Clara · New York · Seattle
Prolog
AI/ML
NCCL
NVLink
DevOps
SLURM
Kubernetes
SRE
GitHub
Apply
Engineering Lead 1 day ago
≈ $146k – $291k per year (Estimated) · Hybrid · 5+ years exp · Bachelor's Degree · Santa Clara
JavaScript
Java
TypeScript
Java
Maven
Spring Boot
Hibernate
Spring MVC
Spring Security
Spring Cloud
Gradle
Databases
Oracle
RabbitMQ
Apache Kafka
AI/ML
Prompt Engineering
LLM
RAG
OpenAI
Frontend
Angular
Bootstrap
React.js
Mobile
Clean Architecture
DevOps
Rest API
GCP
GitHub Actions
Azure
CI/CD
Jenkins
AWS
Docker
Kubernetes
Amazon EKS
Google GKE
Azure AKS
SOAP
Management
Agile
Apply
COOK (FULL TIME) 1 day ago
$52k per year · In office · Full-Time · Santa Clara
Apply
≈ $28k – $52k per year (Estimated) · In office · Full-Time · Santa Clara
Apply
See all jobs
This is one of many
2,455,751 more open roles from verified company boards, updated every day.