368,634open jobs
9,437companies
50,578added this week
Browse all
Salary
$170k – $230k per year
Location
In office (Palo Alto)
Seniority
Middle · 3+ years exp
Overview
Company
Impact
Profile match
We're building the omnicloud for AI We're building the omnicloud for AI Mithril exists to make cloud compute more accessible, efficient, and powerful for AI developers.

About Mithril

Mithril is an AI infrastructure platform built to make GPU compute more accessible and affordable for the world’s leading enterprises, AI startups, and the AI research community, including LG AI Research, Saronic, and the Broad Institute (among many others).

Founded by a former Google DeepMind research scientist and Stanford CS PhD, Mithril has raised $80M across seed and Series A funding led by Sequoia Capital & Lightspeed Venture Partners. Platform revenue has grown >6x over the past year, and we were recently recognized by Fast Company as the 8th Most Innovative Company in Artificial Intelligence for 2026.

Our engineering team is lean and high-impact. This role is a core infrastructure hire that will shape how Mithril scales its platform across a heterogeneous, multi-cloud environment.

About the Opportunity

You will be a core contributor to the stability and performance of Mithril's global GPU orchestration platform. This is not a 'keep the lights on' role - you will build the automation, observability, and tooling that allows Mithril to coordinate advanced compute across multiple cloud providers at scale, ensuring customers have fast, reliable access to the infrastructure they need.

You will work directly with our founding team on high-impact infrastructure decisions - from SLO design to capacity orchestration - with clear visibility into the technical and commercial dynamics of the business.

What Makes This Role Different

Most SRE roles at this stage are primarily reactive - on-call, incident management, keeping services stable. At Mithril, you'll also be building infrastructure that directly shapes how our marketplace operates: how supply is sourced, allocated, and monitored across providers. The systems you build will have a direct line to customer experience and company revenue.

You'll have real ownership, a short feedback loop to leadership, and the opportunity to define how infrastructure engineering operates as the company scales.

Core Responsibilities

Platform reliability and infrastructure automation are the primary focus of this role (~70-75% of time).

Reliability & SLOs

  • Implement and own SLIs and SLOs across Mithril's API layer and internal orchestration services to ensure customer commitments are met.
  • Partner with Product and Platform teams to ensure new features are designed for operability, reliability, and performance from the start.
  • Participate in an on-call rotation; drive root cause analysis (RCA) for production incidents and implement durable fixes to prevent recurrence.

Observability & Monitoring

  • Build and maintain dashboards, alerts, and distributed tracing within Mithril's monitoring stack to provide high-granularity visibility into our multi-cloud infrastructure.
  • Own the tooling that surfaces supply-side signal - GPU availability, provider health, reservation fill rates - to both engineering and operations teams.

Infrastructure as Code & Automation

  • Develop and maintain Terraform/Pulumi modules and Kubernetes configurations to manage Mithril's growing multi-cloud provider footprint.
  • Write clean, maintainable Python (or Go) to automate repetitive operational tasks - from provider API reconciliation to automated health checks and capacity rebalancing.

Capacity Support

  • Assist in managing GPU capacity across providers, ensuring the marketplace can dynamically respond to supply fluctuations and customer demand signals.
  • Surface capacity constraints and failure modes early; contribute to the tooling that enables Mithril to make fast, data-driven supply decisions.

Requirements

The profile we're hiring for combines strong systems instincts with the ability to build and own tooling end-to-end. Candidates should be able to point to infrastructure or automation they've built that is still running in production.

  • 3+ years of experience in SRE, Production Engineering, or Infrastructure roles at a high-growth technology company.
  • Hands-on Kubernetes experience: comfortable managing clusters, deployments, and troubleshooting production incidents in a multi-tenant environment.
  • Cloud proficiency in at least one major provider (AWS, GCP, or Azure), including practical understanding of cloud networking fundamentals (VPC, DNS, load balancing, security groups).
  • Coding ability: proficiency in Python or equivalent (Go, Rust, etc.) - you build tools and services, not just scripts. Willing to pick up new languages as needed.
  • Linux fundamentals: strong command of Linux systems, TCP/IP networking, and security best practices.
  • Disciplined troubleshooter: calm under pressure during production incidents, with a rigorous approach to RCA and long-term remediation.
  • Clear communicator: able to document processes and explain technical trade-offs to engineering and non-engineering teammates.

Nice to Have

  • Experience with GPU/TPU-accelerated workloads or AI/ML infrastructure.
  • Exposure to multi-cloud deployments or niche/specialized cloud providers (e.g., CoreWeave, Lambda Labs, Nebius).
  • Familiarity with distributed systems concepts - service discovery, circuit breakers, consensus protocols.
  • Production experience with Prometheus, Grafana, or OpenTelemetry.
  • Prior experience in a high-growth startup environment where infrastructure scope expands faster than headcount.

Benefits

  • Health, dental, and vision coverage for you and your dependents
  • 401k Plan with 4% company match
  • 21 days of PTO & 14 company holidays; including 2 floating holidays

Salary Range Information 

In consideration of market analysis and various pertinent factors, the remuneration bracket for this role is set between $170,000 and $230,000. Nevertheless, adjustments beyond this range could be warranted for candidates whose qualifications substantially deviate from those delineated in the job description.

In-Office Requirement

At Mithril, we take our work extremely seriously, though not always ourselves. We recognize that we are striving to achieve something substantial-an all-too-rare and elusive counterfactual contribution. Our work is not easy, so we seek out any lever that can accelerate our progress and increase the likelihood of realizing our full ambitions. Working collaboratively in person is one such lever.

Our headquarters is in Palo Alto (very near the Caltrain station) and we recently opened a second office in the Jackson Square area of San Francisco. We expect team members to primarily work from their local office (Palo Alto or SF), with everyone gathering at HQ a minimum one day a week while our team remains small and cross-collaboration is critical.

This approach is built on trust. We take our mission seriously and are committed to fostering an environment where you can make impactful decisions and drive success. We also understand that life can present challenges, and if extenuating circumstances arise, we’re here to support you.

Ultimately, we believe this guidance helps us be as effective as possible while maintaining the spirit of teamwork and flexibility.

Equal Opportunity Employer

Mithril maintains a strict commitment to Equal Opportunity employment practices. All applicants are evaluated without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.

We emphasize that candidates need not fulfill every expectation listed to be eligible for this position. Our objective is to cultivate a diverse team encompassing a spectrum of backgrounds, experiences, and skill sets.

 

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,634 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Palo Alto
$22k – $58k per year (Estimated) • In office • Full-Time • Pune
AI/ML
Claude
Claude Code
Copilot
AI Agents
DevOps
ArgoCD
AWS
Azure
Backstage
CI/CD
Docker
GCP
GitHub Actions
Jenkins
Kubernetes
Platform Engineering
GitHub
Apply
$29k – $70k per year (Estimated) • Remote/Hybrid • Full-Time • 11+ years exp • Bachelor's Degree • Hyderabad
Python
SQL
Databases
Databricks
Snowflake
DevOps
AWS
Azure
CI/CD
Apply
$71k – $154k per year (Estimated) • In office • Full-Time • Dublin
Java
Databases
Apache Kafka
AI/ML
Copilot
LLM
LLM Guardrails
DevOps
AWS
CI/CD
Kubernetes
GitHub
Apply
$75k – $198k per year (Estimated) • In office • Full-Time • Dublin
Java
Kotlin
Java
Spring Boot
Databases
Amazon Aurora
Apache Kafka
PostgreSQL
DevOps
AWS
CI/CD
Dynatrace
GitLab CI
Kubernetes
Trunk-Based Development
GitLab
Apply
$99k – $219k per year (Estimated) • In office • Full-Time • Dublin
Java
Kotlin
Databases
Amazon Aurora
PostgreSQL
DevOps
AWS
CI/CD
GitLab CI
Kubernetes
GitLab
Apply
$170k – $230k per year • In office • PhD • Palo Alto
Python
TypeScript
JavaScript
Databases
Apache Kafka
RabbitMQ
AI/ML
SkyPilot
Frontend
React.js
tRPC
DevOps
AWS
Docker
Docker Swarm
GCP
Grafana
gRPC
Kubernetes
Kustomize
Prometheus
Terraform
WebSockets
Apply
$170k – $230k per year • In office • PhD • Palo Alto
Python
TypeScript
JavaScript
Databases
Apache Kafka
RabbitMQ
AI/ML
SkyPilot
Frontend
React.js
tRPC
DevOps
AWS
Docker
Docker Swarm
GCP
Grafana
gRPC
Kubernetes
Kustomize
Prometheus
Terraform
WebSockets
Apply
Chief of Staff 8 hours ago
$120k – $150k per year • Equity 0.4–0.7% • In office • Full-Time • 3+ years exp • Palo Alto
AI/ML
AI Agents
Apply
$140k – $310k per year (Estimated) • Remote/Hybrid • Bachelor's Degree • Palo Alto
Databases
Apache Kafka
NATS
DevOps
AWS
Azure
CI/CD
Docker
GCP
Grafana
gRPC
Kubernetes
OpenTelemetry
Platform Engineering
Prometheus
Robotics
EtherCAT
IoT
MQTT
OPC UA
Apply
$139k – $294k per year (Estimated) • In office • Palo Alto
Python
AI/ML
Fine-tuning
Hybrid Search
LLM
Prompt Engineering
RAG
Human-in-the-Loop
Knowledge Graph
AI Agents
Function Calling
DevOps
AWS
Apply
$137k – $292k per year (Estimated) • In office • Palo Alto
Python
AI/ML
Hybrid Search
LLM
Prompt Engineering
RAG
Human-in-the-Loop
AI Agents
Function Calling
DevOps
AWS
Apply
$150k – $271k per year (Estimated) • Remote/Hybrid • Full-Time • 5+ years exp • Bachelor's Degree • Palo Alto
C++
Java
Python
Rust
AI/ML
LLM
Apply
See all jobs
This is one of many
368,634 more open roles from verified company boards, updated every day.