706,396open jobs
41,960companies
98,709added this week
Browse all
Salary
$250k – $300k per year
Location
In office (San Francisco, New York)
Seniority
Staff · 5+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match
Modal is an AI infrastructure company headquartered in New York City and founded in 2021. It provides a serverless cloud platform featuring sub-second cold starts and instant autoscaling that enables developers to run GPU-accelerated workloads, including model inference and fine-tuning, using a Python-native SDK. The company operates a globally distributed compute network designed for AI applications and serves a diverse range of industries such as generative AI and biotechnology.

About Us:

AI needs a new infrastructure layer. We're building it at Modal.

Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.

Our customers include category-defining companies like Lovable, Ramp, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.

We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September.

Our team includes creators of popular open-source projects (e.g.,Seaborn,Luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.

The Role:

We are looking for strong engineers with experience and interest in designing, building, and maintaining the novel, high-performance systems that make up our serverless platform. Specifically, you'll be working on the distributed object storage system that underpins every container image, volume, and checkpoint on Modal: hundreds of petabytes of data, replicated across multiple cloud object stores and a CDN, cached on local NVMe across a large fleet of workers in many datacenters, and shared peer-to-peer within each datacenter. You'll make cold starts feel local when the data is hundreds of milliseconds away, designing the caching, preloading, and peer-to-peer layers that hide object-store latency and keep public ingress off saturated uplinks. You'll own durability and cost at petabyte scale, from streaming and batch replication between origins, to garbage collection over billions of objects. You'll work across the stack, from local disk and page cache to distributed blob storage and garbage collection and you'll help shape what storage becomes next as we push storage closer to workloads.

Requirements:

  • 5+ years of experience writing high-quality production code

  • Experience building high-performance distributed storage or caching systems at a large scale (the more challenges you've worked through, the better)

  • Strong cloud skills, including deep familiarity with object storage (S3 or similar), CDNs, and their consistency, throughput, and cost characteristics

  • Strong knowledge of low-level operating system foundations (Linux kernel, file systems, page cache, containers, etc.)

  • Willingness to step into the thick of it with our on-call rotation and respond to production incidents

Nice-to-Haves:

  • Experience with replication, content addressing, and consistency models in multi-region or multi-cloud systems

  • Experience operating storage systems at scale (petabyte-scale datasets, high-throughput read/write paths, large-scale garbage collection or data migration)

  • Experience with data engineering at petabyte-scale.

  • Prior experience with Rust

Key Things the Team Is Working On:

  • P2P sharing of data across workers within a single datacenter to dramatically reduce ingress

  • Replicating data across multiple blob storage providers

  • Automating garbage collection across hundreds of petabytes of data

  • Deploying colocated storage clusters to datacenters to accelerate high-throughput customer workloads

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
706,396 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
San Francisco
$85k – $184k per year (Estimated) • Remote/Hybrid • Full-Time • Belfast
Python
Java
C
C++
Bash
C
ZeroMQ
Databases
KDB+
Apache Kafka
AI/ML
Pandas
NumPy
Time Series Forecasting
Machine Learning
DevOps
GCP
OpenShift
CI/CD
Git
AWS
Docker
Kubernetes
Platform Engineering
GitHub
Linux
Unix
Management
Agile
Apply
$126k – $257k per year (Estimated) • In office • Full-Time • Bachelor's Degree • West Valley City
Python
Java
C#
C++
Structured Text
DevOps
Git
Linux
Robotics
EtherCAT
Apply
$231k – $267k per year • Equity • Remote/Hybrid • 10+ years exp • San Mateo
Python
Ruby
Bash
DevOps
GitOps
Linux
Windows
Cybersecurity
Okta
Crowdstrike
Zero Trust
Microsoft Entra ID
PKI
Management
Google Workspace
Apply
$125k – $253k per year • Equity • In office • 10+ years exp • Santa Clara
Python
Java
DevOps
CI/CD
Docker
Kubernetes
Linux
Windows
VPN
Cybersecurity
Zero Trust
DLP
Apply
$160k – $190k per year • In office • Full-Time • 6+ years exp • San Francisco
JavaScript
TypeScript
Node JS
Databases
PostgreSQL
Snowflake
DynamoDB
Frontend
React.js
DevOps
AWS CDK
AWS
AWS Fargate
AWS Lambda
Amazon S3
Amazon ECS
Cybersecurity
HIPAA
Apply
$270k – $330k per year • In office • Full-Time • 7+ years exp • San Francisco • New York
Rust
DevOps
Amazon S3
Linux
Analytics
Seaborn
Matplotlib
Apply
$270k – $330k per year • In office • Full-Time • 7+ years exp • New York
AI/ML
NVLink
DevOps
Linux
Analytics
Seaborn
Matplotlib
Apply
$250k – $300k per year • In office • Full-Time • 5+ years exp • San Francisco • New York
Python
AI/ML
NVLink
DevOps
Linux
BGP
Analytics
Seaborn
Matplotlib
Apply
$140k – $276k per year (Estimated) • In office • Full-Time • 3+ years exp • New York
AI/ML
AI Agents
DevOps
CI/CD
Analytics
Seaborn
Matplotlib
Apply
Account Manager 6 days ago
$300k per year • Remote • Full-Time • San Francisco • New York
Analytics
Seaborn
Matplotlib
Apply
$245k – $279k per year • In office • Full-Time • 8+ years exp • Bachelor's Degree • San Francisco • McLean • Cambridge • San Jose • New York
Python
Go
Java
C#
C++
Scala
C++
PyTorch C++
AI/ML
CUDA Toolkit
AI Agents
PyTorch
LLM
CUDA
Hugging Face
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
Machine Learning
DevOps
GCP
Azure
AWS
Apply
$245k – $279k per year • In office • Full-Time • 10+ years exp • Bachelor's Degree • McLean • San Francisco • Richmond • Chicago • New York
Python
Go
JavaScript
Rust
TypeScript
C#
Scala
AI/ML
AI Agents
Machine Learning
DevOps
GCP
Azure
AWS
HPC
Apply
Cloud Engineer 5 7 hours ago
$230k – $262k per year • In office • Full-Time • 8+ years exp • Bachelor's Degree • McLean • San Francisco • San Jose • Richmond • New York
Python
JavaScript
Java
Node JS
Scala
DevOps
Terraform
GCP
CloudFormation
Crossplane
Pulumi
Azure
CI/CD
AWS
Docker
Kubernetes
Apply
$197k – $225k per year • In office • Full-Time • 4+ years exp • Bachelor's Degree • San Jose • San Francisco • McLean • Cambridge • New York
Python
Go
Java
C#
C++
Scala
C++
PyTorch C++
AI/ML
CUDA Toolkit
Fine-tuning
AI Agents
PyTorch
LLM
CUDA
Hugging Face
TPU
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
Machine Learning
DevOps
GCP
Azure
AWS
Apply
$219k – $250k per year • In office • Full-Time • 5+ years exp • Master's Degree • San Jose • San Francisco • McLean • Cambridge • New York
AI/ML
Fine-tuning
RLHF
Quantization
NLP
Transfer Learning
VLM
PyTorch
LLM
Tokenization
Self-Supervised Learning
Hugging Face
SFT
Pre-training
Machine Learning
DevOps
AWS
Apply
See all jobs
This is one of many
706,396 more open roles from verified company boards, updated every day.