406,377open jobs
14,133companies
78,486added this week
Browse all
Salary
$164k – $307k per year (Estimated)
Location
Remote/Hybrid (Foster City, United States)
Seniority
Staff
Employment
Full-Time
Overview
Company
Impact
Profile match
Alluxio is a high-performance distributed caching layer built for large-scale AI workloads. Alluxio maximizes I/O throughput and minimizes I/O latency for model training, model deployment, inference cold starts, feature store queries and more — all without replacing your existing storage.

About Alluxio

Alluxio powers the data layer for modern AI and analytics. Proven in production at eight of the top ten internet companies and seven of the ten highest-valued enterprises globally, Alluxio’s data orchestration platform unifies data across storage systems, regions, and clouds providing a high-performance distributed caching layer built for large-scale AI workloads.

Spun out of UC Berkeley’s AMPLab by the creators of Tachyon and backed by Andreessen Horowitz, Hillhouse Capital, and Seven Seas Partners, Alluxio sits at the intersection of data, distributed systems, and AI infrastructure.

Our technology is deployed at scale by organizations such as Meta, Uber, Tencent, TikTok, Alibaba, Expedia, Rakuten, Microsoft, and Walmart, orchestrating data for billions of operations per day. Learn more at alluxio.io or on Wikipedia.

The Role

We’re looking for experienced distributed-systems engineers to join our Core Product team and advance the next generation of Alluxio’s data-orchestration engine - the foundation for AI and analytics at global scale.

As a Staff Software Engineer, you’ll work on high-impact systems problems such as:

1. Optimizing metadata management, caching, and replication across thousands of nodes.

2. Designing concurrent, fault-tolerant services for multi-region and multi-cloud environments.

3. Evolving Alluxio’s storage abstraction and scheduling layer to support large-scale AI/ML data pipelines.

4. Collaborating with internal product teams to push the limits of distributed I/O performance.

This is a hands-on, architecture-plus-implementation role for engineers who love deep systems work and want visible impact in a small, senior, highly technical team.

What You’ll Own

  • Cache and metadata consistency - advance Alluxio’s intelligent caching framework for multi-tenant environments (TTL policies, write-back consistency, invalidation protocols, and distributed metadata scaling).
  • High-throughput data I/O optimization - profile and optimize Alluxio’s data path across S3, GCS, HDFS, and POSIX interfaces using adaptive prefetching, async I/O, and tier-aware scheduling.
  • Scaling for AI and analytics workloads - evolve the coordination layer to efficiently serve distributed AI training clusters, accelerating model load and shuffle operations across regions and clouds.
  • Observability and performance insights - build fine-grained metrics and tracing for cache efficiency, throughput, and latency across storage tiers.
  • Open-source leadership - drive design discussions, mentor contributors, and represent Alluxio’s core-systems direction within the OSS community.

What You’ll Do

  • Design and implement core components of Alluxio’s distributed file and object-access layer.
  • Optimize performance for large-scale, high-throughput environments using advanced concurrency and caching techniques.
  • Build scalable metadata and coordination systems that ensure strong consistency, high availability, and minimal latency.
  • Collaborate cross-functionally with product, solution-engineering, and research teams to drive roadmap and customer success.

What We’re Looking For

  • Strong computer-science fundamentals and a passion for large-scale distributed systems.
  • Professional experience developing in Java, C++, or Go.
  • Deep understanding of concurrency, replication, fault tolerance, and performance optimization.
  • Experience with distributed storage, data-access layers, or cloud infrastructure (e.g., Spark, Presto, Hadoop, Kubernetes).
  • Bachelor’s or advanced degree in Computer Science or related technical field (or equivalent experience).
  • Demonstrated technical leadership: defining architecture, mentoring peers, or driving major projects from design through release.

Why Alluxio

  • Build infrastructure trusted by the world’s largest AI and data-driven companies.
  • Join a small, senior engineering team where your designs shape the product’s evolution.
  • Work directly with the original creators of open-source Alluxio.
  • A culture of empathy, curiosity, and ownership - where engineers collaborate closely to solve hard problems.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
406,377 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Foster City
$115k – $190k per year • Remote/Hybrid • High School Diploma • Ashburn
JavaScript
TypeScript
Java
Java
Spring Boot
Spring Framework
Databases
Apache Kafka
ElasticSearch
Kafka
MySQL
PostgreSQL
RabbitMQ
AI/ML
Hadoop
Frontend
Angular
React.js
Vue.js
DevOps
Amazon EC2
Amazon EKS
Amazon S3
AWS
AWS Lambda
CI/CD
Docker
GitLab
GitLab CI
gRPC
Jenkins
Kubernetes
Apply
$115k – $190k per year • Remote/Hybrid • High School Diploma • Ashburn
Java
SQL
Java
Apache Tomcat
Gradle
Hibernate
Maven
Spring Boot
Databases
Apache Solr
Cassandra
DynamoDB
ElasticSearch
MySQL
Oracle
PostgreSQL
AI/ML
Hadoop
Jupyter Notebook
Spark
DevOps
Amazon EC2
Amazon S3
AWS
Bamboo
Bitbucket
CI/CD
Git
Jenkins
Rest API
Management
Confluence
Jira
Apply
$142k – $236k per year • In office • Bachelor's Degree
C++
Java
Python
Rust
DevOps
Kali Linux
Apply
$77k – $129k per year • In office • 5+ years exp • High School Diploma
C++
Java
MATLAB
Python
SQL
MATLAB
Simulink
Web3
Solana
Robotics
ArduPilot
Mission Planner
QGroundControl
Apply
In office • 5+ years exp • Bachelor's Degree
Ruby
TypeScript
Ruby
Ruby on Rails
Databases
ElasticSearch
Redis
DevOps
Amazon S3
AWS
AWS Lambda
CDKTF
CI/CD
CircleCI
Docker
GitHub
GitHub Actions
Jenkins
Terraform
Apply
In office • Full-Time • 8+ years exp • Bachelor's Degree
Go
Java
Python
DevOps
AWS
Azure
CI/CD
GCP
Jenkins
Apply
In office • 1+ year exp • Bachelor's Degree
C++
Java
Apply
$134k – $241k per year (Estimated) • Equity • Remote/Hybrid • Full-Time • 5+ years exp • Foster City
AI/ML
AI Agents
LangChain
PyTorch
RAG
Ray
TensorFlow
Triton
Wikipedia
DevOps
AWS
Azure
GCP
Kubernetes
Apply
$138k – $248k per year (Estimated) • Remote/Hybrid • Full-Time • Bachelor's Degree • Foster City
C++
Java
AI/ML
Hadoop
Wikipedia
DevOps
Amazon S3
Kubernetes
Apply
In office • Full-Time • 2+ years exp • Bachelor's Degree • Beijing
C++
Java
Apply
$56k – $94k per year • In office • Contractor • Foster City
Apply
$64k – $74k per year • In office • Contractor • Foster City
Apply
$56k per year • In office • Contractor • Foster City
Apply
$84k – $94k per year • In office • Contractor • Foster City
Apply
Cohort 0 2 days ago
In office • Full-Time • Bachelor's Degree • Foster City
AI/ML
AI Agents
Replit
Apply
See all jobs
This is one of many
406,377 more open roles from verified company boards, updated every day.