394,870open jobs
13,845companies
76,904added this week
Browse all
Salary
$138k – $248k per year (Estimated)
Location
Remote/Hybrid (Foster City, United States)
Seniority
Senior
Employment
Full-Time
Overview
Company
Impact
Profile match
Alluxio is a high-performance distributed caching layer built for large-scale AI workloads. Alluxio maximizes I/O throughput and minimizes I/O latency for model training, model deployment, inference cold starts, feature store queries and more — all without replacing your existing storage.

About Alluxio

Alluxio powers the data layer for modern AI and analytics. Proven in production at eight of the top ten internet companies and seven of the ten highest-valued enterprises globally, Alluxio’s data orchestration platform unifies data across storage systems, regions, and clouds providing a high-performance distributed caching layer built for large-scale AI workloads.

Spun out of UC Berkeley’s AMPLab by the creators of Tachyon and backed by Andreessen Horowitz, Hillhouse Capital, and Seven Seas Partners, Alluxio sits at the intersection of data, distributed systems, and AI infrastructure.

Our technology is deployed at scale by organizations such as Meta, Uber, Tencent, TikTok, Alibaba, Expedia, Rakuten, Microsoft, and Walmart, orchestrating data for billions of operations per day. Learn more at alluxio.io or on Wikipedia.

The Role

We’re looking for experienced distributed-systems engineers to join our Core Product team and advance the next generation of Alluxio’s data-orchestration engine - the foundation for AI and analytics at global scale.

As a Senior Software Engineer, you’ll work on high-impact systems problems such as:

1. Optimizing metadata management, caching, and replication across thousands of nodes.

2. Designing concurrent, fault-tolerant services for multi-region and multi-cloud environments.

3. Evolving Alluxio’s storage abstraction and scheduling layer to support large-scale AI/ML data pipelines.

4. Collaborating with internal product teams to push the limits of distributed I/O performance.

This is a hands-on, architecture-plus-implementation role for engineers who love deep systems work and want visible impact in a small, senior, highly technical team.

What You’ll Own

  • Cache and metadata enhancements - design and implement improvements to caching policies, eviction logic, and metadata scalability to increase performance and reliability.
  • Data path optimization - refine I/O pipelines for S3/GCS/HDFS/Posix to reduce latency and improve throughput using concurrency and scheduling techniques.
  • Distributed systems reliability - strengthen consistency, replication, and fault-tolerance mechanisms across large-scale clusters.
  • Feature development and integration - collaborate with product and solution-engineering teams to deliver features that support AI and analytics workloads.
  • Code quality and peer collaboration - participate in design reviews, provide constructive feedback, and ensure robust testing and observability in production systems.

What You’ll Do

  • Design, build, and optimize distributed components within Alluxio’s orchestration layer.
  • Investigate performance bottlenecks and propose scalable solutions using profiling, tracing, and benchmarking tools.
  • Collaborate cross-functionally with fellow engineers, architects, and the open-source community to drive improvements.
  • Contribute to releases and stability efforts, ensuring enterprise-grade reliability across global deployments.

What We’re Looking For

  • Strong computer-science fundamentals and a passion for large-scale distributed systems.
  • Professional experience developing in Java, C++, or Go.
  • Practical knowledge of concurrency, replication, distributed coordination, and performance tuning.
  • Experience with distributed storage, caching, or data-access layers (e.g., Spark, Presto, Hadoop, Kubernetes).
  • Bachelor’s or advanced degree in Computer Science or related technical field (or equivalent experience).

Why Alluxio?

  • Build infrastructure trusted by the world’s largest AI and data-driven companies.
  • Join a small, senior engineering team where your designs shape the product’s evolution.
  • Work directly with the original creators of open-source Alluxio.
  • A culture of empathy, curiosity, and ownership - where engineers collaborate closely to solve hard problems.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
394,870 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Foster City
$148k – $265k per year • Equity • In office • Full-Time • 7+ years exp • United States
Java
Node JS
Python
TypeScript
JavaScript
Databases
Apache Kafka
DynamoDB
Kafka
DevOps
Amazon CloudWatch
Amazon EC2
Amazon EKS
Amazon Kinesis
Amazon S3
API Gateway
ArgoCD
AWS
AWS CDK
AWS Lambda
CI/CD
FinOps
GitHub
GitHub Actions
GitOps
Helm
Incident Management
Jenkins
Kubernetes
Platform Engineering
Terraform
Cybersecurity
SOC 2
Apply
$132k – $238k per year • Remote/Hybrid • Full-Time • 5+ years exp • Master's Degree • Brooklyn Park
Python
Databases
Apache Kafka
Kafka
AI/ML
AI Agents
Hadoop
Spark
Vertex AI
DevOps
CI/CD
Docker
GCP
Kubernetes
Rest API
Apply
$230k – $280k per year • Equity • Remote/Hybrid • Full-Time • 6+ years exp • San Francisco
Python
Databases
DynamoDB
AI/ML
LLM
DevOps
Amazon CloudWatch
Amazon ECS
Amazon EKS
Amazon S3
AWS
AWS Lambda
CI/CD
Kubernetes
Cybersecurity
HIPAA
Apply
SOFTWARE ENGINEER 3 10 hours ago
In office • 5+ years exp • Bachelor's Degree
C#
C++
C#
.NET
DevOps
AWS
Azure
GCP
Apply
AI Test Engineer 10 hours ago
Remote/Hybrid • 2+ years exp • Bachelor's Degree
Java
Python
AI/ML
PyTorch
Scikit-learn
TensorFlow
Mobile
JUnit
DevOps
AWS
Azure
CI/CD
GCP
QA
Pytest
Selenium
Apply
In office • Full-Time • 8+ years exp • Bachelor's Degree
Go
Java
Python
DevOps
AWS
Azure
CI/CD
GCP
Jenkins
Apply
In office • 1+ year exp • Bachelor's Degree
C++
Java
Apply
$134k – $241k per year (Estimated) • Equity • Remote/Hybrid • Full-Time • 5+ years exp • Foster City
AI/ML
AI Agents
LangChain
PyTorch
RAG
Ray
TensorFlow
Triton
Wikipedia
DevOps
AWS
Azure
GCP
Kubernetes
Marketing
Salesforce
Apply
$164k – $307k per year (Estimated) • Remote/Hybrid • Full-Time • Bachelor's Degree • Foster City
C++
Java
AI/ML
Hadoop
Wikipedia
DevOps
Amazon S3
Kubernetes
Apply
In office • Full-Time • 2+ years exp • Bachelor's Degree • Beijing
C++
Java
Apply
Cohort 0 2 days ago
In office • Full-Time • Bachelor's Degree • Foster City
AI/ML
AI Agents
Replit
Apply
$170k – $267k per year • Remote/Hybrid • Full-Time • 3+ years exp • Bachelor's Degree • Foster City
Python
Databases
Databricks
AI/ML
LLM
Robotics
Sensor Fusion
Apply
$215k – $230k per year • In office • 8+ years exp • Bachelor's Degree • Foster City
SQL
Apex
Apex
Salesforce Data Cloud
Databases
Snowflake
Analytics
ETL/ELT
Power BI
Tableau
Marketing
Salesforce
Apply
$175k – $195k per year • In office • 3+ years exp • Bachelor's Degree • Foster City
Apply
$215k – $230k per year • In office • 7+ years exp • Bachelor's Degree • Foster City
Apply
See all jobs
This is one of many
394,870 more open roles from verified company boards, updated every day.