1,810,876open jobs
104,168companies
274,976added this week
Browse all
Salary
≈ $151k – $276k per year (Estimated)
Location
In office (San Mateo)
Seniority
Senior · 5+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 17, 2026. First seen by Alion on Jun 22, 2026.

Overview
Company
Impact
Profile match
Parasail is an AI inference cloud company providing serverless access to GPUs across a distributed network. It describes its product as an AI Supercloud that helps AI teams deploy and scale inference with performance and reliability, and it hires forward deployed engineers, site reliability engineers and partnerships staff. The company is headquartered in San Mateo, California, United States.

Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed network of GPUs, optimizing for cost, performance, and flexibility. Our mission is to empower AI developers with a fast, cost-efficient, and scalable cloud experience-free from vendor lock-in and designed for the next generation of AI workloads.

The Senior Software Engineer, Distributed Systems role at Parasail is crucial for ensuring the seamless deployment, scalability, and security of our AI platform. This position is tailored for individuals passionate about creating robust infrastructures that support complex AI workloads, with a strong emphasis on cloud compatibility, security, ease of use, and cost savings. You will work closely with AI-focused performance and solutions engineering teams, facilitating the orchestration of resources needed for high-performing AI applications, all while ensuring our infrastructure adheres to the highest standards of security and data privacy.

Technical Abilities

  • Microservice Architecture: Deep understanding of distributed application design patterns, service decomposition, and inter-service communication. Experience in building scalable and maintainable microservice-based systems.

  • Backend Development: Strong foundation in storage solutions and networking protocols. Ability to design and implement robust backend systems with optimized data management and network communication.

  • Programming Languages & Frameworks: Extensive experience with Java, Spring Boot, and Golang. Proficiency in developing enterprise-grade applications using modern development frameworks and tools.

  • Distributed Systems: Deep knowledge of distributed computing principles, including consistency models, fault tolerance, and scalability patterns. Experience in designing and maintaining large-scale distributed applications.

  • Cloud-Native Technologies: Proficiency in cloud platforms and Infrastructure as Code (IaC). Experience with containerization, orchestration, and automated infrastructure deployment using modern DevOps practices.

  • Large Language Models: Understanding of LLM technologies and their applications. Experience in integrating and working with AI language models in production environments, including model deployment and optimization.

Qualifications

  • 5+ years of experience in backend or infrastructure, with exposure in Kubernetes and distributed computing environments.

  • Demonstrated ability to build and secure scalable, high-performance backend.

  • Hands-on to build brand new system and make end to end work

  • Excellent problem-solving skills, with a track record of designing solutions that address the complex needs of AI workloads.

  • While AI experience is not required, a demonstrated capacity to learn new technologies and stay up-to-date on the cutting edge is essential.

What You Bring to the Table

This role is pivotal in building a new breed of cloud architecture that enables enterprises to build powerful AI in their preferred environment with the same performance and economics as uncontrolled external services. This role ensures our AI solutions are not just innovative but also secure and sustainable. If you're passionate about learning the cutting edge of AI, building the future of infrastructure, and making a tangible impact to the early days of a company, we're excited to welcome you aboard.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,810,876 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
San Mateo
$144k – $194k per year • Equity • In office • Full-Time • 3+ years exp • Bachelor's Degree • Seattle
Java
C#
C++
Perl
AI/ML
Machine Learning
DevOps
CI/CD
AWS
Apply
$144k – $194k per year • Equity • In office • Full-Time • 3+ years exp • Bachelor's Degree • Austin
Java
C#
C++
Perl
AI/ML
AI Agents
Apply
$144k – $194k per year • Equity • In office • Full-Time • 4+ years exp • Bachelor's Degree • Annapolis Junction
Rust
DevOps
AWS
Apply
$144k – $194k per year • Equity • In office • Full-Time • 3+ years exp • Bachelor's Degree • Austin
Python
Java
C#
C++
Perl
AI/ML
Spark
DevOps
AWS
AWS Fargate
AWS Lambda
Amazon S3
Amazon ECS
Management
Agile
Scrum
Apply
$144k – $194k per year • Equity • In office • Full-Time • 3+ years exp • Bachelor's Degree • Arlington
Java
C#
C++
Perl
Databases
Neo4j
Amazon Neptune
AI/ML
AI Agents
LLM
Knowledge Graph
Apply
$74k – $186k per year • In office • Full-Time • Tokyo
Python
Rust
Kotlin
TypeScript
Ruby
Databases
PostgreSQL
DynamoDB
ElasticSearch
OpenSearch
Google BigQuery
BigQuery
AI/ML
LLM
DevOps
Terraform
GCP
Datadog
Azure
AWS
Docker
Kubernetes
GitHub
Apply
$74k – $186k per year • In office • Contractor • Tokyo
Python
Java
Kotlin
TypeScript
SQL
Java
Spring Boot
Gradle
Kotlin
Ktor
Databases
PostgreSQL
ElasticSearch
Apache Kafka
DevOps
Splunk
GCP
GitHub Actions
Azure
AWS
Cloudflare
Google Cloud Run
GitHub
Apply
In office • Japan
AI/ML
LLM
Apply
$36k – $53k per year • In office • Tokyo
AI/ML
LLM
Apply
$58k – $102k per year • In office • Full-Time • Japan
AI/ML
LLM
RAG
Feature Store
Analytics
ETL/ELT
Apply
≈ $96k – $248k per year (Estimated) • In office • Full-Time
AI/ML
vLLM
SGLang
OpenAI
DevOps
Kubernetes
Linux
Apply
≈ $76k – $210k per year (Estimated) • In office • Full-Time
AI/ML
vLLM
SGLang
OpenAI
DevOps
CI/CD
Kubernetes
Linux
Apply
≈ $132k – $256k per year (Estimated) • In office • Full-Time • San Mateo
AI/ML
vLLM
SGLang
OpenAI
DevOps
CI/CD
Kubernetes
Linux
Apply
≈ $161k – $306k per year (Estimated) • In office • Full-Time • 5+ years exp • San Mateo
Python
Java
Rust
C++
AI/ML
vLLM
Quantization
SGLang
TensorRT
TensorRT-LLM
LLM
Anomaly Detection
Triton
Speculative Decoding
DevOps
CI/CD
Kubernetes
SRE
Platform Engineering
Linux
Apply
$200k – $220k per year • In office • Full-Time • Master's Degree • San Francisco
Apply
≈ $178k – $358k per year (Estimated) • Equity • Hybrid • 10+ years exp • San Mateo
Marketing
LinkedIn
Apply
$36k – $42k per year • In office • Part-Time • 1+ year exp • High School Diploma • San Mateo
Apply
$36k per year • In office • Part-Time • High School Diploma • San Mateo
Apply
$100k – $130k per year • Hybrid • Boston • San Mateo
Apply
$54k – $64k per year • In office • Full-Time • San Mateo
Apply
See all jobs
This is one of many
1,810,876 more open roles from verified company boards, updated every day.