Ray Serve Jobs - Remote & On-site

Ray Serve jobs at vetted startups and product companies, updated daily. Explore senior and specialized Ray Serve opportunities with competitive pay and remote-friendly options at some companies. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Executive
Networking
Product
Design
Analytics
Support
Enterprise Apps
Quantum

Saviynt
saviynt.com
We're building revolutionary identity and security solutions to help the world's largest companies migrate to the cloud and solve the toughest security challenges in record time. What's our secret? Our people. We're a global group of innovators wh...
saviynt.com • San Francisco • Bengaluru • Milpitas • Delhi • Atlanta • Artificial Intelligence • Cybersecurity • Identity Management • 501-1000 employees
San Francisco • Bengaluru • Milpitas • Delhi • Atlanta • Artificial Intelligence • Cybersecurity • Identity Management • 501-1000 employees
Top 25% payVerified live · 6 hours ago 3 months ago

AI Platform Engineer, Training and Inference
$274k – $304k per year • Remote/Hybrid (Milpitas, United States) • Bachelor's Degree • Full-Time
Python
Databases
pgvector
Qdrant
PostgreSQL
AI/ML
Fine-tuning
LLM
MLFlow
ONNX
PyTorch
Quantization
RAG
Ray
Ray Serve
RLHF
RLlib
SGLang
TensorRT
vLLM
Triton
Flyte
FSDP
GRPO
NCCL
PPO
AWQ
Bitsandbytes
GPTQ
Post-training
DevOps
Google GKE
Vector
GCP
Kubernetes
Amazon S3
QA
k6
Apply
Report

Baseten
baseten.co
Baseten is an AI infrastructure platform designed to help developers and machine learning teams deploy, serve, and scale open-source and custom AI models. The platform provides performant, low-latency inference infrastructure alongside developer tools like Truss, an open-source model packaging framework. Headquartered in San Francisco, California, Baseten enables companies to run state-of-the-art models in production seamlessly without managing underlying cloud infrastructure.
baseten.co • HQ: San Francisco, United States • Hardware • Machine Learning • AI Infrastructure • Artificial Intelligence
HQ: San Francisco, United States • Hardware • Machine Learning • AI Infrastructure • Artificial Intelligence
Top 25% payVerified live · 5 hours ago 3 months ago

Engineering Manager, Forward Deployed Engineering (LLM)
$260k – $380k per year • Lead • 4+ years exp • Remote/Hybrid (San Francisco, New York, United States, Toronto, Montreal, Canada) • Bachelor's Degree • Full-Time • Staff
Python
AI/ML
ComfyUI
Cursor
LLM
Ray
Ray Serve
Spark
TensorRT
vLLM
Whisper
Triton
Hugging Face
DevOps
Docker
Management
Notion
Apply
Report

Blockchain Capital
blockchaincapital.com
Blockchain Capital is one of the earliest dedicated digital asset venture firms, founded in 2013 in San Francisco. It has invested across many funds in exchanges, infrastructure, decentralised finance and consumer applications. The firm was also a pioneer of tokenised fund structures, issuing a security token to represent limited partner interests.
blockchaincapital.com • HQ: San Francisco, United States • Blockchain & Crypto • Est. 2013
HQ: San Francisco, United States • Blockchain & Crypto • Est. 2013
Open 115 daysVerified live · 2 hours ago 3 months ago

Senior AI Compute Infrastructure Engineer
≈ $90k – $170k per year (Estimated) • Senior • 5+ years exp • Panama • Remote (United Kingdom, Argentina, Brazil, Bulgaria, Canada) • Full-Time • Senior
Python
C++
Rust
AI/ML
KServe
Ray
Ray Serve
TensorRT
Triton
Triton Inference Server
vLLM
TorchServe
CUDA
CUDA Toolkit
DeepSpeed
AWS Trainium
FSDP
Megatron-LM
NCCL
TPU
DevOps
Kubernetes
AWS
Apply
Report

Fathom
fathom.ai
Fathom captures, transcribes, and summarizes Zoom, Google Meet, and Microsoft Teams calls. Free for individuals, with AI-powered CRM updates for teams.
fathom.ai • Productivity Software • LLM & Generative AI • Artificial Intelligence • Est. 2020
Productivity Software • LLM & Generative AI • Artificial Intelligence • Est. 2020
Open 117 daysVerified live · 8 hours ago 3 months ago

AI Engineer - Model Performance
≈ $138k – $302k per year (Estimated) • Remote (United States) • Master's Degree • Full-Time
Python
AI/ML
Axolotl
CUDA Toolkit
Fine-tuning
LLM
LoRA
Multimodal AI
Prompt Engineering
QLoRA
Quantization
Ray
Ray Serve
SGLang
TensorRT
TensorRT-LLM
torchtune
vLLM
PEFT
PyTorch
CUDA
DPO
SFT
Speech Recognition
DevOps
GitHub
Management
Notion
Slack
Marketing
HubSpot
Apply
Report

Sesame AI
sesame.com
Sesame AI is a company founded in 2022 that develops conversational speech models with unusually natural timing and prosody. Its demonstration voices drew wide attention for sounding present in a conversation rather than reading text aloud, and it released a base speech model openly. The company is also building lightweight eyewear intended to keep an assistant available throughout the day.
sesame.com • HQ: San Francisco, United States • Est. 2022
HQ: San Francisco, United States • Est. 2022
Open 118 daysTop 25% pay 3 months ago

Staff Software Engineer, Backend Infrastructure
$175k – $280k per year • Equity • Staff+ • 7+ years exp • In office (San Francisco, New York, Bellevue, United States) • Full-Time • Staff
KServe
PyTorch
Ray
Ray Serve
Seldon Core
TorchServe
DevOps
Kubernetes
AWS
CloudFormation
Pulumi
Terraform
Apply
Report

SatSure
satsure.co
SatSure builds decision analytics from satellite imagery and other geospatial data. Its products serve agricultural lending, insurance, infrastructure and climate risk. Banks and government bodies use its crop and land intelligence.
satsure.co • HQ: Bengaluru, India • Data & Analytics • Decision Intelligence • Artificial Intelligence • Est. 2017
HQ: Bengaluru, India • Data & Analytics • Decision Intelligence • Artificial Intelligence • Est. 2017
Open 151 day 4 months ago

Senior Cloud/DevOps Engineer (SDE - 3)
≈ $25k – $63k per year (Estimated) • Senior • 5+ years exp • Remote/Hybrid (Bengaluru, India) • Bachelor's Degree • Full-Time • Senior
Python
Python
Dask
AI/ML
Airflow
KServe
LLM
Ray
Ray Serve
vLLM
DevOps
Amazon EC2
Amazon EKS
Ansible
ArgoCD
AWS
Azure
Azure AKS
Error Budget
FinOps
GCP
GitOps
Google GKE
Grafana
Helm
Istio
Karpenter
Kubernetes
Loki
Mimir
OpenTelemetry
Prometheus
Service Mesh
SLI/SLO/SLA
Terraform
Amazon CloudWatch
Amazon S3
IAM
Bitbucket
CI/CD
Datadog
Envoy
Jenkins
Cybersecurity
CIS Benchmarks
ISO 27001
Keycloak
Apply
Report
Ray Serve Jobs - Remote & On-site
Frequently asked questions
Ray Serve: how many jobs are available now?
There are 26 Ray Serve job listings on Alion right now.
Ray Serve: what is the typical salary for these roles?
The average salary for Ray Serve roles on Alion is about $273,294 USD based on our aggregated data.
Ray Serve: are Ray Serve roles remote or do they offer relocation or visa sponsorship?
Ray Serve roles can be remote or hybrid, and some employers may offer relocation or visa sponsorship-verify details on each listing.
Ray Serve: how do I apply for Ray Serve jobs on Alion?
Sign up on Alion, complete your profile, search for Ray Serve openings, and apply directly through the job page or employer link.