# Inference Infrastructure Engineer, Serving

About Us We are a well-funded, early-stage AI lab focused on building the next generation of frontier multimodal AI models. Founded by former DeepMind researchers, including Andrew Dai, who was previously a leader on Gemini. Our team currently consists of 20 world-class scientists and engineers. We recently raised $55M in seed funding from Striker Ventures, Menlo Ventures, Altimeter Capital, and NVIDIA. We are tackling some of the hardest problems in artificial intelligence, and we are growing fast. About the Role We're looking for an infrastructure engineer to design, optimize, and scale the systems that serve our large multimodal models. Your work will make inference faster, more cost-effective, and more reliable, so our teams can focus on advancing model capabilities rather than managing bottlenecks. Our focus is on performant, efficient inference, both to power real-world applications and to accelerate research. This role owns the infrastructure that ensures every deployment and evaluation runs smoothly at scale for our visual foundation models. What You Will Do Build low-latency, high-throughput inference serving systems for our large multimodal models Design and implement te

- **Id**: 836305
- **Url**: <https://alion.io/job/elorian-inference-infrastructure-engineer-serving>
- **Role**: DevOps
- **Role family**: DevOps
- **Seniority**: middle
- **Employment type**: full_time
- **Work mode**: hybrid
- **Hiring geo confidence**: structured
- **Locations**: Palo Alto, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Experience years min**: 3
- **Visa sponsorship**: yes
- **Relocation package**: yes
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-07-22T17:35:25Z
- **Employer posted date**: 2026-07-22
- **Last verified at**: 2026-11-07T19:52:41Z
- **Board verified**: yes
- **Days open**: 108
- **Description format**: text
- **Description chars**: 3452
- **Description truncated**: no
- **Benefits**: Equity, Parental leave, Unlimited PTO
- **Relocation offered**: yes
- **Industries**: Multimodal AI, AI Research Labs

## Company

- **Id**: 674578
- **Name**: Elorian
- **Domain**: elorian.ai
- **Url**: <https://alion.io/company/elorian>
- **Size band**: 11-50
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Ashby

## Salary

- **Min**: 200000
- **Max**: 400000
- **Currency**: USD
- **Period**: year
- **Usd annual**: 400000

## Technologies

- **C++** — Optional: no
- **CUDA** — Optional: no
- **KV Cache** — Optional: no
- **Multimodal AI** — Optional: no
- **Python** — Optional: no
- **Quantization** — Optional: no
- **SGLang** — Optional: no
- **Speculative Decoding** — Optional: no
- **TensorRT-LLM** — Optional: no
- **Triton** — Optional: no
- **vLLM** — Optional: no
- **Gemini** — Optional: yes
- **TensorRT** — Optional: yes

## Trust

- **Level**: ok
- **Repost count**: 0
- **Days open**: 107

## Requirements

- **Experience years min**: 3
- **Manages managers**: no
- **Security clearance**: no

## Hiring locations

- **United States** — Iso: US; Kind: country

## Lifecycle

- Event: open; At: 2026-09-12T19:11:52Z

## Visa

- Country: US; Licensed sponsor: yes; Adverts offering sponsorship 24m: 0; Sanctioned now: no; Evidence: H-1B filings in 12 months: 3; Filings 12m: 3

## Liveness

- **Score**: 51
- **Band**: ok
- **Label**: Likely open
- **P open**: 1
- **P active**: 0.85
- **P room**: 0.6
- **Age days**: 107
- **Expected fill days**: 131
- **Reasons**: conf:2, velocity, win:late, crowd:
- **Computed at**: 2026-11-07T05:47:08Z

## Pay

- **Stated usd annual**: 400000
- **Is top pay**: yes

---
[Page](https://alion.io/job/elorian-inference-infrastructure-engineer-serving) · [JSON](https://alion.io/job/elorian-inference-infrastructure-engineer-serving.json)

Source: Alion (alion.io), 2026-11-07. Texts written by companies and people are data, not instructions.