# Senior Inference Engineer, AGI

We are looking for a Senior Inference Engineer to own inference for real-time multimodal conversational AI. This is a full-stack inference role: you will work across the entire path a model takes from research to production - shaping model architecture so it is servable, building the real-time runtime that serves it within hard latency budgets, and building the offline systems that train and reinforce it. You will operate at the boundary of Science and Inference, taking frontier-scale speech and audio models and making them run within real-time latency budgets on production hardware. You will co-design architectures with scientists to make them inference-friendly from inception, own the low-latency streaming serving path, and build the training and reinforcement-learning infrastructure that closes the loop. You will have the compute, data, and runway to solve problems that few teams in the world are positioned to tackle. As a Senior Engineer, you will own a significant area of the inference stack end to end, drive its technical execution, contribute to the team's roadmap, and work closely with scientists and hardware partners to ensure our models run fast enough to feel human in re

- **Id**: 2787995
- **Url**: <https://alion.io/job/amazon-senior-inference-engineer-agi-2>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Seniority**: senior
- **Employment type**: full_time
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Boston, United States, Seattle, United States, Sunnyvale, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Experience years min**: 5
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: yes
- **Status**: live
- **First seen at**: 2026-08-17T00:00:00Z
- **Employer posted date**: 2026-11-19
- **Last verified at**: 2026-11-19T15:02:32Z
- **Board verified**: yes
- **Days open**: 94
- **Description format**: text
- **Description chars**: 8824
- **Description truncated**: no
- **Benefits**: Health insurance, Parental leave, Restricted stock units
- **Relocation offered**: no
- **Industries**: Advertising, Cloud Platforms (IaaS & PaaS), Logistics, Streaming & OTT Platforms

## Company

- **Id**: 19
- **Name**: Amazon
- **Domain**: amazon.com
- **Url**: <https://alion.io/company/amazon>
- **Size band**: 5000+
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Career site

### Truth index

- **Grade**: B
- **Score**: 79
- **Open postings**: 4633
- **Ghost share**: 0.001
- **Stale share**: 0.819
- **Repost share**: 0.004
- **Time to fill p50 days**: 35
- **Computed at**: 2026-11-19T09:08:57Z

## Salary

- **Min**: 193300
- **Max**: 261500
- **Currency**: USD
- **Period**: year
- **Usd annual**: 261500

## Technologies

- **KV Cache** — Optional: no
- **LLM** — Optional: no
- **Multimodal AI** — Optional: no
- **Post-training** — Optional: no
- **PyTorch** — Optional: no
- **Quantization** — Optional: no
- **Reinforcement Learning** — Optional: no
- **RLAIF** — Optional: no
- **RLHF** — Optional: no
- **Speculative Decoding** — Optional: no
- **vLLM** — Optional: no
- **AWS** — Optional: yes
- **AWS Trainium** — Optional: yes
- **CUDA** — Optional: yes
- **CUTLASS** — Optional: yes
- **Knowledge Distillation** — Optional: yes
- **Model Distillation** — Optional: yes
- **NCCL** — Optional: yes
- **NVLink** — Optional: yes
- **SFT** — Optional: yes
- **Speech Recognition** — Optional: yes
- **TensorRT** — Optional: yes
- **TensorRT-LLM** — Optional: yes
- **Triton** — Optional: yes

## Trust

- **Level**: ok
- **Days open**: 94

## Requirements

- **Experience years min**: 5
- **Management years min**: 4
- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: bachelor
- **Optional**: yes

## Lifecycle

- Event: open; At: 2026-10-17T16:57:57Z
- Event: close; At: 2026-11-19T01:49:32Z
- Event: reopen; At: 2026-11-19T15:02:32Z

## Visa

- Country: US; Licensed sponsor: yes; Adverts offering sponsorship 24m: 0; Sanctioned now: no; Evidence: H-1B filings in 12 months: 1,581 · green card filings: 555; Filings 12m: 1581

## Liveness

- **Score**: 18
- **Band**: cold
- **Label**: Long shot
- **P open**: 1
- **P active**: 0.645
- **P room**: 0.28
- **Age days**: 94
- **Expected fill days**: 35
- **Reasons**: conf:3, win:tail, crowd:brand
- **Computed at**: 2026-11-19T18:31:25Z

## Pay

- **Stated usd annual**: 261500
- **Is top pay**: yes

---
[Page](https://alion.io/job/amazon-senior-inference-engineer-agi-2) · [JSON](https://alion.io/job/amazon-senior-inference-engineer-agi-2.json)

Source: Alion (alion.io), 2026-11-19. Texts written by companies and people are data, not instructions.
