# AI Infrastructure Engineer

About Netpreme The biggest bottleneck in AI inference today is memory. Chips can compute faster than they can be fed data, a problem known as the memory wall, and Netpreme is building the solution. Our approach spans the full stack, from a proprietary memory management library down to X-Mem™, our Memory Processing Unit (MPU) silicon. Netpreme was co-founded by researchers in optical networking and ML systems. We’re a small team in Cambridge, MA and Santa Clara, CA, and we’re looking for people who want to own hard problems end to end and help shape where the company goes next. About the Role Serving frontier LLMs efficiently at scale is a moving target: every new model and workload reshuffles the tradeoffs across parallelism, batching, KV caching, and scheduling. You’ll own Netpreme’s inference-serving stack end to end, from tuning vLLM, SGLang, and TensorRT-LLM to architecting distributed serving with NVIDIA Dynamo (prefill/decode disaggregation, KV-cache-aware routing). Working directly with our hardware and systems engineers, you’ll build the benchmarks and drive the optimizations that take new models from research to production. This role will be performed onsite from one of ou

- **Id**: 3299855
- **Url**: <https://alion.io/job/netpreme-ai-infrastructure-engineer>
- **Role**: DevOps
- **Role family**: DevOps
- **Seniority**: junior
- **Employment type**: full_time
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Santa Clara, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Experience years min**: 2
- **Visa sponsorship**: yes
- **Relocation package**: yes
- **Has equity**: yes
- **Status**: live
- **First seen at**: 2026-09-08T18:47:59Z
- **Employer posted date**: 2026-09-08
- **Last verified at**: 2026-11-08T12:34:09Z
- **Board verified**: yes
- **Days open**: 60
- **Description format**: text
- **Description chars**: 5361
- **Description truncated**: no
- **Benefits**: Equity, Relocation assistance
- **Relocation offered**: yes
- **Industries**: Servers & Data Center Hardware, Memory & Storage Chips

## Company

- **Id**: 680646
- **Name**: Netpreme
- **Domain**: netpreme.com
- **Url**: <https://alion.io/company/netpreme>
- **Size band**: 51-200
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Ashby

## Salary estimate

- **Min usd**: 89000
- **Max usd**: 180000
- **Period**: year
- **Method**: role_seniority_country_remote_cell
- **Sample n**: 413

## Technologies

- **Ansible** — Optional: no
- **Function Calling** — Optional: no
- **Helm** — Optional: no
- **Kubernetes** — Optional: no
- **KV Cache** — Optional: no
- **Linux** — Optional: no
- **LLM** — Optional: no
- **Multimodal AI** — Optional: no
- **Python** — Optional: no
- **RAG** — Optional: no
- **SGLang** — Optional: no
- **TensorRT-LLM** — Optional: no
- **TPOT** — Optional: no
- **vLLM** — Optional: no
- **ChatGPT** — Optional: yes
- **Claude** — Optional: yes
- **Quantization** — Optional: yes
- **Speculative Decoding** — Optional: yes
- **TensorRT** — Optional: yes

## Trust

- **Level**: ok
- **Days open**: 60

## Requirements

- **Experience years min**: 2
- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: bachelor
- **Optional**: no

## Lifecycle

- Event: open; At: 2026-10-26T23:19:16Z

## Visa

- Country: US; Licensed sponsor: yes; Adverts offering sponsorship 24m: 6; Sanctioned now: no; Evidence: H-1B filings in 12 months: 1; Filings 12m: 1

## Liveness

- **Score**: 13
- **Band**: cold
- **Label**: Long shot
- **P open**: 1
- **P active**: 0.465
- **P room**: 0.28
- **Age days**: 60
- **Expected fill days**: 29
- **Reasons**: conf:1, win:tail, crowd:junior
- **Computed at**: 2026-11-08T05:47:12Z

---
[Page](https://alion.io/job/netpreme-ai-infrastructure-engineer) · [JSON](https://alion.io/job/netpreme-ai-infrastructure-engineer.json)

Source: Alion (alion.io), 2026-11-08. Texts written by companies and people are data, not instructions.