# GPU Engineer

About Kog At Kog, we're building real-time LLM inference for AI agents. Coding agents execute sequences of tasks where each step depends on the model's previous response. The faster the model generates tokens, the faster these agents can reason, code, and act. Our approach is to co-design model architecture, the inference engine, and low-level GPU kernels to minimize generation latency on standard NVIDIA and AMD datacenter GPUs. We've developed several technologies to make this possible: Monokernel: a persistent GPU program that keeps the entire token generation loop on the GPU, avoiding CPU handoffs. KCCL: our custom inter-GPU communication layer, designed to minimize latency. Delayed Tensor Parallelism (DTP): a model architecture that overlaps communication with computation and weight loading. Laneformer 2B: our code-generation model demonstrating this co-design approach. Our engineers work directly with GPU hardware, using CUDA, PTX, HIP, and CDNA ISA to optimize execution. Implementing and optimizing a new AI model for a specific GPU architecture can take months of manual engineering. Meanwhile, new models are constantly being released. Our goal is to use AI agents to imple

- **Id**: 3975438
- **Url**: <https://alion.io/job/kog-labs-gpu-engineer-2>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Employment type**: full_time
- **Work mode**: remote
- **Remote scope**: stated_countries
- **Remote scope basis**: posting_text
- **Hiring geo confidence**: explicit
- **Locations**: Paris, France
- **Countries**: FR
- **Hiring countries**: FR
- **Hiring countries total**: 1
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-09T15:00:23Z
- **Employer posted date**: 2026-11-09
- **Last verified at**: 2026-11-09T17:52:39Z
- **Board verified**: yes
- **Days open**: 0
- **Description format**: text
- **Description chars**: 3773
- **Description truncated**: no
- **Relocation offered**: yes
- **Industries**: AI Research Labs, AI Compute & Inference

## Company

- **Id**: 185339
- **Name**: Kog Labs
- **Domain**: kog.ai
- **Url**: <https://alion.io/company/kog-labs>
- **Size band**: 11-50
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Ashby

## Technologies

- **AI Agents** — Optional: no
- **C++** — Optional: no
- **CUDA** — Optional: no
- **HPC** — Optional: no
- **LLM** — Optional: no
- **ROCm** — Optional: no

## Trust

- **Level**: ok
- **Days open**: 0

## Requirements

- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: phd
- **Optional**: no

## Hiring locations

- **France** — Iso: FR; Kind: country

## Lifecycle

- Event: open; At: 2026-11-09T17:52:39Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 0
- **Expected fill days**: 15
- **Reasons**: conf:0, win:early
- **Computed at**: 2026-11-09T18:31:18Z

---
[Page](https://alion.io/job/kog-labs-gpu-engineer-2) · [JSON](https://alion.io/job/kog-labs-gpu-engineer-2.json)

Source: Alion (alion.io), 2026-11-09. Texts written by companies and people are data, not instructions.