{"id":3975438,"url":"https://alion.io/job/kog-labs-gpu-engineer-2","title":"GPU Engineer","company":{"id":185339,"name":"Kog Labs","domain":"kog.ai","url":"https://alion.io/company/kog-labs","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Paris, France"],"countries":["FR"],"hiring_countries":["FR"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"HPC","optional":false},{"name":"LLM","optional":false},{"name":"ROCm","optional":false}],"status":"live","first_seen_at":"2026-11-09T15:00:23Z","employer_posted_date":"2026-11-09","last_verified_at":"2026-11-09T17:52:39Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About Kog\nAt Kog, we're building real-time LLM inference for AI agents.\nCoding agents execute sequences of tasks where each step depends on the model's previous response. The faster the model generates tokens, the faster these agents can reason, code, and act.\nOur approach is to co-design model architecture, the inference engine, and low-level GPU kernels to minimize generation latency on standard NVIDIA and AMD datacenter GPUs.\nWe've developed several technologies to make this possible:\nMonokernel: a persistent GPU program that keeps the entire token generation loop on the GPU, avoiding CPU handoffs.\n\nKCCL: our custom inter-GPU communication layer, designed to minimize latency.\n\nDelayed Tensor Parallelism (DTP): a model architecture that overlaps communication with computation and weight loading.\n\nLaneformer 2B: our code-generation model demonstrating this co-design approach.\n\nOur engineers work directly with GPU hardware, using CUDA, PTX, HIP, and CDNA ISA to optimize execution.\nImplementing and optimizing a new AI model for a specific GPU architecture can take months of manual engineering. Meanwhile, new models are constantly being released.\nOur goal is to use AI agents to implement and optimize the models we choose on the GPUs we choose, in a fraction of the time required today.\nThese agents will build on the GPU optimizations and hardware insights our team has developed. They'll explore optimization strategies, generate and modify kernels, verify correctness, benchmark performance on real hardware, and iterate based on the results.\nWe want to make model porting and GPU optimization much faster and repeatable, allowing Kog to keep pace with the latest AI models rather than spending months adapting each one manually.\nThis is a major engineering direction we're now developing, and you'll help shape it.\nLearn more at https://blog.kog.ai.\nWhat you'll work on\nYou'll join our GPU engineering team to tackle challenging performance problems and help build the internal agents that will accelerate this work.\nDevelop and optimize GPU kernels using C++, CUDA, HIP, and low-level instructions.\n\nInvestigate GPU architecture, memory access, synchronization, and execution bottlenecks.\n\nProfile and benchmark workloads to identify and validate performance improvements.\n\nOptimize inference operations and communication across multiple GPUs.\n\nImplement and optimize new AI models on NVIDIA and AMD GPUs.\n\nHelp build AI agents for GPU engineering, enabling automated code optimization, correctness testing, benchmarking, and iterative improvements.\n\nTake ownership of technical decisions and their implementation.\n\nWhat we're looking for\nWe're looking for an experienced GPU Engineer who can contribute quickly and independently to complex performance problems.\nStrong hands-on experience developing and optimizing GPU kernels, ideally using CUDA C++ or HIP/ROCm.\n\nDeep understanding of GPU architecture, memory hierarchy, parallel execution, and performance bottlenecks.\n\nStrong C++ skills and experience profiling and benchmarking GPU workloads.\n\nProven ownership of challenging technical projects, from implementation to measured results.\n\nInterest in developing AI agents and tools to accelerate GPU engineering.\n\nExperience with PTX, CDNA ISA, multi-GPU systems, low-latency inference, or GPU performance portability is particularly valuable.\nA PhD in HPC, computer science, or a related field is a plus when backed by substantial engineering work. Previous experience building AI agents is not required.\nLocation and availability\nCandidates must already be based in Paris or elsewhere in Île-de-France.\nWe are not considering relocation from other regions or countries for this position.\nWe're looking for someone who can join the team quickly.","description_format":"text","description_chars":3773,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"France","iso":"FR","kind":"country"}],"hiring_excludes":[],"relocation_offered":true,"industries":["AI Research Labs","AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-11-09T17:52:39Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":15,"reasons":["conf:0","win:early"],"computed_at":"2026-11-09T18:31:03Z"},"pay":null,"html_url":"https://alion.io/job/kog-labs-gpu-engineer-2","json_url":"https://alion.io/job/kog-labs-gpu-engineer-2.json","meta":{"generated_at":"2026-11-09T18:31:03Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3284,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-10T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":185339},"rest":"https://alion.io/mcp/rest/get_company?id=185339"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fkog-labs-gpu-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fkog-labs-gpu-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fkog-labs-gpu-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/kog-labs-gpu-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fkog-labs-gpu-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3975438}},{"tool":"search_jobs","arguments":{"company":"kog.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3975438},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}