{"id":4272527,"url":"https://alion.io/job/prosus-ml-infrastructure-acceleration-engineer-llms","title":"ML Infrastructure & Acceleration Engineer - LLMs","company":{"id":15163,"name":"Prosus","domain":"prosus.com","url":"https://alion.io/company/prosus","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":{"grade":"C","score":56,"open_postings":11,"ghost_share":0.727,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-11-12T10:38:37Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Amsterdam, Netherlands"],"countries":["NL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"CUDA","optional":false},{"name":"FSDP","optional":false},{"name":"Grafana","optional":false},{"name":"HPC","optional":false},{"name":"InfiniBand","optional":false},{"name":"Kubernetes","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"NCCL","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Prometheus","optional":false},{"name":"PyTorch","optional":false},{"name":"Quantization","optional":false},{"name":"SGLang","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"SLURM","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"AI Agents","optional":true},{"name":"DeepSpeed","optional":true},{"name":"Hugging Face","optional":true},{"name":"Megatron-LM","optional":true},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-11-13T12:44:08Z","employer_posted_date":null,"last_verified_at":"2026-11-13T12:44:08Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Who We Are\n\nWe are Prosus, a global technology company powering some of the world's leading lifestyle ecommerce businesses. Every day, billions of people across India, Latin America, Europe and beyond use our products and services to buy, sell, pay, connect and discover.\n\nOur AI-driven ecosystem spans 100+ companies across ecommerce, food delivery, fintech and experiences, serving billions of consumers worldwide. AI powers how we operate and innovate, with more than 60,000 active AI agents helping our teams build, scale and move faster. Through our investment team, we also back the founders and technologies shaping the future: From robotics and autonomous systems to synthetic biology and frontier AI.\n\nGuided by our five values Innovation, Results, People, Impact, and Entrepreneurship, culture is our competitive advantage. We thrive with experimentation; we build, we test, we learn, we iterate.\n\nWho we're looking for\n\nWe're seeking an experienced ML Infrastructure & Acceleration Engineer - LLMs to own the GPU infrastructure that powers our LLM training and serving, and to make every workload on it faster and cheaper. You'll run our H200 cluster end to end, deploy models to production, and profile and optimize our training and inference pipelines down to the kernel level when it matters. You understand GPUs from the cluster scheduler to the memory hierarchy, you measure before you optimize, and you're motivated by turning raw compute into faster iteration for our ML team. You thrive in environments where infrastructure reliability and efficiency directly shape how quickly research reaches millions of users.\n\n Amsterdam\n\n Full time\n\n AI & ML\n\nWhat you'll do\n\nGPU Cluster & Infrastructure:\n\n Own our H200 GPU cluster end to end: Kubernetes and Slurm for training and inference workloads, with multi-tenant scheduling, quotas, and resource isolation\n\n Keep large distributed training runs healthy: node health checks, NCCL and interconnect debugging, automated job recovery, and checkpoint management\n\n Track and optimize GPU utilization and cost across training and inference, with dashboards and budget alerting\n\n Manage infrastructure-as-code and provisioning for GPU environments\n\n Define and monitor SLIs/SLOs for cluster availability and production model serving\n\nDeployment & Serving:\n\n Deploy LLMs to production using vLLM or SGLang, with CI/CD, model versioning, and safe rollouts and rollbacks\n\n Monitor serving latency, throughput, errors, and cost, and act on regressions\n\nML Acceleration:\n\n Profile training and inference end to end (PyTorch Profiler, Nsight Systems, Nsight Compute) to find and remove bottlenecks\n\n Improve training throughput and MFU: parallelism strategies (FSDP, tensor and pipeline parallelism), communication/compute overlap, mixed precision and FP8, activation checkpointing, torch.compile\n\n Optimize inference: quantization (FP8, INT8, INT4), speculative decoding, prefix caching, continuous batching, KV cache tuning, and parallelism layouts\n\n Write or integrate fused and custom kernels (Triton, CUDA) where off-the-shelf implementations fall short\n\n Build benchmarking tooling so every optimization ships with measured gains\n\nEnablement & Best Practices:\n\n Partner with ML engineers and researchers to make training and serving efficient by default\n\n Establish best practices for using the cluster and guide teams in their adoption\n\nMinimum qualifications\n\n 5+ years in ML infrastructure, MLOps, HPC, or platform engineering with focus on GPU workloads\n\n Hands-on experience operating multi-node GPU clusters with Kubernetes and/or Slurm, including debugging hardware, networking (NCCL, InfiniBand/RoCE), and job failures\n\n Production experience deploying and optimizing LLM inference with vLLM, SGLang, or TensorRT-LLM\n\n Proven track record of profiling and accelerating GPU workloads, with measured results in throughput, latency, MFU, or cost\n\n Solid understanding of monitoring and observability for GPU systems (Prometheus, Grafana, DCGM, or similar)\n\n Naturally curious with a track record of proactively identifying and implementing improvements\n\nPreferred qualifications\n\n Experience writing custom kernels in Triton or CUDA, and familiarity with fused kernels such as FlashAttention\n\n Performance tuning of distributed training frameworks: FSDP, Megatron-LM, or DeepSpeed\n\n Experience with low-precision training and inference (FP8, INT4) and model compression for production deployment\n\n Deep knowledge of GPU architectures: memory hierarchy, tensor cores, roofline analysis\n\n Experience with multi-tenant GPU scheduling and fair-share resource allocation\n\n Contributions to open-source projects such as vLLM, SGLang, PyTorch, or Triton\n\nWhat we offer\n\n Critical infrastructure ownership for high-impact AI projects that are strategically vital to the company, with direct visibility to senior leadership including the CEO\n\n State-of-the-art GPU infrastructure: H200 fleet, vLLM serving stack, and the freedom to optimize it end to end\n\n Expert ML team who have released top Hugging Face models, published at NeurIPS, and built production systems that will run on your infrastructure\n\n Significant autonomy in choosing tools and shaping our infrastructure and performance strategy\n\n Modern tooling: Latest ML frameworks, coding assistants, best-in-class development environment\n\n Hybrid work model with our Amsterdam office - home to the AI House, bringing together 200+ AI professionals through events and collaborations\n\n Competitive compensation, top-spec MacBook Pro, and an environment genuinely built for professional growth and learning\n\nIf you're excited to own the GPU infrastructure behind cutting-edge LLMs and make every training run and every request faster, let's talk.","description_format":"text","description_chars":5757,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Apple Macbook","Hybrid work"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["E-commerce Platforms","Investment Holding Companies"],"lifecycle":[{"event":"open","at":"2026-11-13T18:15:30Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":28,"reasons":["seen:0","win:early"],"computed_at":"2026-11-13T21:44:15Z"},"pay":null,"html_url":"https://alion.io/job/prosus-ml-infrastructure-acceleration-engineer-llms","json_url":"https://alion.io/job/prosus-ml-infrastructure-acceleration-engineer-llms.json","meta":{"generated_at":"2026-11-13T21:44:15Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":43365,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":15163},"rest":"https://alion.io/mcp/rest/get_company?id=15163"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fprosus-ml-infrastructure-acceleration-engineer-llms"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fprosus-ml-infrastructure-acceleration-engineer-llms"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fprosus-ml-infrastructure-acceleration-engineer-llms"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/prosus-ml-infrastructure-acceleration-engineer-llms\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fprosus-ml-infrastructure-acceleration-engineer-llms"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4272527}},{"tool":"search_jobs","arguments":{"company":"prosus.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4272527},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}