{"id":100213,"url":"https://alion.io/job/nvidia-senior-software-engineer-ai-inference-systems","title":"Senior Software Engineer, AI Inference Systems","company":{"id":6,"name":"NVIDIA","domain":"nvidia.com","url":"https://alion.io/company/nvidia","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":80,"open_postings":775,"ghost_share":0.025,"stale_share":0.735,"repost_share":0.043,"time_to_fill_p50_days":35,"computed_at":"2026-10-22T06:10:10Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Germany","United Kingdom","Poland","Switzerland","France"],"countries":["DE","GB","PL","CH","FR"],"hiring_countries":["DE"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":110000,"max_usd":226000,"period":"year","method":"role_seniority_country_cell","sample_n":18},"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"Go","optional":false},{"name":"Python","optional":false},{"name":"Rust","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"vLLM","optional":false},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"CI/CD","optional":true},{"name":"containerd","optional":true},{"name":"CRI-O","optional":true},{"name":"CUDA","optional":true},{"name":"CUTLASS","optional":true},{"name":"Docker","optional":true},{"name":"GCP","optional":true},{"name":"GitHub","optional":true},{"name":"Kubernetes","optional":true},{"name":"Linux","optional":true},{"name":"LLM","optional":true},{"name":"LLVM","optional":true},{"name":"MLIR","optional":true},{"name":"NCCL","optional":true},{"name":"PyTorch","optional":true},{"name":"SGLang","optional":true},{"name":"SLURM","optional":true},{"name":"Triton","optional":true},{"name":"XLA","optional":true}],"status":"closed","first_seen_at":"2026-08-17T00:00:00Z","employer_posted_date":"2026-09-18","last_verified_at":"2026-10-21T12:00:15Z","board_verified":false,"closed_at":"2026-10-21T12:00:15Z","days_open":65,"trust":{"level":"ok","repost_count":1,"flags":[],"days_open":65},"description":"We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry benchmarks, and scale workloads across multi-GPU, multi-node, and multi-cloud environments. You’ll collaborate across inference, compiler, scheduling, and performance teams to push the frontier of accelerated computing for AI.\nWhat you’ll be doing:\nContribute features to vLLM that empower the newest models with the latest NVIDIA GPU hardware features; profile and optimize the inference framework (vLLM) with methods like speculative decoding, data/tensor/expert/pipeline-parallelism, prefill-decode disaggregation.\n\nDevelop, optimize, and benchmark GPU kernels (hand-tuned and compiler-generated) using techniques such as fusion, autotuning, and memory/layout optimization; build and extend high-level DSLs and compiler infrastructure to boost kernel developer productivity while approaching peak hardware utilization.\n\nDefine and build inference benchmarking methodologies and tools; contribute both new benchmark and NVIDIA’s submissions to the industry-leading MLPerf Inference benchmarking suite.\n\nArchitect the scheduling and orchestration of containerized large-scale inference deployments on GPU clusters across clouds.\n\nConduct and publish original research that pushes the pareto frontier for the field of ML Systems; survey recent publications and find a way to integrate research ideas and prototypes into NVIDIA’s software products.\n\nWhat we need to see:\nBachelor’s degree (or equivalent expeience) in Computer Science (CS), Computer Engineering (CE) or Software Engineering (SE) with 7+ years of experience; alternatively, Master’s degree in CS/CE/SE with 5+ years of experience; or PhD degree with the thesis and top-tier publications in ML Systems, GPU architecture, or high-performance computing.\n\nStrong programming skills in Python and C/C++; experience with Go or Rust is a plus; solid CS fundamentals: algorithms & data structures, operating systems, computer architecture, parallel programming, distributed systems, deep learning theories.\n\nKnowledgeable and passionate about performance engineering in ML frameworks (e.g., PyTorch) and inference engines (e.g., vLLM and SGLang).\n\nFamiliarity with GPU programming and performance: CUDA, memory hierarchy, streams, NCCL; proficiency with profiling/debug tools (e.g., Nsight Systems/Compute).\n\nExperience with containers and orchestration (Docker, Kubernetes, Slurm); familiarity with Linux namespaces and cgroups.\n\nExcellent debugging, problem-solving, and communication skills; ability to excel in a fast-paced, multi-functional setting.\n\nWays to stand out from the crowd\nExperience building and optimizing LLM inference engines (e.g., vLLM, SGLang).\n\nHands-on work with ML compilers and DSLs (e.g., Triton, TorchDynamo/Inductor, MLIR/LLVM, XLA), GPU libraries (e.g., CUTLASS) and features (e.g., CUDA Graph, Tensor Cores).\n\nExperience contributing to containerization/virtualization technologies such as containerd/CRI-O/CRIU.\n\nExperience with cloud platforms (AWS/GCP/Azure), infrastructure as code, CI/CD, and production observability.\n\nContributions to open-source projects and/or publications; please include links to GitHub pull requests, published papers and artifacts.\n\nAt NVIDIA, we believe artificial intelligence (AI) will fundamentally transform how people live and work. Our mission is to advance AI research and development to create groundbreaking technologies that enable anyone to harness the power of AI and benefit from its potential. Our team consists of experts in AI, systems and performance optimization. Our leadership includes world-renowned experts in AI systems who have received multiple academic and industry research awards. If you’re excited to build systems, kernels, and tools that make large-scale AI faster, more efficient, and easier to deploy, we’d love to hear from you.\nYour base salary will be determined based on your location, experience, and the pay of employees in similar positions. For Poland: The base salary range is 292,500 PLN - 507,000 PLN for Level 4, and 375,000 PLN - 650,000 PLN for Level 5.","description_format":"text","description_chars":4297,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Germany","iso":"DE","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","Servers & Data Center Hardware","Computer Components","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-08-17T00:00:00Z"},{"event":"close","at":"2026-09-03T06:39:18Z"},{"event":"reopen","at":"2026-09-18T08:37:49Z"},{"event":"close","at":"2026-10-21T12:00:15Z"}],"visa":[],"liveness":null,"pay":null,"html_url":"https://alion.io/job/nvidia-senior-software-engineer-ai-inference-systems","json_url":"https://alion.io/job/nvidia-senior-software-engineer-ai-inference-systems.json","meta":{"generated_at":"2026-10-22T07:28:03Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3067,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-23T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6},"rest":"https://alion.io/mcp/rest/get_company?id=6"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnvidia-senior-software-engineer-ai-inference-systems"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnvidia-senior-software-engineer-ai-inference-systems"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnvidia-senior-software-engineer-ai-inference-systems"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nvidia-senior-software-engineer-ai-inference-systems\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnvidia-senior-software-engineer-ai-inference-systems"}]}