{"id":2736177,"url":"https://alion.io/job/nvidia-senior-deep-learning-research-engineer-llm-inference","title":"Senior Deep Learning Research Engineer, LLM Inference","company":{"id":6,"name":"NVIDIA","domain":"nvidia.com","url":"https://alion.io/company/nvidia","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":82,"open_postings":592,"ghost_share":0.019,"stale_share":0.66,"repost_share":0.034,"time_to_fill_p50_days":33,"computed_at":"2026-10-17T05:46:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Tel Aviv, Israel"],"countries":["IL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":133000,"max_usd":342000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2102},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"HPC","optional":false},{"name":"LLM","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-05-13T00:00:00Z","employer_posted_date":"2026-05-13","last_verified_at":"2026-10-17T11:15:56Z","board_verified":true,"closed_at":null,"days_open":157,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":157},"description":"We are seeking a Deep Learning Research Engineer to join our team and help develop the next generation of Large Language Model (LLM) inference algorithms. You will work on technologies that directly enhance NVIDIA's software, making the latest LLMs more efficient and accessible to users worldwide. This role is designed for someone with strong research foundations who also wants to build software that runs and scales into production systems across the world.\nBy joining us, you will be part of a strategic effort to establish NVIDIA as the definitive platform for high-performance LLM inference. The work requires a combination of research taste, experimental rigor, and engineering ownership: you will explore new ideas, run rigorous evaluations, and help transform successful approaches into tools and implementations.\nWhat you'll be doing:\nDevelop and improve benchmarks, profiling workflows, and evaluation pipelines that make inference performance measurable and reproducible.\n\nDesign and lead the development of experimental frameworks that enable rapid, reproducible evaluation of algorithmic tradeoffs across quality, latency, throughput, and more.\n\nPrototype new algorithms for LLM inference to advance the state of the art in both low-latency and high-throughput scenarios, translating them into practical software solutions that directly impact NVIDIA's products and customers\n\nTrace and profile the performance of new algorithms on NVIDIA’s latest hardware, identifying bottlenecks and opportunities for algorithmic optimizations.\n\nCollaborate with internal research, engineering, and product teams across the globe to drive the development of advanced inference technologies.\n\nStay ahead of research in LLM inference, efficient generation, model architecture, inference engines, and translate relevant advances into practical solutions.\n\nWhat we need to see:\nMSc in Computer Science, Electrical Engineering, or a closely related field; or equivalent experience in an industrial research role.\n\nAt least 5 years of proven experience in applied research, research engineering, or algorithm engineering.\n\nExcellent software engineering skills, particularly in Python and deep learning frameworks like PyTorch.\n\nProven experience with High-Performance Computing (HPC) environments, including training or running inference on large-scale GPU clusters (tens to hundreds of GPUs).\n\nInterest in the systems side of deep learning, including inference engines, benchmarking, profiling, GPU efficiency, memory behavior, and deployment constraints.\n\nA strong problem-solving mentality and a proactive attitude, driven by the ambition to deliver solutions with real-world impact.\n\nWays to stand out from the crowd:\nAt least one publication in a top-tier AI/ML conference (e.g., NeurIPS, ICLR, ICML).\n\nDeep understanding of LLM architectures coupled with hands-on experience in training large-scale models.\n\nHands-on research experience in LLM inference optimization algorithms such as speculative decoding or parallelization strategies.\n\nDeep familiarity and experience with popular LLM inference frameworks (e.g., vLLM, TensorRT-LLM).\n\nWe are an equal-opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.","description_format":"text","description_chars":3690,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","Servers & Data Center Hardware","Computer Components","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-10-16T19:06:27Z"}],"visa":[],"liveness":{"score":6,"band":"cold","label":"Long shot","p_open":1,"p_active":0.215,"p_room":0.28,"age_days":157,"expected_fill_days":33,"reasons":["conf:1","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/nvidia-senior-deep-learning-research-engineer-llm-inference","json_url":"https://alion.io/job/nvidia-senior-deep-learning-research-engineer-llm-inference.json","meta":{"generated_at":"2026-10-17T11:22:57Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14785,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6},"rest":"https://alion.io/mcp/rest/get_company?id=6"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnvidia-senior-deep-learning-research-engineer-llm-inference"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnvidia-senior-deep-learning-research-engineer-llm-inference"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnvidia-senior-deep-learning-research-engineer-llm-inference"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nvidia-senior-deep-learning-research-engineer-llm-inference\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnvidia-senior-deep-learning-research-engineer-llm-inference"}]}