{"id":3484569,"url":"https://alion.io/job/nvidia-software-engineer-ml-performance","title":"Software Engineer, ML Performance","company":{"id":6,"name":"NVIDIA","domain":"nvidia.com","url":"https://alion.io/company/nvidia","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":84,"open_postings":821,"ghost_share":0.023,"stale_share":0.56,"repost_share":0.054,"time_to_fill_p50_days":40,"computed_at":"2026-11-06T05:58:05Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Santa Clara, United States","Austin, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":224000,"max":356500,"currency":"USD","period":"year","gross":null,"usd_annual":356500},"salary_estimate":null,"experience_years_min":12,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CUDA","optional":false},{"name":"JAX","optional":false},{"name":"Megatron-LM","optional":false},{"name":"NCCL","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"SGLang","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-10-29T21:22:24Z","employer_posted_date":"2026-10-29","last_verified_at":"2026-11-07T02:38:34Z","board_verified":true,"closed_at":null,"days_open":8,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":8},"description":"NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology-and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in an inclusive, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.\nJoin us at NVIDIA and be part of a team that’s crafting the future of technology! Our dedication to innovation and excellence has made us a leader in computer graphics, PC gaming, and accelerated computing for over 25 years. As we delve into the limitless opportunities that AI brings, we are looking for passionate individuals to help us push boundaries and redefine what's possible. NVIDIA is seeking a dedicated Software Engineer, ML Performance to join our team in Santa Clara, CA. In this role, you will engage directly with the latest AI technologies and work on optimizing performance at an outstanding scale. Your expertise will ensure that our groundbreaking solutions operate flawlessly and continue to lead the industry.\nWhat you’ll be doing:\nAnalyze the performance of distributed training and inference workloads throughout the entire stack: model and framework, data loading and checkpointing, compiler and kernels, CUDA and NCCL, host and network. Identify the bottleneck, resolve it or suggest a solution, and provide the supporting evidence.\nDefine the performance metrics tracked across a fleet of GPUs. Break them down into factors engineers need to debug. Decide which signals the platform collects first.\nDrive the analysis of regressions: segment workloads across machines, versions, and configurations to isolate the cause, and turn the method into analysis others can reuse.\nEvaluate automated diagnoses: judge whether a finding is accurate, identify misleading results and missed problems, and build the labeled cases that keep the analysis honest.\nWork closely with build partners on their real workloads, carry findings through to improvements, and feed what the product is missing back into the roadmap.\nWhat we need to see:\nBachelor’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.\n12+ years of relevant software engineering experience, including hands-on optimization of GPU training or inference workloads in production.\nDemonstrated performance work across more than one layer of the stack, with a clear account of the baseline, evidence, alternative explanations and validated outcome.\nExperience diagnosing performance across many jobs, machines or tenants, not only tuning a single workload.\nEnough familiarity with framework, runtime and compiler interfaces to say where a signal should be measured, even when someone else writes the instrumentation.\nAbility to distinguish symptoms from causes, recognize noisy or incomplete measurements and the effects of the measurement itself, and know when the evidence is insufficient.\nStrong programming and debugging skills, demonstrated by maintainable analysis code, tests or repeatable investigation procedures, including when using automated development tools.\nClear communication of findings, trade-offs and remaining uncertainty to the people who own the workload.\nProficiency with Python and CUDA.\nWays to stand out from the crowd:\nImproved operation of both training and inference.\nDeep knowledge of one or more of PyTorch, JAX, Megatron, NCCL, TensorRT-LLM, vLLM, SGLang or Dynamo.\nExperience moving between application, system software, driver or hardware roles, and the full-stack view that comes with it.\nStatistical judgment applied to noisy, multi-node fleet-scale performance data. Ideally, experience with counter-factual analysis and segmentation of workloads for diagnosing regressions.\nBuilt debugging or performance-analysis tools used by other engineers, with evidence that they made investigations more effective.\nYour base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD.You will also be eligible for equity and benefits.\nApplications for this job will be accepted at least until November 2, 2026.This posting is for an existing vacancy.\nNVIDIA uses AI tools in its recruiting processes.\nNVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.","description_format":"text","description_chars":5101,"description_truncated":false,"requirements":{"experience_years_min":12,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","Servers & Data Center Hardware","Computer Components","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-10-29T21:22:24Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 2,856 · green card filings: 799","filings_12m":2856,"filings_prev_12m":1684,"green_card_filings_12m":799,"median_offered_wage_usd":186407,"route":null,"cap_exempt":false,"checked_at":"2026-11-06T22:30:08+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":1330}],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":7,"expected_fill_days":40,"reasons":["conf:0","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-11-06T05:58:05Z"},"pay":{"stated_usd_annual":356500,"is_top_pay":true},"html_url":"https://alion.io/job/nvidia-software-engineer-ml-performance","json_url":"https://alion.io/job/nvidia-software-engineer-ml-performance.json","meta":{"generated_at":"2026-11-07T02:52:47Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6874,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6},"rest":"https://alion.io/mcp/rest/get_company?id=6"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnvidia-software-engineer-ml-performance"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnvidia-software-engineer-ml-performance"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnvidia-software-engineer-ml-performance"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nvidia-software-engineer-ml-performance\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnvidia-software-engineer-ml-performance"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3484569}},{"tool":"search_jobs","arguments":{"company":"nvidia.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3484569},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}