{"id":3010833,"url":"https://alion.io/job/nvidia-system-software-architect-ai-hardware-and-software-performance","title":"System Software Architect, AI Hardware and Software Performance","company":{"id":6,"name":"NVIDIA","domain":"nvidia.com","url":"https://alion.io/company/nvidia","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":80,"open_postings":804,"ghost_share":0.024,"stale_share":0.729,"repost_share":0.044,"time_to_fill_p50_days":35,"computed_at":"2026-10-24T06:02:35Z"}},"role":"DevOps","role_family":"DevOps","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Shanghai, China"],"countries":["CN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":63000,"max_usd":147000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":865},"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"HPC","optional":false},{"name":"JAX","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"SGLang","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-10-19T00:00:00Z","employer_posted_date":"2026-10-19","last_verified_at":"2026-10-24T03:57:46Z","board_verified":true,"closed_at":null,"days_open":5,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":5},"description":"NVIDIA's Performance Lab (PerfLab) builds the automation platforms that evaluate the performance and quality of accelerated computing workloads efficiently and accurately, from single nodes to large training and inference clusters. Our platforms turn complex benchmark campaigns into reliable, scalable, and reproducible workflows, enabling engineering, product, and marketing teams to make data-driven decisions.\nWe are looking for a System Software Architect to set the technical direction for these platforms. You will build platform components and lead projects from problem discovery and technical design through production deployment and adoption. This hands-on role combines architecture, cross-team alignment, and direct system debugging. You will collaborate with NVIDIA teams around the world and help shape how NVIDIA measures, understands, and improves performance for large language models, agentic AI, and emerging HPC and AI workloads.\nWhat You'll Be Doing:\nDefine the technical direction and architecture for major areas of PerfLab's benchmark infrastructure, translating evolving business and engineering needs into clear roadmaps and scalable platform capabilities.\nLead the implementation of reusable software, services, and workflows that automate benchmark definition, execution, result collection, validation, and reporting across local, cluster, and cloud-native environments.\nEstablish engineering approaches that improve the reliability, scalability, observability, maintainability, and reproducibility of large benchmark campaigns.\nStay hands-on with AI benchmarking, analysis, and benchmark design, and use that first-hand knowledge of how real workflows behave to ground platform investments and technical decisions.\nLead delivery across team boundaries: align partner teams on direction, eliminate duplicated efforts, manage delivery risk, and keep stakeholders informed.\nRaise the engineering bar through architecture and code reviews, technical standards, and mentoring, while evaluating emerging technologies.\nContribute to the strategy and development of internal and open-source projects, and grow their adoption.\nWhat We Need to See:\nM.Sc. or Ph.D. in Computer Science, Electrical or Computer Engineering from a leading university (or equivalent experience).\n10+ years of hands-on experience in developing system software, distributed systems, or AI systems.\nStrong Python and software engineering expertise, with a track record of building and operating production-quality tools, services, or automation frameworks.\nProven technical leadership on sophisticated, multi-functional projects, including defining architecture, managing technical risk, resolving ambiguity, and driving solutions through delivery and adoption.\nExperience in quantitative analysis of AI hardware and systems, including hardware and system performance, architecture evaluation and power efficiency.\nExperience in operating distributed or cloud-native systems at scale, including performance profiling, capacity analysis, or resource scheduling.\nExcellent communication, influence, presentation, and cross-functional coordination skills, with experience aligning teams across countries and time zones to drive decisions.\nA record of mentoring engineers, raising engineering quality, and helping teams make better technical decisions.\nWays to Stand Out From the Crowd:\nGood technical understanding of modern compute hardware at one or more levels of the stack, including silicon, systems, networking, or clusters.\nWorking knowledge of how AI workloads stress hardware, including memory bandwidth, memory capacity, interconnect communication, and real-world compute utilization.\nPractical experience building custom agent harnesses or strategies that improve workflows at team or organizational scale.\nHands-on experience with AI training or inference frameworks such as vLLM, SGLang, TensorRT-LLM, PyTorch, or JAX.\nDemonstrated success turning loosely defined, cross-organizational problems into durable platforms or programs with measurable engineering impact.\nWe have some of the most forward-thinking and hardworking people in the world working for us. If you are creative, autonomous, and passionate about providing technical leadership while remaining hands-on in building systems that make complex AI performance work repeatable and scalable, we want to hear from you.","description_format":"text","description_chars":4383,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","Servers & Data Center Hardware","Computer Components","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-10-21T15:20:34Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":5,"expected_fill_days":35,"reasons":["conf:2","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-10-24T06:02:35Z"},"pay":null,"html_url":"https://alion.io/job/nvidia-system-software-architect-ai-hardware-and-software-performance","json_url":"https://alion.io/job/nvidia-system-software-architect-ai-hardware-and-software-performance.json","meta":{"generated_at":"2026-10-24T07:20:23Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10844,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-25T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6},"rest":"https://alion.io/mcp/rest/get_company?id=6"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnvidia-system-software-architect-ai-hardware-and-software-performance"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnvidia-system-software-architect-ai-hardware-and-software-performance"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnvidia-system-software-architect-ai-hardware-and-software-performance"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nvidia-system-software-architect-ai-hardware-and-software-performance\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnvidia-system-software-architect-ai-hardware-and-software-performance"}]}