{"id":3010840,"url":"https://alion.io/job/nvidia-senior-system-software-engineer-local-ai-3","title":"Senior System Software Engineer - Local AI","company":{"id":6,"name":"NVIDIA","domain":"nvidia.com","url":"https://alion.io/company/nvidia","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":80,"open_postings":805,"ghost_share":0.024,"stale_share":0.732,"repost_share":0.043,"time_to_fill_p50_days":35,"computed_at":"2026-10-25T05:49:26Z"}},"role":"DevOps","role_family":"DevOps","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":25000,"max_usd":51000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":49},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"C#","optional":false},{"name":"C++","optional":false},{"name":"Git","optional":false},{"name":"Grafana","optional":false},{"name":"Kibana","optional":false},{"name":"llama.cpp","optional":false},{"name":"LocalAI","optional":false},{"name":"Ollama","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"SQL","optional":false},{"name":"vLLM","optional":false},{"name":"Windows","optional":false}],"status":"live","first_seen_at":"2026-10-19T00:00:00Z","employer_posted_date":"2026-10-19","last_verified_at":"2026-10-24T08:48:21Z","board_verified":true,"closed_at":null,"days_open":6,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":6},"description":"NVIDIA has continuously reinvented itself for over two decades. The invention of the GPU in 1999 fueled the growth of PC gaming, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning has ignited modern AI, positioning NVIDIA as a leading AI computing company.\nArtificial intelligence is shifting from passive assistance to autonomous, always-on workflows. Our mission is to make this transition seamless, efficient, and secure for millions globally. The Local AI Inference team is seeking a Senior System Software Engineer to lead the development of robust system-level software and infrastructure for deploying, benchmarking, and qualifying high-quality AI applications and models across Linux and Windows systems powered by RTX and DGX-class GPUs. You will partner with inference engineers, model developers, and AI application teams to build reliable, scalable infrastructure that enables reproducible evaluation and improves local AI performance. Using AI tools and developing autonomous agents, you will accelerate infrastructure development, automate operations, and help engineers diagnose complex system issues. If you enjoy tackling systems challenges and shaping how AI infrastructure is built and operated, we would love to hear from you!\nWhat you'll be doing:\nPartner across organizations with benchmarking teams, inference teams, and AI application developers to define requirements, design, and maintain shared infrastructure for deploying, benchmarking, and qualifying AI workloads across infernece backends such as llama.cpp, Ollama, PyTorch, vLLM, and WinML.\nBuild Git-based CI infrastructure for automated builds, integration testing, and regression detection across hardware platforms, operating systems, and runtime configurations.\nDevelop model management services to download, version, cache, and synchronize checkpoints and dependencies for reproducible execution.\nDesign databases, backend services, and data pipelines to store and query model metadata, benchmark results, system telemetry, and execution artifacts.\nCreate dashboards and reports that help engineers compare inference configurations, identify regressions, and investigate performance bottlenecks.\nDevelop and operate server infrastructure, including environment provisioning, workload scheduling, resource management, and failure recovery.\nDevelop autonomous AI agents for infrastructure management, workload orchestration, monitoring, and diagnostics, with appropriate access controls and execution safeguards.\nMaintain Git repositories and companion websites, keeping code, documentation, model recommendations, and evaluation results current.\nCollaborate with inference developers to implement instrumentation and debugging capabilities, resolve system issues, and improve infrastructure efficiency and scalability.\nWhat we need to see:\nB.Tech or higher degree in Computer Science, Computer Engineering, Information Technology, Software Engineering, or a related field, or equivalent experience.\n5+ years of relevant software development, with strong programming skills in Python, C/C++, C#, or another systems programming language.\nExperience developing system software, backend services, or infrastructure supporting engineering development.\nUnderstanding of system APIs, multithreading, process and resource management, and systems debugging.\nHands-on with Git-based CI, databases, SQL, and data modeling.\nStrong analytical and problem-solving skills, with the ability to independently own projects and manage competing priorities.\nExcellent written and verbal communication skills for collaboration across engineering teams.\nWays to stand out from the crowd:\nTrack record of integrating or debugging AI inference frameworks and building model evaluation or benchmarking platforms\nProficiency working with AI agents, including tool integration and evaluation of autonomous infrastructure workflows.\nHands-on expertise in developing telemetry and observability systems using tools such as Grafana or Kibana.\nDemonstrated ability to publish technical documentation, model recommendations, or benchmark results through companion websites.\nWe're a top employer known for innovation and growth. We are an equal-opportunity employer and value diversity at our company. With competitive salaries and a generous benefits package, we are widely considered to be one of the world’s most desirable employers of technology. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our best-in-class engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we would like to hear from you.","description_format":"text","description_chars":4758,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Servers & Data Center Hardware","Computer Components","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-10-21T15:20:34Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":6,"expected_fill_days":35,"reasons":["conf:21","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-10-25T05:49:26Z"},"pay":null,"html_url":"https://alion.io/job/nvidia-senior-system-software-engineer-local-ai-3","json_url":"https://alion.io/job/nvidia-senior-system-software-engineer-local-ai-3.json","meta":{"generated_at":"2026-10-25T18:09:11Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":25979,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-26T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6},"rest":"https://alion.io/mcp/rest/get_company?id=6"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnvidia-senior-system-software-engineer-local-ai-3"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnvidia-senior-system-software-engineer-local-ai-3"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnvidia-senior-system-software-engineer-local-ai-3"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nvidia-senior-system-software-engineer-local-ai-3\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnvidia-senior-system-software-engineer-local-ai-3"}]}