{"id":3686538,"url":"https://alion.io/job/nvidia-senior-system-software-engineer-accelerated-microservices-and-libraries","title":"Senior System Software Engineer – Accelerated Microservices and Libraries","company":{"id":6,"name":"NVIDIA","domain":"nvidia.com","url":"https://alion.io/company/nvidia","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":83,"open_postings":823,"ghost_share":0.026,"stale_share":0.599,"repost_share":0.055,"time_to_fill_p50_days":40,"computed_at":"2026-11-07T05:47:08Z"}},"role":"DevOps","role_family":"DevOps","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India","Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"Computer Vision","optional":false},{"name":"CUDA","optional":false},{"name":"FFmpeg","optional":false},{"name":"KV Cache","optional":false},{"name":"Python","optional":false},{"name":"Quantization","optional":false},{"name":"Rest API","optional":false},{"name":"TensorRT","optional":false},{"name":"Triton Inference Server","optional":false},{"name":"C","optional":true}],"status":"live","first_seen_at":"2026-11-03T15:00:26Z","employer_posted_date":"2026-11-03","last_verified_at":"2026-11-07T18:38:54Z","board_verified":true,"closed_at":null,"days_open":4,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":4},"description":"We are looking for a senior software engineer to contribute to building accelerated microservices and libraries for our harnesses and agents. In this role, you will be part of an engineering team designing and developing microservices and libraries and optimizing these for relevant metrics.\nWhat you will be doing:\nContribute to design and development of accelerated microservices and libraries \nCollaborate with peer engineering and Product Management teams to understand requirements and translate these into deliverables across milestones. \nDesign, develop, and maintain real-time vision-language model inference microservices, from video ingestion and preprocessing through model serving and downstream integration. \nDevelop automated functional, accuracy, and performance regression tests, and own component readiness through integration, release, and post-release debugging. \nProfile and optimize end-to-end latency, throughput, GPU memory usage, and concurrent user capacity across platforms. \nWhat we need to see:\nMasters or Bachelors degree in Computer Science, or related engineering field \n8+ years of overall experience in software development , a strong technical foundation in software design principles and strong programming skills in C/C++ and Python. \nHands-on experience building microservices using containers, REST APIs, and asynchronous messaging. \nHands-on experience integrating and serving computer vision and vision-language models in production. \nUnderstanding of real-time video processing and the tradeoffs among latency, throughput, and resource utilization and strong debugging skills. \nExperience evaluating model quality and diagnosing accuracy or performance regressions across model, preprocessing, and inference-runtime changes. \nWays to stand out from the crowd:\nExperience delivering end-to-end video AI applications, including video ingestion, inference, tracking, analytics, and downstream integrations, using technologies such as RTSP and FFmpeg. \nBackground with NVIDIA DeepStream, TensorRT, Triton Inference Server, CUDA, or comparable technologies. \nExperience optimizing and profiling GPU inference pipelines, including batching, memory management, and concurrent model execution. \nExperience with stateful streaming inference, KV-cache management, batching, quantization, and their impact on serving performance. \nExperience profiling GPU applications with tools such as NVIDIA Nsight Systems and deploying inference services across x86 and ARM platforms. \nNVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and passionate people in the world working for us. Are you a creative problem solver with a passion for solving real-world problems with AI? If so, we want to hear from you.","description_format":"text","description_chars":2809,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","Servers & Data Center Hardware","Computer Components","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-11-03T15:00:26Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":3,"expected_fill_days":40,"reasons":["conf:3","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-11-07T05:47:08Z"},"pay":null,"html_url":"https://alion.io/job/nvidia-senior-system-software-engineer-accelerated-microservices-and-libraries","json_url":"https://alion.io/job/nvidia-senior-system-software-engineer-accelerated-microservices-and-libraries.json","meta":{"generated_at":"2026-11-07T22:51:01Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":37767,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6},"rest":"https://alion.io/mcp/rest/get_company?id=6"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnvidia-senior-system-software-engineer-accelerated-microservices-and-libraries"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnvidia-senior-system-software-engineer-accelerated-microservices-and-libraries"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnvidia-senior-system-software-engineer-accelerated-microservices-and-libraries"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nvidia-senior-system-software-engineer-accelerated-microservices-and-libraries\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnvidia-senior-system-software-engineer-accelerated-microservices-and-libraries"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3686538}},{"tool":"search_jobs","arguments":{"company":"nvidia.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3686538},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}