Senior System Software Engineer - Local AI Automation

N

VIDIA is leading the next era of AI computing, bringing Generative AI from the cloud to local devices. The Local AI team develops the software platform that enables developers, enterprises, and creators to build and run AI applications on NVIDIA client platforms, including GeForce RTX PCs, RTX PRO workstations, RTX Spark, DGX Spark, and DGX Station.

The Local AI Automation team is seeking a senior system software engineer passionate about building and maintaining robust infrastructure for deploying high-quality AI applications and models. You will collaborate with a team of highly qualified engineers dedicated to creating top-tier infrastructure for Local AI automation. If you have a real passion for setting up automation systems in the AI ecosystem to achieve excellence, this could be an excellent opportunity for us to work together!

What you'll be doing:

• Design, implement, and maintain robust infrastructure to efficiently run various AI workloads through different inference backends like Llama.cpp, Ollama, Pytorch, WinML, TRT-RTX, and others.

• Scope out the requirements for deploying various AI applications, benchmarks and models in automation, and develop solutions to measure accuracy, functionality and performance.

• Develop Infrastructure to download AI models from various sources and efficiently manage a local repository, create an automated synchronization mechanism to keep repository up to date.

• Analyze large datasets to derive insights and design visualizations, implement data processing engines to transform raw data into a more usable format for developers to review.

• Collaborate with internal Local AI developers to identify and implement features in automation that help them quickly debug/isolate issues.

• Design, implement, and maintain robust CI/CD pipelines for automated build and deployment. Collaborate with development teams for seamless integration and deployment.

• Understand existing infrastructure and debug issues in current frameworks. Identify performance bottlenecks and devise solutions to enhance efficiency.

What we need to see:

• 5+ years of experience with B.Tech or higher degree in Computer Science, Information Technology, Software engineering, or related field.

• Strong analytical and problem-solving abilities, with the capacity to multitask effectively in a dynamic environment.

• Confirmed experience as a developer includes at least 5+ years of proficiency in application development using C#, Java, or another programming language. You should also have exposure to at least one scripting language such as Python, Perl, or PHP.

• Familiarity with databases and SQL and experience working with source control systems, CI/CD pipelines. (Git, Perforce, Jenkins)

• Outstanding written and oral communication skills, enabling effective collaboration with management and engineering teams.

Ways to stand out from the crowd:

• Experience of building robust backend automation systems with hands on experience of working the databases.

• Familiarized in setting up visualization interfaces using Grafana, Kibana, or similar platforms.

• Hands on background with managing git CICD pipelines, Kubernetes and Docker.

• Hands on experience with inference frameworks Llama.cpp, Ollama, Pyotrch etc.

We are an equal-opportunity employer and value diversity at our company. With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.