Senior Performance Engineer
NVIDIA is seeking a highly skilled Senior Performance Engineer to join our Performance and R&D organizations. In this role, you will help build and evolve systems that support performance analysis, telemetry, and optimization for large-scale GPU- and CPU-based clusters used in AI and high-performance computing environments. You will work closely with hardware, networking, firmware, and software teams to collect, analyze, and interpret performance data from live systems. This is a fast-paced R&D environment where system behavior and requirements evolve rapidly, requiring adaptable engineering solutions and strong analytical thinking.
What you’ll be doing:
Profile, benchmark, and analyze AI and HPC workloads on GPU and CPU clusters
Explore performance characteristics of high-performance networking and collective communications (e.g., NCCL, RDMA, MPI, RoCE)
Identify performance bottlenecks across networking, compute, memory, and system architecture
Develop and enhance performance analysis, benchmarking, and diagnostic tools
Define performance test plans and establish expectations for new technologies and platforms
Collaborate across hardware, firmware, networking, systems, and software teams to provide actionable performance insights
Support telemetry collection and data refinement efforts to enable accurate performance analysis
Maintain high standards for data quality, reproducibility, and traceability of performance results
What we need to see:
B.Sc. or M.Sc. in Computer Science, Computer Engineering, Software Engineering, or equivalent experience
5+ years of experience in performance analysis, systems engineering, or HPC/AI infrastructure
Demonstrated expertise in performance analysis skills and methodologies
Hands-on experience with high-performance networking (RDMA, MPI, NCCL, congestion control)
Strong understanding of system performance metrics (latency, throughput, resource utilization)
Exposure to hardware, firmware, or embedded telemetry environments
Strong analytical, problem-solving, and communication skills
Ability to work effectively in cross-functional, fast-paced R&D teams
Ways to stand out from the crowd:
Knowledge of CUDA, NCCL internals, and congestion control algorithms
Deep system-level understanding of CPU architectures, GPUs, HCAs, memory, and PCIe
Experience with NVIDIA GPUs, CUDA, and deep learning frameworks such as PyTorch or TensorFlow
Experience with cloud platforms
Proficiency in Python; experience with Bash and C/C++ is a plus as well as a strong experience working in Linux environments