1,823,437open jobs
104,694companies
274,214added this week
Browse all
Salary
≈ $113k – $203k per year (Estimated)
Location
In office (Toronto, Canada)
Seniority
Senior · 5+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 18, 2026. First seen by Alion on Mar 23, 2026. NVIDIA scores B on the Alion truth index.

Overview
Company
Impact
Profile match
NVIDIA is an American technology company founded in 1993 that invented the graphics processing unit and has become the dominant supplier of accelerated computing platforms for artificial intelligence. Its portfolio spans data centre GPUs and systems built on the Hopper and Blackwell architectures, GeForce consumer graphics, automotive and robotics platforms, high-speed networking acquired with Mellanox, and the CUDA software stack that binds the ecosystem together. Headquartered in Santa Clara, California, the company sells to cloud providers, enterprises, research institutions and gamers worldwide and is one of the most valuable listed businesses on the Nasdaq.

We are now looking for a Senior Machine Learning Applications and Compiler Engineer!

NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack. You will work at the intersection of large-scale systems, compilers, and deep learning, crafting how neural network workloads map onto future NVIDIA platforms. This is your chance to be part of something outstandingly innovative!

What you’ll be doing:

  • Build, develop, and maintain high-performance runtime and compiler components, focusing on end-to-end inference optimization.

  • Define and implement mappings of large-scale inference workloads onto NVIDIA’s systems.

  • Extend and integrate with NVIDIA’s SW ecosystem, contributing to libraries, tooling, and interfaces that enable seamless deployment of models across platforms.

  • Benchmark, profile, and monitor key performance and efficiency metrics to ensure the compiler generates efficient mappings of neural network graphs to our inference hardware.

  • Collaborate closely with hardware architects and design teams to feedback software observations, influence future architectures, and codesign features that unlock new performance and efficiency points.

  • Prototype and evaluate new compilation and runtime techniques, including graph transformations, scheduling strategies, and memory/layout optimizations tailored to spatial processors.

  • Publish and present technical work on novel compilation approaches for inference and related spatial accelerators at top tier ML, compiler, and computer architecture venues.

What we need to see:

  • MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience, with 5 years of relevant experience.

  • Strong software engineering background with proficiency in systems level programming (e.g., C/C++ and/or Rust) and solid CS fundamentals in data structures, algorithms, and concurrency.

  • Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.

  • Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.

  • Familiarity with deep learning frameworks such as TensorFlow and PyTorch, and experience working with portable graph formats such as ONNX.

  • Solid understanding of parallel and heterogeneous compute architectures, such as GPUs, spatial accelerators, or other domain specific processors.

  • Strong analytical and debugging skills, with experience using profiling, tracing, and benchmarking tools to drive performance improvements.

  • Excellent communication and collaboration skills, with the ability to work across hardware, systems, and software teams.

  • Ideal candidates will have direct experience with MLIR based compilers or other multilevel IR stacks, especially in the context of graph based deep learning workloads.

Ways to stand out from the crowd:

  • Prior work on spatial or dataflow architectures, including static scheduling, pipeline parallelism, or tensor parallelism at scale.

  • Contributions to opensource ML frameworks, compilers, or runtime systems, particularly in areas related to performance or scalability.

  • Demonstrated research impact, such as publications or presentations at conferences like PLDI, CGO, ASPLOS, ISCA, MICRO, MLSys, NeurIPS, or similar.

  • Experience with large-scale AI distributed inference or training systems, including performance modeling and capacity planning for multi rack deployments.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 135,000 CAD - 185,000 CAD for Level 3, and 170,000 CAD - 220,000 CAD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until March 27, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,823,437 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Similar stack
Same company
Toronto
≈ $107k – $273k per year (Estimated) • In office • Full-Time • 3+ years exp • Tel Aviv
Python
Python
FastAPI
AI/ML
LangChain
AI Agents
Agentic Workflows
DevOps
CI/CD
Cybersecurity
Cortex XSOAR
SIEM
Apply
Lead AI/ML Engineer 8 months ago
In office • Full-Time • 5+ years exp • Bachelor's Degree
AI/ML
Claude
Fine-tuning
Embeddings
LLM
RAG
GPT-4
Multi-Agent Systems
Machine Learning
DevOps
CI/CD
AWS
Docker
Kubernetes
Apply
≈ $24k – $52k per year (Estimated) • In office • Full-Time • 5+ years exp • Bengaluru
Python
Databases
OpenSearch
AI/ML
LoRA
Model Context Protocol
MLFlow
Fine-tuning
Embeddings
Scikit-learn
Multimodal AI
Function Calling
Computer Vision
AI Agents
NLP
PEFT
QLoRA
AWS Bedrock
Transformers
TensorFlow
Pandas
NumPy
PyTorch
LLM
RAG
Hallucination
Reranking
Anomaly Detection
Amazon SageMaker
AWS Bedrock AgentCore
A2A
GraphRAG
Context Engineering
Knowledge Graph
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
Tool Use
Machine Learning
DevOps
CI/CD
AWS
Docker
Kubernetes
Amazon EKS
AWS Lambda
Amazon S3
IAM
Amazon CloudWatch
AWS Step Functions
API Gateway
Apply
In office • Internship • Beijing
Python
C++
AI/ML
Spark
Apply
In office • Internship • Beijing
Apply
$139k – $231k per year • Equity • In office • Full-Time • 8+ years exp • Master's Degree • Toronto
Python
AI/ML
Fine-tuning
Multimodal AI
Diffusion Models
Computer Vision
PyTorch
Management
Agile
Apply
$106k – $176k per year • Equity • In office • Full-Time • 4+ years exp • Master's Degree • Toronto
Python
Java
C++
AI/ML
Reinforcement Learning
Recommender Systems
Machine Learning
DevOps
Linux
Unix
Apply
$106k – $176k per year • Equity • In office • Full-Time • 4+ years exp • Master's Degree • Toronto
Python
Java
C#
C++
AI/ML
Reinforcement Learning
AI Agents
NLP
NER
LLM
RAG
Tokenization
Sentiment Analysis
Post-training
Recommender Systems
Reward Modeling
Machine Learning
DevOps
Linux
Unix
Apply
$139k – $231k per year • Equity • In office • Full-Time • 6+ years exp • Master's Degree • Toronto
Python
Java
C++
C++
TensorFlow C++
AI/ML
Hadoop
Spark
Scikit-learn
SciPy
Computer Vision
NLP
TensorFlow
NumPy
Machine Learning
Apply
$106k – $176k per year • Equity • In office • Full-Time • 4+ years exp • Master's Degree • Toronto
Python
Java
C++
AI/ML
NLP
Machine Learning
Apply
See all jobs
This is one of many
1,823,437 more open roles from verified company boards, updated every day.