1,547,583open jobs
93,161companies
237,930added this week
Browse all
Salary
$180k – $324k per year
Location
Remote (United States)
Seniority
Senior
Visa
H-1B filings in 12 months: 16 · for this role: 10 · green card filings: 1
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 13, 2026. First seen by Alion on Oct 2, 2026.

Overview
Company
Impact
Profile match
The unified AI inference stack - from custom GPU kernels to production cloud serving on NVIDIA and AMD. 2x performance. Top open models. Open source stack.

Join Modular, a company dedicated to building a next-generation AI platform. As a Senior AI Framework Engineer, you will own and evolve core APIs and developer experience for inference and training of AI models. You will work at the intersection of API design, systems engineering, and modern AI frameworks. Your output will be the specifications, abstractions, and reference implementations that make MAX feel coherent, powerful, and intuitive to use.

Missions

  • Evoluer et améliorer les API et l'expérience développeur pour l'inférence et l'entraînement des modèles d'IA.
  • Concevoir des API d'inférence et d'entraînement qui répondent aux besoins du monde réel et qui évoluent de l'exécution sur un seul appareil à l'exécution distribuée.
  • Rédiger et socialiser des propositions, recueillir des commentaires et itérer vers un consensus en collaboration avec des équipes interfonctionnelles.

Profil recherché

- Experience with inference and training systems (model execution graphs, compilation, runtime scheduling, distributed execution, checkpointing, performance tuning)

- Strong understanding of modern AI frameworks and their design tradeoffs (e.g., PyTorch, JAX, TensorFlow, vLLM, XLA/MLIR-adjacent ecosystems)

- Strong written communication: you can write specs that engineers can implement without ambiguity

- Significant experience designing and evolving developer-facing APIs (SDKs, frameworks, or platforms)

- High engineering standards, pragmatism, and a bias towards incremental development without compromising long term design

- Fluency in one or more systems / performance languages (C++, Rust, Go) and one or more user-facing languages (Python; familiarity with Mojo is a plus)

- Excellent taste for API ergonomics: naming, composability, types, error handling, configurability, and clarity

- For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply, as we may have openings at lower or higher levels than the one advertised

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,547,583 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Similar stack
Same company
United States
ML Engineer 1 hour ago
$28k – $36k per year • Remote (likely EAEU) • 3+ years exp • Moscow
Python
SQL
Databases
PostgreSQL
Databricks
Milvus
pgvector
FAISS
AI/ML
LangGraph
Weights & Biases
LangChain
Spark
LoRA
MLFlow
Vertex AI
Fine-tuning
Embeddings
Scikit-learn
Prompt Engineering
AI Agents
NLP
Arize Phoenix
DeepEval
Langfuse
LangSmith
PEFT
Ragas
Kubeflow
TensorFlow
NumPy
PyTorch
CrewAI
LLM
RAG
Feast
Amazon SageMaker
LLMOps
Feature Store
LLM Evaluation
Multi-Agent Systems
DevOps
Rest API
gRPC
GitHub Actions
Prometheus
GitLab CI
Azure
CI/CD
AWS
Docker
Kubernetes
Grafana
Analytics
ETL/ELT
A/B Testing
Apply
$145k – $225k per year • Hybrid • 3+ years exp • Bachelor's Degree • New York
Python
Java
C++
C++
TensorFlow C++
PyTorch C++
AI/ML
Reinforcement Learning
Scikit-learn
Speech Recognition
TensorFlow
PyTorch
Recommender Systems
Machine Learning
DevOps
GCP
Azure
AWS
Docker
Kubernetes
Apply
$155k – $235k per year • Hybrid • 3+ years exp • Bachelor's Degree • New York
Verilog
VHDL
AI/ML
TensorFlow
PyTorch
Edge AI
Apply
≈ $112k – $248k per year (Estimated) • Remote (Europe)
Python
AI/ML
Fine-tuning
NLP
Speech Recognition
TensorFlow
PyTorch
Machine Learning
Apply
≈ $112k – $248k per year (Estimated) • Remote (Turkey, Ukraine)
Python
AI/ML
Fine-tuning
NLP
Speech Recognition
TensorFlow
PyTorch
Machine Learning
Apply
$100k per year • Remote (United States) • Full-Time • 6+ years exp
Python
C++
AI/ML
DeepSpeed
vLLM
TensorRT
TensorRT-LLM
LLM
Triton
CUTLASS
DevOps
FinOps
HPC
Apply
≈ $15k – $35k per year (Estimated) • In office • 3+ years exp • Pune
Python
Go
AI/ML
Time Series Forecasting
DevOps
Terraform
Ansible
GCP
GitHub Actions
Prometheus
Git
AWS
Kubernetes
Amazon EKS
Google GKE
Linux
Management
Slack
Apply
In office • 4+ years exp
Python
Python
Asyncio
Databases
MySQL
PostgreSQL
SQLite
OpenSearch
AI/ML
NLP
LLM
Text-to-Speech
LiveKit
DevOps
Rest API
WebRTC
Prometheus
WebSockets
CI/CD
Git
Docker
Kubernetes
Grafana
Linux
Apply
$160k – $300k per year • Remote (likely United States) • Contractor
Python
AI/ML
SciPy
NumPy
Apply
≈ $106k – $235k per year (Estimated) • Remote (likely United States) • Full-Time • 5+ years exp
Python
SQL
Databases
Teradata
AI/ML
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Docker
Apply
$234k – $286k per year • Remote (United States) • Full-Time • 9+ years exp • Master's Degree • United States
AI/ML
vLLM
CUDA Toolkit
Vertex AI
PyTorch
CUDA
Amazon SageMaker
Edge AI
Machine Learning
DevOps
Kubernetes
Apply
≈ $163k – $290k per year (Estimated) • Remote (United States) • 15+ years exp • Bachelor's Degree • United States
Databases
Databricks
AI/ML
LoRA
Fine-tuning
Reinforcement Learning
Prompt Engineering
AI Agents
PEFT
AWS Bedrock
Transformers
RAG
Synthetic Data
OpenAI
Amazon SageMaker
SFT
Knowledge Graph
Machine Learning
DevOps
Azure
AWS
Platform Engineering
Apply
$38k per year • In office • Full-Time • High School Diploma • United States
Apply
≈ $40k – $90k per year (Estimated) • In office • United States
Apply
Activities Driver 1 day ago
≈ $40k – $90k per year (Estimated) • In office • United States
Apply
Dietary Cook 1 day ago
≈ $36k – $65k per year (Estimated) • In office • 1+ year exp • High School Diploma • United States
Apply
See all jobs
This is one of many
1,547,583 more open roles from verified company boards, updated every day.