AI Platform Engineer (Inference)

Amazon • Go • Python • 26 days ago
Apply now
Save
368,530open jobs
9,432companies
50,439added this week
Browse all
Salary
≈ $34k – $86k per year (Estimated)
Location
In office (Bengaluru)
Seniority
Senior · 6+ years exp
Overview
Company
Impact
Profile match

Amazon

Amazon is an American technology and retail conglomerate founded by Jeff Bezos in 1994 as an online bookstore and headquartered in Seattle, Washington. It operates the world's largest online marketplace together with a global logistics network, physical grocery stores and a third-party seller platform that accounts for most units sold. Amazon Web Services, launched in 2006, is the leading public cloud provider and generates the majority of the group's operating profit, while advertising, Prime Video, Alexa devices and Kuiper satellite broadband round out the business.
amazon.com • HQ: Seattle, United States • Cybersecurity • Information Technology • Data & Analytics • Artificial Intelligence • Streaming & OTT Platforms • Media & Entertainment • Sales & Marketing • Advertising • Marketplaces • Cloud Computing • E-commerce Platforms • 5000+ employees • Est. 1994

Requirements:

  • 6+ years of backend development / distributed systems; Python or Go.
  • Hands-on experience with one or more inference frameworks: vLLM, Triton, TensorRT-LLM, ONNX Runtime, PyTorch.
  • Understanding of distributed training: data parallelism, tensor parallelism, pipeline parallelism, ZeRO.
  • Knowledge of Kubernetes and cloud-native ecosystem; containerization and service orchestration.
  • Proficiency in GPU cluster management fundamentals (CUDA, cuDNN, device plugins).
  • Strong distributed systems design: load balancing, HA, resource scheduling.

Nice-to-Have:

  • LLM serving at scale (vLLM, SGLang, TensorRT-LLM) in production.
  • Quantisation techniques: INT8/FP8 sparsity, speculative decoding.
  • Large-scale GPU training cluster operation (Slurm, Volcano, KubeRay).
  • Training fault recovery, checkpoint management, elastic training.
  • RDMA/NCCL/InfiniBand high-performance networking.
  • Active open-source contributions (vLLM, SGLang, Megatron-LM, DeepSpeed, Ray).
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,530 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Bengaluru
Data & AI Engineer 2 days ago
In office • Full-Time • 3+ years exp • Luxembourg City
Java
Python
TypeScript
C#
Java
Spring Boot
Python
FastAPI
C#
.NET
AI/ML
Computer Vision
LLM
Mistral
NLP
Ollama
ONNX
RAG
Semantic Search
Transformers
Edge AI
OCR
Semantic Search
DevOps
Ansible
AWS
Azure
CI/CD
Docker
GitHub Actions
Rest API
Terraform
Vector
GitHub
Apply
≈ $64k – $150k per year (Estimated) • Equity • Remote • Full-Time • PhD
Bash
Ruby
Ruby
Ruby on Rails
AI/ML
LLM
DevOps
CI/CD
Git
Kubernetes
OpenShift
GitLab
Cybersecurity
FedRAMP
Apply
AI Engineer 2 days ago
Remote/Hybrid • 8+ years exp
C#
Python
TypeScript
C#
.NET
Databases
ElasticSearch
OpenSearch
AI/ML
AutoGen
AWS Bedrock
Claude
CrewAI
Embeddings
LangGraph
LLM
Model Context Protocol
Prompt Engineering
RAG
Semantic Kernel
Semantic Search
LangChain
Anthropic
LLM Guardrails
OpenAI
OpenAI Agents SDK
Semantic Search
Structured Outputs
AI Agents
Function Calling
DevOps
AWS
Azure
Docker
GCP
Kubernetes
Vector
Apply
$220k – $325k per year • Remote/Hybrid • Full-Time • 15+ years exp • New York
DevOps
AWS
Azure
CI/CD
GCP
Kubernetes
Platform Engineering
Cybersecurity
Threat Modeling
Apply
≈ $26k – $66k per year (Estimated) • In office • Full-Time • 7+ years exp • Master's Degree • Hyderabad
Python
SQL
TypeScript
Databases
OpenSearch
Snowflake
AI/ML
AI Agents
AWS Bedrock
Claude
Claude Code
Fine-tuning
Hallucination
LangChain
LLM
Model Context Protocol
Multimodal AI
Prompt Engineering
RAG
Synthetic Data
A2A
Amazon SageMaker
DevOps
AWS
CI/CD
Docker
Vector
Analytics
A/B Testing
Apply
≈ $37k – $76k per year (Estimated) • In office • 6+ years exp • Bachelor's Degree • Bengaluru
PowerShell
Python
Databases
Databricks
Snowflake
DevOps
AIOps
AWS
AWS Lambda
CI/CD
Datadog
GitHub Actions
Jenkins
Prometheus
Terraform
Amazon CloudWatch
Amazon S3
GitHub
GitLab
IAM
Analytics
QlikSense
Apply
≈ $42k – $93k per year (Estimated) • In office • 3+ years exp • Bengaluru
Java
Java
Spring Boot
Spring Framework
AI/ML
AI Agents
Apply
≈ $19k – $63k per year (Estimated) • In office • 5+ years exp • Pune
JavaScript
TypeScript
Java
Java
Gradle
Frontend
GraphQL
Redux
Redux Toolkit
React.js
Mobile
Adaptive UI
Bitrise
CocoaPods
Fastlane
Material Design
React Native
State Management
DevOps
CI/CD
Git
GitHub Actions
GitHub
QA
Detox
Jest
Apply
SDET II 8 days ago
≈ $15k – $45k per year (Estimated) • In office • 3+ years exp • Bengaluru
JavaScript
TypeScript
AI/ML
AI Agents
Claude
DevOps
CI/CD
Docker
Git
GitHub Actions
Jenkins
Kubernetes
Rest API
GitHub
QA
Cucumber
Playwright
Postman
Apply
≈ $15k – $45k per year (Estimated) • In office • 3+ years exp • Bengaluru
JavaScript
TypeScript
AI/ML
AI Agents
DevOps
CI/CD
Docker
Git
GitHub Actions
Jenkins
Kubernetes
Rest API
GitHub
QA
Cucumber
Playwright
Postman
Selenium
Apply
≈ $41k – $89k per year (Estimated) • Remote/Hybrid • Full-Time • 8+ years exp • Bengaluru
C#
TypeScript
JavaScript
C#
.NET
Databases
Apache Kafka
AI/ML
Copilot
LLM
OpenAI
Frontend
Angular
GraphQL
DevOps
Azure
Azure AKS
Azure DevOps
CI/CD
Docker
GitHub
GitHub Actions
Grafana
Kubernetes
Prometheus
Rest API
Apply
≈ $38k – $83k per year (Estimated) • In office • Full-Time • 12+ years exp • Bachelor's Degree • Bengaluru
Databases
Oracle
DevOps
AWS
Platform Engineering
Apply
Data Architect 2 hours ago
≈ $38k – $91k per year (Estimated) • In office • Full-Time • 3+ years exp • Bengaluru • Pune
Node JS
Python
SQL
JavaScript
Databases
Databricks
MongoDB
Redis
Apply
≈ $28k – $71k per year (Estimated) • In office • Full-Time • 5+ years exp • Bengaluru
DevOps
CI/CD
Platform Engineering
Apply
≈ $26k – $69k per year (Estimated) • In office • Full-Time • 9+ years exp • Bachelor's Degree • Bengaluru • Hyderabad • Chennai • Noida
Databases
Db2
IMS
Apply
See all jobs
This is one of many
368,530 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles