2,459,682open jobs
149,964companies
317,068added this week
Browse all
Location
In office (San Jose)
Seniority
Staff · 5+ years exp
Visa
H-1B filings in 12 months: 672 · for this role: 481 · green card filings: 565
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 22, 2026. First seen by Alion on Nov 13, 2026. ByteDance scores A on the Alion truth index.

Overview
Company
Impact
Profile match
ByteDance is a Chinese internet technology company founded in Beijing in 2012 that operates some of the world's largest content and commerce platforms. Its portfolio includes the short-video apps TikTok and Douyin, the news aggregator Toutiao, the video editor CapCut, the workplace suite Lark and the Doubao family of AI assistants and models. Recommendation systems trained on user behaviour sit at the centre of every product, and the company has grown into one of the highest-revenue private technology businesses in the world.

岗位职责 / Responsibilities

The mission of our Applied Machine Learning (AML) team is to push the next-generation AI infrastructure and recommendation platform for ads ranking, search ranking, live streaming, and e-commerce. We drive substantial impact across ByteDance’s core businesses by building world-class ML platforms and systems.

We are seeking an Tech Lead, AML Inference to oversee the development and execution of ByteDance’s inference infrastructure. This role will lead and mentor a team of Machine Learning Engineers focused on inference, ensuring reliability, scalability, and performance across large-scale distributed systems. The Inference Lead will collaborate closely with research, product, and platform teams to design and deliver cutting-edge solutions that power critical ranking and recommendation services.

Responsibilities:

- Lead and mentor a team of inference-focused Machine Learning Engineers, setting technical direction and ensuring best practices.

- Drive the design and evolution of distributed inference infrastructure to support feeds, ads, search, and other core ranking models.

- Oversee the development of monitoring, observability, and management tools to ensure reliability and scalability of online inference services.

- Identify and resolve system inefficiencies, performance bottlenecks, and reliability issues, ensuring optimized end-to-end performance.

- Partner with research and product teams to translate requirements into robust and efficient inference solutions.

- Stay at the forefront of advancements in inference frameworks, ML hardware acceleration, and distributed systems, incorporating innovations where impactful.

任职要求 / Requirements

Minimum Qualifications:

- Bachelor’s degree or above in Computer Science, Electrical Engineering, or related field.

- 5+ years of experience in developing and deploying large-scale, distributed systems, with at least 5 years in a leadership or technical lead role.

- Deep understanding of inference architecture, with experience in ML framework development(tensorflow/pytorch), compilation optimization(openxla/inductor), and high-performance kernel development(cuda/triton).

- Proven experience optimizing performance for large-scale machine learning systems, including hardware-software co-design, GPU acceleration, or HPC techniques.

- Excellent communication and collaboration skills; ability to work across research, engineering, and product teams.

Preferred Qualifications:

- Experience leading teams working on high-throughput, low-latency ML serving systems.

- Contributions to open-source ML or systems projects.

- Familiarity with container orchestration, service mesh, or cloud-native ML infrastructure.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,459,682 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Remote, many countries
Similar stack
Same company
San Jose
Staff AI Engineer 2 days ago
Remote (United States) · Full-Time · 10+ years exp · United States
Python
AI/ML
Claude
Function Calling
AI Agents
AWS Bedrock
LLM Guardrails
Multi-Agent Systems
DevOps
CI/CD
AWS
AWS Lambda
GitHub
AWS Step Functions
Management
Jira
QA
Selenium
Cypress
Playwright
Apply
$250k – $300k per year · In office · Full-Time · 6+ years exp · Bachelor's Degree · New York
AI/ML
JAX
Multimodal AI
VLM
PyTorch
Vision-Language-Action
Machine Learning
Robotics
ROS
Gazebo
Isaac Sim
MuJoCo
Imitation Learning
Apply
In office · TS/SCI · 8+ years exp · Bachelor's Degree · United States
Python
C++
MATLAB
MATLAB
Simulink
AI/ML
Machine Learning
Robotics
Sensor Fusion
SpaceTech
STK
Defense
AFSIM
Apply
$156k – $234k per year · Hybrid · Full-Time · 12+ years exp · Las Colinas
Python
JavaScript
Java
TypeScript
Python
Pydantic
Java
Spring Boot
Spring Cloud
Databases
PostgreSQL
Oracle
Chroma
Milvus
pgvector
Pinecone
Qdrant
Apache Kafka
AI/ML
LangGraph
AutoGen
LangChain
LlamaIndex
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
AI Agents
NLP
Langfuse
CrewAI
LLM
RAG
TruLens
Hallucination
Sentiment Analysis
Human-in-the-Loop
Structured Outputs
Semantic Search
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
Frontend
Tailwind CSS
Next.js
React.js
DevOps
Rest API
gRPC
GCP
OpenShift
OpenTelemetry
WebSockets
Azure
CI/CD
AWS
Kubernetes
Apply
$141k – $212k per year · Hybrid · Full-Time · 10+ years exp · Bachelor's Degree · Tampa
Python
JavaScript
Java
TypeScript
SQL
Python
FastAPI
Pydantic
Java
Spring Boot
Quarkus
Micronaut
Vert.x
Databases
Oracle
Apache Kafka
AI/ML
Copilot
Spark
Claude Code
Model Context Protocol
Prompt Engineering
AI Agents
Flink
LLM
RAG
Google ADK
Hybrid Search
OpenAI Codex
Machine Learning
Frontend
GraphQL
Angular
DevOps
Rest API
Splunk
Terraform
OpenShift
CircleCI
CloudFormation
Prometheus
CI/CD
Jenkins
AWS
Docker
Kubernetes
Grafana
Tekton
GitHub
Amazon CloudWatch
Management
Agile
Scrum
Apply
Remote (EAEU) · Full-Time · Saint Petersburg
Python
SQL
Databases
ClickHouse
AI/ML
NLP
Apply
$95k – $106k per year · Hybrid · 5+ years exp · Bachelor's Degree · San Jose
Analytics
Microsoft Excel
Management
QuickBooks
Apply
In office · PhD · San Jose
Apply
$130k per year · In office · 7+ years exp · Bachelor's Degree · San Jose
Chips/EDA
Cadence Quantus
Apply
$52k per year · In office · Full-Time · San Jose
Apply
In office · 10+ years exp · San Jose
Chips/EDA
Synopsys Design Compiler
Synopsys PrimeTime
Ansys RedHawk
Apply
See all jobs
This is one of many
2,459,682 more open roles from verified company boards, updated every day.