2,292,754open jobs
145,640companies
270,928added this week
Browse all
Location
In office (Seongnam)
Seniority
Senior · 5+ years exp

Confirmed on the employer's own hiring board on Nov 16, 2026. First seen by Alion on Mar 18, 2026. Rebellions scores C on the Alion truth index.

Overview
Company
Impact
Profile match
Rebellions is a South Korean semiconductor company founded in 2020 by former Wall Street quantitative engineers and IBM chip designers to build accelerators specialised for AI inference rather than training. Its ATOM processor targets efficiency per watt in data centre inference, and the follow-on REBEL design uses chiplet packaging to scale to large language model workloads. The company merged with Sapeon Korea, the AI chip unit of the SK group, to consolidate the domestic effort against foreign GPUs, becoming South Korea's first AI semiconductor unicorn and working closely with SK Telecom, KT and Samsung Foundry.

We are seeking a highly skilled NPU Runtime Software Engineer to join our team. You will be responsible for designing and implementing the software layer that bridges high-level ML frameworks with our proprietary NPU hardware - enabling the next generation of real-time AI applications. Your work will ensure that state-of-the-art models - with a heavy focus on LLMs - run with industry-leading efficiency, low latency, and high throughput. You will sit at the intersection of compilers, system drivers, and distributed inference frameworks, spanning the full runtime stack from graph execution and compiler integration to inference serving.

Responsibilities and Opportunities

  • Design and implement the RBLN runtime module that interfaces with compiler and driver components, including the graph executor and runtime APIs, to enable ML model deployment through the RBLN SDK
  • Architect and maintain native PyTorch execution support within the runtime, including torch.compile integration and RBLN compiler toolchains, to enable seamless NPU acceleration with minimal user-side code changes
  • Design and implement a user-facing profiler that provides actionable performance insights, delivered as part of the RBLN SDK
  • Develop and extend vLLM to enhance inference performance on NPUs, including support for key vLLM features such as advanced memory management, parallelism, and dynamic batching
  • Design and optimize distributed inference across multi-NPU setups, including collective communication operations (CCL) to support various parallelism strategies
  • Conduct benchmarking and profiling to evaluate runtime system performance and implement optimizations to improve overall system efficiency
  • Collaborate with ML engineers and infrastructure teams to deploy and scale inference services

Key Qualifications

  • Over 5 years of experience in software engineering, with significant work on ML frameworks, inference runtimes, or AI accelerator toolchains in production environments
  • Bachelor's degree or higher in Computer Science, Electrical Engineering, or a related field
  • Strong proficiency in C++ and Python
  • Strong understanding of deep learning fundamentals and LLM architectures, including Transformer-based models, generative AI, and inference optimization techniques
  • Hands-on experience with LLM serving frameworks (e.g., vLLM, TensorRT-LLM)
  • Solid understanding of model optimization techniques (tensor parallelism, KV cache optimizations, memory-efficient execution)
  • Familiarity with system software components, including compilers, runtimes, drivers, and firmware
  • Familiarity with hardware acceleration (GPUs, NPUs, TPUs) and efficient memory management techniques
  • Strong debugging and performance profiling skills for high-throughput inference environments
  • Ability to work effectively across compiler, driver, and ML engineering teams
  • Excellent written and verbal communication skills

Ideal Qualifications

  • Practical experience with AI accelerator runtimes and driver APIs (e.g., GPUs)
  • Direct contribution or production experience with ML frameworks and serving systems such as PyTorch, vLLM, SGLang, TensorRT, and TensorRT-LLM
  • Understanding of torch.compile and graph optimizations
  • Strong understanding of operating systems, resource management, and high-performance computing concepts
  • Advanced proficiency in modern C++ for developing efficient, high-performance systems
  • Experience with multithreading and parallel programming
  • Experience deploying LLMs in distributed environments

전형절차

  • 서류전형 > On-line 인터뷰 > On-site 인터뷰(과제 포함) > Culture-fit인터뷰 > 처우 협의 > 최종 합격
  • 전형절차는 직무별로 다르게 운영될 수 있으며, 일정 및 상황에 따라 변동될 수 있습니다.
  • 전형 일정 및 결과는 지원 시 작성하신 이메일로 개별 안내드립니다.

참고사항

  • 본 공고는 모집 완료 시 조기 마감될 수 있습니다.
  • 지원서 내용 중 허위사실이 있는 경우에는 합격이 취소될 수 있습니다.
  • 채용 및 업무 수행과 관련하여 요구되는 법령 상 자격이 갖추어지지 않은 경우 채용이 제한될 수 있습니다.
  • 보훈 대상자 및 장애인 여부는 채용 과정에서 어떠한 불이익도 미치지 않습니다.
  • 담당 업무 범위는 후보자의 전반적인 경력과 경험 등 제반사정을 고려하여 변경될 수 있습니다. 이러한 변경이 필요할 경우, 최종 합격 통지 전 적절한 시기에 후보자와 커뮤니케이션 될 예정입니다.
  • 채용 관련 문의사항은 아래 메일 주소로 문의바랍니다.
  • [email protected]
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,292,754 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
Seongnam
In office · Full-Time · 5+ years exp · Seoul
Python
C#
Cybersecurity
SBOM
MedTech
DICOM
Apply
Software Engineer II 8 hours ago
In office · Full-Time · 3+ years exp · Master's Degree · Seoul
C++
C++
Qt
Apply
Apply
Hybrid · Full-Time · Sweden
SQL
C#
C#
.NET
DevOps
OpenShift
Git
Kubernetes
Apply
In office · Full-Time · Jena
C++
C++
CMake
Qt
DevOps
Git
Management
Scrum
QA
Pytest
Apply
In office · Full-Time · Master's Degree · Hyderabad
Python
Java
C++
Scala
C++
TensorFlow C++
AI/ML
Copilot
TensorFlow
Keras
Machine Learning
DevOps
Linux
Unix
SOAP
Robotics
Digital Twin
Apply
Data Scientist III 8 days ago
$132k – $220k per year · Remote (United States) · 5+ years exp · Bachelor's Degree · United States
Python
SQL
Python
Flask
FastAPI
Databases
PostgreSQL
Milvus
pgvector
FAISS
ElasticSearch
OpenSearch
AI/ML
LangGraph
LangChain
LoRA
Model Context Protocol
vLLM
MLFlow
Fine-tuning
Embeddings
Quantization
Scikit-learn
Function Calling
AI Agents
DeepEval
LangSmith
PEFT
QLoRA
Ragas
Kubeflow
TensorFlow
Pandas
NumPy
PyTorch
CrewAI
LLM
RAG
Google ADK
Reranking
Anomaly Detection
Time Series
Triton
LLMOps
SFT
OpenAI Agents SDK
A2A
Structured Outputs
Context Engineering
Agentic Workflows
Machine Learning
DevOps
OpenShift
OpenTelemetry
AWS
Kubernetes
Management
Confluence
Jira
Agile
Apply
up to $22k per year (net) · In office · Moscow
Python
C#
C++
Cybersecurity
Kaspersky
Apply
In office · Full-Time · Bern
Python
C#
C#
.NET
AI/ML
Copilot
Model Context Protocol
LLM
RAG
Copilot Studio
DevOps
Rest API
CI/CD
Cybersecurity
Microsoft Entra ID
Apply
In office · Full-Time · 4+ years exp · Bachelor's Degree · Tel Aviv
Python
AI/ML
Copilot
Cursor
Claude Code
Prompt Engineering
AI Agents
DevOps
Rest API
GCP
Azure
AWS
Docker
Kubernetes
TCP/IP
VPN
Apply
In office · 5+ years exp · Master's Degree · Seongnam
Python
C++
C++
TensorFlow C++
AI/ML
vLLM
JAX
Multimodal AI
AI Agents
Diffusers
TensorRT
TensorRT-LLM
Transformers
TensorFlow
PyTorch
LLM
CUDA
Triton
Hugging Face
MLIR
Apache TVM
DevOps
GitHub Actions
CI/CD
Docker
Kubernetes
Buildkite
Apply
In office · Master's Degree · Seongnam
Python
C++
AI/ML
LLM
Apply
In office · Master's Degree · Seongnam
Python
C++
AI/ML
Computer Vision
Speech Recognition
OpenCL
CUDA
Apply
In office · Bachelor's Degree · Seongnam
Python
Perl
Apply
In office · 5+ years exp · Master's Degree · Seongnam
C
C++
C
MPI
AI/ML
TPU
NCCL
NVLink
DevOps
HPC
Apply
In office · Full-Time · 3+ years exp · Seongnam
C++
C++
LLVM
AI/ML
OpenMP
CUDA
MLIR
Apply
In office · Full-Time · Seongnam
C++
AI/ML
OpenCL
CUDA
Apply
In office · Full-Time · 3+ years exp · Seongnam
Python
Python
FastAPI
AI/ML
LangGraph
LangChain
Model Context Protocol
vLLM
Function Calling
AI Agents
LLM
RAG
Human-in-the-Loop
LLM Guardrails
DevOps
Git
Docker
Linux
Apply
≈ $111k – $244k per year (Estimated) · Hybrid · Full-Time · Seongnam
Management
Confluence
Agile
Apply
In office · Seongnam
Apply
See all jobs
This is one of many
2,292,754 more open roles from verified company boards, updated every day.