{"id":3981933,"url":"https://alion.io/job/opera-principal-engineer-on-device-inference-gpu-kernels","title":"Principal Engineer, On-Device Inference & GPU Kernels","company":{"id":13673,"name":"Opera","domain":"opera.com","url":"https://alion.io/company/opera-help","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Teamtailor","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"lead","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Wrocław, Poland","Warsaw, Poland"],"countries":["PL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CUDA","optional":false},{"name":"Edge AI","optional":false},{"name":"KV Cache","optional":false},{"name":"Mixture of Experts","optional":false},{"name":"MLX ML","optional":false},{"name":"OpenVINO","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"AWQ","optional":true},{"name":"Fine-tuning","optional":true},{"name":"GPTQ","optional":true},{"name":"llama.cpp","optional":true},{"name":"ONNX Runtime","optional":true},{"name":"SGLang","optional":true},{"name":"vLLM","optional":true}],"status":"live","first_seen_at":"2026-11-09T11:02:59Z","employer_posted_date":"2026-11-09","last_verified_at":"2026-11-10T20:59:16Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Location: Wrocław, Warsaw (Hybrid)\nWe're looking for a hands-on Principal Engineer to join our AI & Browser Innovation Hub in Wrocław, focusing on high-performance, on-device AI inference and GPU optimisation. In this role, you'll work at the intersection of advanced AI research and low-level systems engineering, developing solutions that make language models faster and more efficient on consumer hardware. Working closely with Opera's AI leadership, you'll take ownership of performance-critical components, from speculative decoding and GPU kernels to quantisation and memory management. You'll have the opportunity to experiment with emerging techniques, solve complex engineering challenges, and contribute to AI capabilities used by millions of Opera users.\nRole & Responsibilities\nSpeculative decoding. Train, tune and ship draft models for the models we run block-diffusion drafters (DFlash2-like), semi-autoregressive drafters with confidence-scheduled verification (DSpark), EAGLE-style heads and multi-token prediction and keep pushing acceptance length up and drafting cost down on consumer hardware.\n\nKernels. Write, fuse and tune kernels for attention, quantised matmul, MoE routing, sampling and draft verification, across Metal/MLX, CUDA, Vulkan and OpenVINO.\n\nQuantisation. Design mixed-precision schemes for weights, activations and KV cache. Match formats to the hardware, from 4-bit integer on integrated GPUs and NPUs to FP8, FP4 and microscaling formats on newer GPUs, and prove what each one costs in quality before it ships.\n\nPrefill and decode. Push time-to-first-token and tokens per second with flash and paged attention, efficient handling of sliding-window and hybrid attention, chunked prefill and kernel-level scheduling.\n\nTiered memory. Build hierarchical KV and context caching that spans GPU memory, system RAM and SSD, with prefix reuse, smart eviction and prefetching that hides I/O, so long contexts and multiple models fit on machines that shouldn't be able to hold them.\n\nMaking it work everywhere. Build the test matrix, performance telemetry and regression gates that catch a slow driver, a wrong numerical result or a stalled UI before users do.\n\nInstrumentation. Expose hooks into the runtime, such as activations and attention, so research and security work can see inside models without giving up the speed of fused kernels.\n\nJob Requirements\nDeep, hands-on GPU programming in at least one of CUDA, Metal/MLX or Vulkan compute, plus evidence that you've carried that work over to a second backend.\n\nHands-on speculative decoding experience: you've implemented or trained drafters and understand what actually drives acceptance rate and end-to-end speed-up.\n\nA track record of making real inference workloads measurably faster in tokens per second, latency or memory with numbers you can explain.\n\nStrong command of quantisation and its effect on model quality, including how you measure it.\n\nDiscipline about correctness. You validate numerics against a reference and measure quality, not just speed.\n\nNice to Have\nContributions to llama.cpp/ggml, MLX, vLLM, SGLang, ONNX Runtime, OpenVINO or similar.\n\nExperience with drafter-training frameworks or published work on speculative or parallel decoding.\n\nQuantisation research or tooling: GPTQ, AWQ, k-quants, MX formats, or quantisation-aware fine-tuning.\n\nKV cache compression, offloading or paging at the systems level.\n\nExperience with NPUs (Intel, Qualcomm, AMD, Apple Neural Engine).\n\nWhat's On Offer\nAt Opera, you'll join a collaborative, international team with a flat structure, direct communication, and opportunities for professional growth.\nAdvanced computing resources: Access to Apple Silicon, NVIDIA (including Blackwell-class), AMD, and Intel hardware, plus cloud GPUs for model training.\n\nTechnical ownership: Lead performance-critical development of Opera's on-device AI, working directly with AI leadership.\n\nGlobal impact: Build AI solutions used by hundreds of millions of browser users across diverse hardware platforms.\n\nResearch opportunities: Contribute to open-source projects and publish technical findings where appropriate.\n\nInterested?\nWe'd love to hear from you! Applications are reviewed on a rolling basis, so we encourage you to apply soon. Please submit your CV in English.","description_format":"text","description_chars":4303,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Advertising","Domain Registrars & Registries","Mobile Games","Consumer & Utility Software"],"lifecycle":[{"event":"open","at":"2026-11-09T20:02:46Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":41,"reasons":["conf:4","win:early"],"computed_at":"2026-11-10T06:52:35Z"},"pay":null,"html_url":"https://alion.io/job/opera-principal-engineer-on-device-inference-gpu-kernels","json_url":"https://alion.io/job/opera-principal-engineer-on-device-inference-gpu-kernels.json","meta":{"generated_at":"2026-11-10T23:57:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":500,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-11T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":13673},"rest":"https://alion.io/mcp/rest/get_company?id=13673"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fopera-principal-engineer-on-device-inference-gpu-kernels"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fopera-principal-engineer-on-device-inference-gpu-kernels"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fopera-principal-engineer-on-device-inference-gpu-kernels"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/opera-principal-engineer-on-device-inference-gpu-kernels\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fopera-principal-engineer-on-device-inference-gpu-kernels"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3981933}},{"tool":"search_jobs","arguments":{"company":"opera.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3981933},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}