{"id":447432,"url":"https://alion.io/job/arago-ml-systems-engineer-inference-acceleration","title":"ML Systems Engineer — Inference Acceleration","company":{"id":173018,"name":"Arago","domain":"arago.inc","url":"https://alion.io/company/arago-2","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":83,"open_postings":4,"ghost_share":0,"stale_share":0.5,"repost_share":0,"time_to_fill_p50_days":76,"computed_at":"2026-10-24T06:02:35Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Paris, France"],"countries":["FR"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":58000,"max_usd":124000,"period":"year","method":"role_country_seniority_unknown","sample_n":114},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"KV Cache","optional":false},{"name":"MLIR","optional":false},{"name":"Python","optional":false},{"name":"ROCm","optional":false},{"name":"SGLang","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-08-17T12:10:55Z","employer_posted_date":"2026-08-17","last_verified_at":"2026-10-24T12:15:13Z","board_verified":true,"closed_at":null,"days_open":68,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":68},"description":"Meet Arago and the Aragonians\nArago’s mission is to re-engineer the foundations of computing from first principles.\nThe explosive growth of AI is pushing the industry to rethink how processors are built. Arago is meeting that challenge with a proprietary technology that fuses optical and CMOS technologies to deliver an order-of-magnitude increase in performance.\nArago is the fastest, and currently the only, company to have built such a processor. It's backed by leading deep-tech investors and some of the most respected figures in semiconductors and computing, including the CEO of Arm, the founder of macOS who worked directly with Steve Jobs at Apple, an Nvidia Fellow, the Head of Optics at Google, and many other industry leaders.\nOur work is guided by three clear values: do great things, move with high velocity, and operate as one unit. We work in a demanding environment where constant learning, ownership, and execution are expected, and where exceptional people have the opportunity to do their life’s work.\nWhat you’ll do\nOptimize the execution and serving of modern AI models on Arago's custom accelerator. Work across kernels, model execution, multi-device distribution, runtime, and inference serving, while helping shape the software stack around the capabilities of Arago's hardware.\nRequired Skills and Experience\nStrong experience in high-performance ML inference, GPU/accelerator programming, or ML systems engineering.\n\nDeep understanding of computer architecture, accelerator/GPU execution models, memory hierarchies, parallelism, and performance bottlenecks.\n\nExperience developing and optimizing custom kernels using CUDA, Triton, ROCm/HIP, or equivalent low-level programming environments.\n\nExperience with operator fusion, tiling, scheduling, data movement optimization, graph execution, and profiling of compute- and memory-bound workloads.\n\nStrong understanding of distributed model execution, including tensor, pipeline, sequence, and/or expert parallelism and communication/computation overlap.\n\nHands-on experience with modern inference-serving systems such as vLLM, SGLang, TensorRT-LLM, or equivalent, including KV-cache management, continuous batching, paged attention, and prefill/decode scheduling.\n\nStrong C++ and Python skills, and comfort working on a custom accelerator stack where compiler, runtime, kernels, and abstractions are actively being developed. Exposure to or experience with MLIR and MLIR dialects is a strong plus.\n\nLanguage: English at a proficient level.\n\nResponsibilities\nAnalyze modern AI workloads and identify kernel-, runtime-, memory-, and system-level bottlenecks on Arago's accelerator.\n\nDevelop and optimize custom kernels, fused operators, and execution strategies to maximize device utilization.\n\nDesign efficient mappings of models and operators across multiple Arago devices, including communication and synchronization strategies.\n\nDevelop inference-serving techniques such as continuous batching, paged KV caches, prefix/context caching, chunked prefill, and prefill/decode interleaving or disaggregation.\n\nBuild profiling, benchmarking, and performance-analysis infrastructure spanning kernels, full models, and serving workloads.\n\nWork closely with Arago's hardware, compiler, and runtime teams to co-design software abstractions and influence future hardware features based on real model workloads.\n\nPay and benefits\nCompetitive cash compensation, with final package based on location, experience, and the pay of team members in similar positions.\n\nMeaningful stock option plan offered (included in the majority of full time offers).\n\nHealthcare coverage (including family-friendly options), pension contributions, professional development support, and 25 days of PTO, in addition to public holidays.\n\nOwnership of a key technical domain, with significant vertical and/or horizontal growth opportunities, based on performance and individual drive.\n\nWe look forward to hearing how you can help shape the future of AI at Arago.","description_format":"text","description_chars":4003,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Growth opportunities","Professional development"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-09-06T07:59:09Z"}],"visa":[],"liveness":{"score":40,"band":"fade","label":"Fading","p_open":1,"p_active":0.659,"p_room":0.6,"age_days":67,"expected_fill_days":76,"reasons":["conf:2","win:late","crowd:"],"computed_at":"2026-10-24T06:02:35Z"},"pay":null,"html_url":"https://alion.io/job/arago-ml-systems-engineer-inference-acceleration","json_url":"https://alion.io/job/arago-ml-systems-engineer-inference-acceleration.json","meta":{"generated_at":"2026-10-24T15:51:34Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":22815,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-25T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":173018},"rest":"https://alion.io/mcp/rest/get_company?id=173018"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Farago-ml-systems-engineer-inference-acceleration"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Farago-ml-systems-engineer-inference-acceleration"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Farago-ml-systems-engineer-inference-acceleration"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/arago-ml-systems-engineer-inference-acceleration\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Farago-ml-systems-engineer-inference-acceleration"}]}