{"id":2921396,"url":"https://alion.io/job/mistral-ai-research-engineer-latency-throughput","title":"Research Engineer, Latency & Throughput","company":{"id":22,"name":"Mistral AI","domain":"mistral.ai","url":"https://alion.io/company/mistral-ai","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":95,"open_postings":197,"ghost_share":0,"stale_share":0.005,"repost_share":0,"time_to_fill_p50_days":64,"computed_at":"2026-10-26T05:57:25Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Paris, France","London, United Kingdom"],"countries":["FR","GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":56000,"max_usd":121000,"period":"year","method":"role_country_seniority_unknown","sample_n":121},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"Fine-tuning","optional":false},{"name":"JAX","optional":false},{"name":"LLM","optional":false},{"name":"Mistral","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Quantization","optional":false},{"name":"Rust","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"Tokenization","optional":false},{"name":"vLLM","optional":false}],"status":"live","first_seen_at":"2026-10-20T11:22:45Z","employer_posted_date":"2026-10-20","last_verified_at":"2026-10-27T00:14:57Z","board_verified":true,"closed_at":null,"days_open":6,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":6},"description":"About Mistral\nMistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.\nWe are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited.\nThe Role\nAs a Research Engineer on the Latency & Throughput team, you will push the frontier of LLM inference by researching and prototyping techniques that reduce latency and increase throughput - from speculative decoding and quantization to KV compression and new attention variants. The team sits at the intersection of research and production: you will take ideas from recent literature, form hypotheses, run experiments, and ship the techniques that prove out into our serving stack.\nThis role sits between our inference engineers, who own the production serving stack, and our research scientists, who focus on paper-level contributions. You will be more science-focused than a pure engineer: you are expected to generate new ideas, keep up with the state of the art, and implement proof-of-concepts that bridge the gap between academic results and production impact. Some techniques you explore will be lossy or require integration into training - retraining models, tuning architectures, or training auxiliary models to improve inference.\nYou will work closely with the Inference Foundation and Kernels teams, who turn your validated techniques into production recipes, and with pretraining and RL teams when your work touches model training. Success is measured by demonstrated latency or throughput gains, first at small scale, then adopted in production.\nWhat You Will Do\nResearch and prototype inference techniques - speculative decoding, quantization, KV compression, watermarking, and new model architectures - by reading recent literature and forming testable hypotheses.\n\nDesign and run experiments to validate or refute ideas, iterating quickly on small-scale setups before proposing production integration. Demonstrate clear latency or throughput gains without unacceptable quality loss.\n\nCollaborate with the Inference Foundation team to integrate validated techniques into the vLLM-based serving stack.\n\nPartner with pretraining and RL teams when techniques require co-training, retraining, or training auxiliary models to improve inference.\n\nBuild the right tooling and validation platforms to facilitate AI-driven inference research.\nWhat We're Looking For\nA strong ML background with solid knowledge of LLM training techniques - architecture, tokenization, fine-tuning, and evaluation.\n\nHands-on experience with Python and PyTorch; you write clean, experimental code and iterate fast. JAX is acceptable with strong Python proficiency. C++ and Rust are not required, CUDA and GPU knowledge is expected but hands-on experience is not required.\n\nResearch experience of some form: a thesis, publications, a dedicated research project, or efficiency-oriented work in a lab or industry research setting. A PhD is not required, but we are looking for genuine research depth.\n\nA track record of conducting experiments: forming hypotheses, designing controlled comparisons, and drawing clear conclusions from results.\n\nFamiliarity with the state of the art in LLM inference - you know what has been tried, what works, and where the open problems are.\n\nSelf-starter, low-ego, and collaborative. You are comfortable with ambiguity, negative results, and are eager to take matters into your own hands.\n\nInference or serving experience is a plus, not a requirement. Prior work with vLLM, production LLM deployments, or serving systems will help you ramp up faster.\n\nLocation and Remote\nThis role is based in our Paris or London offices (hybrid). We will prioritize candidates who reside in the Paris area or are open to relocating. We strongly believe in the value of in-person collaboration to foster strong relationships and seamless communication within our team. For senior profiles, we will also consider remote candidates based in France. In that case, we ask all new hires to visit our Paris office:\nFor the first week of their onboarding (accommodation and travel covered)\n\nThen at least 3 days per month\n\nWhat We Offer\nWe offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.\nFor the most up-to-date details on benefits available in your location, please refer to our Benefits page.\nPrivacy Policy\nYour privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy.","description_format":"text","description_chars":5170,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":["Parental leave","Retirement plans","Wellness"],"hiring_locations":[{"name":"France","iso":"FR","kind":"country"}],"hiring_excludes":[],"relocation_offered":true,"industries":["LLM & Generative AI","Code Intelligence","Foundation Models","AI Research Labs"],"lifecycle":[{"event":"open","at":"2026-10-20T12:05:13Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":5,"expected_fill_days":64,"reasons":["conf:0","velocity","win:early","comp:brand"],"computed_at":"2026-10-26T05:57:25Z"},"pay":null,"html_url":"https://alion.io/job/mistral-ai-research-engineer-latency-throughput","json_url":"https://alion.io/job/mistral-ai-research-engineer-latency-throughput.json","meta":{"generated_at":"2026-10-27T00:44:46Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":937,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-28T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":22},"rest":"https://alion.io/mcp/rest/get_company?id=22"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmistral-ai-research-engineer-latency-throughput"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmistral-ai-research-engineer-latency-throughput"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmistral-ai-research-engineer-latency-throughput"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/mistral-ai-research-engineer-latency-throughput\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmistral-ai-research-engineer-latency-throughput"}]}