{"id":582875,"url":"https://alion.io/job/snowflake-ai-systems-research-and-development-engineer-llm-inference-systems-optimization","title":"Senior/Staff System Research Engineer – LLM Inference Optimization","company":{"id":96,"name":"Snowflake","domain":"snowflake.com","url":"https://alion.io/company/snowflake","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":86,"open_postings":51,"ghost_share":0,"stale_share":0.549,"repost_share":0.02,"time_to_fill_p50_days":54,"computed_at":"2026-10-29T05:49:05Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"staff","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Bellevue, United States","Menlo Park, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":236000,"max":330000,"currency":"USD","period":"year","gross":null,"usd_annual":330000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CUDA","optional":false},{"name":"cuDNN","optional":false},{"name":"CUTLASS","optional":false},{"name":"DeepSpeed","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Mixture of Experts","optional":false},{"name":"Post-training","optional":false},{"name":"Quantization","optional":false},{"name":"SGLang","optional":false},{"name":"Snowflake","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"TensorFlow","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-09-09T23:46:08Z","employer_posted_date":"2026-09-21","last_verified_at":"2026-10-29T10:39:28Z","board_verified":true,"closed_at":null,"days_open":49,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":49},"description":"At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset - who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done.\nWe are looking for talented systems developers and researchers to join the Snowflake AI Research team and advance the state of the art in LLM inference systems and optimization.\nOur mission is to build the next generation of high-performance and intelligent inference systems. We optimize not only how fast and efficiently models run, but also how quickly inference systems can adapt to new models, architectures, hardware, and workloads.\nOur work spans the full inference stack-from distributed serving and runtime systems to GPU kernels and model-system co-design. We explore techniques such as adaptive parallelism, speculative and parallel decoding, disaggregated inference, scheduling and batching, KV-cache optimization, model swapping, quantization, and GPU kernel optimization to push the frontier of latency, throughput, scalability, and cost.\nBeyond optimizing individual models, we are building intelligent and adaptive inference systems that can automate performance optimization-rapidly profiling new models and workloads, identifying bottlenecks, selecting effective execution strategies, and adapting system configurations with minimal manual tuning. We embrace AI-native engineering, using AI not only as the workload we optimize, but also as a tool to accelerate system development, experimentation, debugging, optimization, and adaptation to new models. Our goal is to accelerate both the speed of inference and the agility of inference development.\nThis is an exciting opportunity to collaborate with a world-class team, including founding members of DeepSpeed, vLLM, and TensorFlow. Together, we will push the boundaries of AI systems and bring cutting-edge research into production-scale AI.\nResponsibilities\nDesign and develop high-performance LLM inference systems, spanning distributed serving, runtime systems, GPU execution, and performance-critical kernels.\n\nDevelop novel techniques to improve inference latency, generation speed, throughput, memory efficiency, scalability, and cost.\n\nExplore advanced inference techniques including speculative and parallel decoding, prefill/decode disaggregation, adaptive parallelism, continuous batching and scheduling, KV-cache management, quantization, and communication optimization.\n\nDevelop adaptive and intelligent inference systems that automatically optimize execution for new model architectures, hardware platforms, workload characteristics, and deployment environments.\n\nApply AI-driven and AI-native approaches to systems engineering, including automated profiling, bottleneck identification, configuration search, code generation, experimentation, runtime strategy selection, debugging, and performance tuning.\n\nIndependently identify high-impact performance and systems problems, formulate hypotheses, prototype solutions, and drive promising ideas from research through production.\n\nDesign distributed inference strategies across GPUs and nodes, including tensor, sequence, pipeline, data, and expert parallelism.\n\nDevelop efficient approaches for multi-model serving, dynamic resource management, model loading and swapping, and workload-aware scheduling.\n\nAnalyze and optimize GPU kernels and operators for attention, MoE, communication, and other performance-critical model components.\n\nExplore model-system co-design, including model or post-training techniques that unlock substantially more efficient inference.\n\nProfile and benchmark end-to-end workloads to identify bottlenecks across compute, memory, communication, networking, scheduling, and model execution.\n\nCollaborate closely with model researchers, infrastructure teams, and product teams to deploy research innovations in production.\n\nOpen-source and publish innovations through technical blogs and top-tier systems and machine learning conferences.\n\nRequirements\nBachelor’s degree in Computer Science, Electrical Engineering, or a related field. A Master’s degree or PhD is preferred.\n\n5+ years of experience in one or more of the following areas: LLM inference systems, distributed AI systems, GPU systems, or high-performance computing.\n\nStrong understanding of modern LLM inference architectures and the performance tradeoffs involved in serving large-scale models.\n\nHands-on experience with modern LLM inference and serving frameworks, such as vLLM, SGLang, TensorRT-LLM, or similar systems.\n\nExperience designing, extending, or optimizing inference runtimes, including areas such as scheduling, batching, KV-cache management, distributed execution, parallelism, speculative decoding, or disaggregated serving.\n\nStrong understanding of GPU architectures and experience with CUDA, Triton, or similar GPU programming environments.\n\nExperience with performance-oriented libraries and frameworks such as CUTLASS, cuBLAS, cuDNN, or related technologies.\n\nExperience profiling and diagnosing end-to-end system performance using Nsight Systems, Nsight Compute, or equivalent tools.\n\nDemonstrated ability to operate as an independent problem identifier and solver-recognizing important problems with limited direction, defining the right technical questions, and driving solutions through ambiguity.\n\nStrong ability to work across model, runtime, distributed system, and hardware layers and reason about end-to-end performance tradeoffs.\n\nExperience using AI-native engineering approaches to accelerate software development, experimentation, debugging, optimization, or system adaptation is a strong plus.\n\nExcellent communication skills and the ability to collaborate effectively across research, engineering, and product teams.\n\nSnowflake is growing fast, and we’re scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.\nHow do you want to make your impact?\nFor jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com","description_format":"text","description_chars":6734,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Warehouses & Lakehouses","Databases & DBMS","Data Marketplaces, Sharing & Clean Rooms"],"lifecycle":[{"event":"open","at":"2026-09-10T00:16:35Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 529 · green card filings: 106","filings_12m":529,"filings_prev_12m":372,"green_card_filings_12m":106,"median_offered_wage_usd":160862,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":331}],"liveness":{"score":35,"band":"fade","label":"Fading","p_open":1,"p_active":0.578,"p_room":0.6,"age_days":49,"expected_fill_days":54,"reasons":["conf:3","stale_co","velocity","win:late","crowd:brand"],"computed_at":"2026-10-29T05:49:05Z"},"pay":{"stated_usd_annual":330000,"is_top_pay":true},"html_url":"https://alion.io/job/snowflake-ai-systems-research-and-development-engineer-llm-inference-systems-optimization","json_url":"https://alion.io/job/snowflake-ai-systems-research-and-development-engineer-llm-inference-systems-optimization.json","meta":{"generated_at":"2026-10-29T13:12:26Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":19810,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":96},"rest":"https://alion.io/mcp/rest/get_company?id=96"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsnowflake-ai-systems-research-and-development-engineer-llm-inference-systems-optimization"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsnowflake-ai-systems-research-and-development-engineer-llm-inference-systems-optimization"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsnowflake-ai-systems-research-and-development-engineer-llm-inference-systems-optimization"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/snowflake-ai-systems-research-and-development-engineer-llm-inference-systems-optimization\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsnowflake-ai-systems-research-and-development-engineer-llm-inference-systems-optimization"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":582875}},{"tool":"search_jobs","arguments":{"company":"snowflake.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":582875},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}