{"id":1937135,"url":"https://alion.io/job/adaption-labs-inference-engineer","title":"Inference Engineer","company":{"id":669497,"name":"Adaption Labs","domain":"adaptionlabs.ai","url":"https://alion.io/company/adaptionlabs","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":165000,"max_usd":364000,"period":"year","method":"role_country_seniority_unknown","sample_n":3434},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"CUDA Toolkit","optional":false},{"name":"KV Cache","optional":false},{"name":"NCCL","optional":false},{"name":"Python","optional":false},{"name":"Quantization","optional":false},{"name":"Rust","optional":false},{"name":"SGLang","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-10-05T23:11:40Z","employer_posted_date":"2026-10-05","last_verified_at":"2026-10-06T21:33:16Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"The role\nYou'll own the cost and performance of our inference stack. Your work will determine how efficiently we serve models as workloads, traffic, and hardware change.\nYou'll work closely with the engineers operating the serving fleet while owning the core performance levers: caching, batching, quantization, decoding, and kernel-level optimization. Success means improving throughput and latency without compromising reliability or model quality.\nResponsibilities\nImprove throughput, cost, and tail latency through KV-cache management, continuous batching, speculative decoding, and quantization.\n\nOptimize long-context prefill and decode workloads based on real production traffic.\n\nTune routing between our infrastructure and external providers based on cost, capacity, and performance.\n\nWork within serving engines such as vLLM, SGLang, and TensorRT-LLM, going below the framework when needed.\n\nBuild profiling and measurement systems that show where time, memory, and compute are being spent.\n\nQualifications\n5+ years in ML systems, inference infrastructure, or performance engineering, with measurable improvements in cost or latency.\n\nDeep understanding of model serving, including prefill and decode, memory bandwidth, batching, and concurrency.\n\nProduction experience with serving engines such as vLLM, SGLang, or TensorRT-LLM.\n\nStrong Python skills and proficiency in C++, Rust, or another systems language.\n\nExperience with GPU performance, including CUDA, NCCL, mixed precision, memory layout, kernels, or quantization.\n\nAbove all, we're looking for great teammates who make work feel lighter and aren't afraid to go out on a limb with bold ideas. You don't need to be perfect, but you do need to be adaptable. We encourage you to apply, even if you don't check every box.\nAbout us\nMost AI is frozen in place - it doesn't adapt to the world. We think that's backwards. Our mandate is to build efficient intelligence that evolves in real-time. Our vision is AI systems that are flexible, personalized, and accessible to everyone. We believe efficiency is what makes this possible - it's how we expand access and ensure innovation benefits the many, not the few. We believe in talent density: bringing together the best and most driven individuals to push the boundaries of continual adaptation. We're looking for builders and creative thinkers ready to shape the next era of intelligence.\nBenefits\nFlexible work: In-person collaboration in the Bay Area, a distributed global-first team, and team offsites.\n\nAdaption Passport: Annual travel stipend to explore a country you've never visited. We're building intelligence that evolves alongside you, so we encourage you to keep expanding your horizons.\n\nLunch Stipend: Weekly meal allowance for take-out or grocery delivery.\n\nWell-Being: Comprehensive medical benefits and generous paid time off.","description_format":"text","description_chars":2857,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-06T00:02:03Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":34,"reasons":["conf:0","win:early"],"computed_at":"2026-10-06T05:45:30Z"},"pay":null,"html_url":"https://alion.io/job/adaption-labs-inference-engineer","json_url":"https://alion.io/job/adaption-labs-inference-engineer.json","meta":{"generated_at":"2026-10-06T22:51:14Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":3616,"day_limit":5000,"remaining_today":1384,"minute_limit":60,"resets_at":"2026-10-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":669497},"rest":"https://alion.io/mcp/rest/get_company?id=669497"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fadaption-labs-inference-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fadaption-labs-inference-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fadaption-labs-inference-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/adaption-labs-inference-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fadaption-labs-inference-engineer"}]}