{"id":2102917,"url":"https://alion.io/job/luma-ai-software-engineer-inference-2","title":"Software Engineer, Inference","company":{"id":247,"name":"Luma AI","domain":"lumalabs.ai","url":"https://alion.io/company/luma-ai","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Backend","role_family":"Backend","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":118000,"max_usd":294000,"period":"year","method":"role_country_seniority_unknown","sample_n":359},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon S3","optional":false},{"name":"CI/CD","optional":false},{"name":"Docker","optional":false},{"name":"Hugging Face","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Redis","optional":false},{"name":"SGLang","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"vLLM","optional":false},{"name":"C","optional":true},{"name":"CUDA","optional":true},{"name":"CUDA Toolkit","optional":true},{"name":"FFmpeg","optional":true},{"name":"InfiniBand","optional":true},{"name":"NVLink","optional":true},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-10-08T16:45:41Z","employer_posted_date":"2026-10-08","last_verified_at":"2026-10-12T10:55:19Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"You'll own how Luma's models get served - integrating new architectures into the inference engine, scaling deployments across thousands of machines, and keeping expensive GPU fleets busy while meeting internal SLOs.\nThis is large-scale inference systems work: scheduling, fleet management, deployment pipelines, and reliability across clusters and hardware providers. It fits a strong systems engineer comfortable with model serving and Kubernetes at scale. If you want pure modeling rather than the systems that run models, this is firmly the systems side.\nWhat You'll Own\nShip new model architectures by integrating them into the inference engine.\n\nCollaborate across research, engineering, and infrastructure to optimize model efficiency and deployments.\n\nBuild internal tooling to measure, profile, and track the lifetime of inference jobs and workflows.\n\nAutomate, test, and maintain inference services for maximum uptime and reliability.\n\nManage and optimize inference workloads across clusters and hardware providers, and scale deployments across thousands of machines.\n\nBuild scheduling systems that use expensive GPU resources optimally while meeting SLOs, and maintain CI/CD for model checkpoints and SDKs.\n\nFirst 90 Days\nOne way the first 90 could unfold.\nDays 1-30 - Immerse & Diagnose: Learn the inference stack, the fleets, and where reliability or utilization break.\n\nDays 30-60 - Ship & Validate: Integrate a model or ship tooling/scheduling that improves uptime or GPU utilization.\n\nDays 60-90 - Scale & Systemize: Harden deployment pipelines and scheduling across clusters and providers.\n\nWhat You Bring\nStrong Python and system-architecture skills.\n\nExperience deploying models with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or similar.\n\nExperience with queues, scheduling, traffic control, and fleet management at scale.\n\nExperience with Linux, Docker, and Kubernetes, and with orchestration, deployment, and scheduling.\n\nFamiliarity with Redis and S3-compatible storage.\n\nNice to Have\nModern networking stacks including RDMA (RoCE, InfiniBand, NVLink).\n\nHigh-performance large-scale ML systems (100+ GPUs).\n\nCUDA, and FFmpeg or multimedia processing.\n\nAbout Luma: Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence - the next step beyond language models comes from vision. Luma is an equal opportunity employer.","description_format":"text","description_chars":2466,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Generative 3D","Generative Image","Generative Video"],"lifecycle":[{"event":"open","at":"2026-10-08T19:17:31Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":3,"expected_fill_days":54,"reasons":["conf:2","velocity","win:early"],"computed_at":"2026-10-12T06:55:09Z"},"pay":null,"html_url":"https://alion.io/job/luma-ai-software-engineer-inference-2","json_url":"https://alion.io/job/luma-ai-software-engineer-inference-2.json","meta":{"generated_at":"2026-10-12T11:44:07Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":18272,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":247},"rest":"https://alion.io/mcp/rest/get_company?id=247"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fluma-ai-software-engineer-inference-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fluma-ai-software-engineer-inference-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fluma-ai-software-engineer-inference-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/luma-ai-software-engineer-inference-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fluma-ai-software-engineer-inference-2"}]}