{"id":140755,"url":"https://alion.io/job/commonai-senior-software-engineer-vllm","title":"Senior Software Engineer (vLLM)","company":{"id":38984,"name":"Commonai","domain":"commonai.org","url":"https://alion.io/company/commonai","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"A","score":100,"open_postings":3,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":56,"computed_at":"2026-10-16T05:45:00Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Cambridge, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":89000,"max_usd":169000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":125},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"CI/CD","optional":false},{"name":"CUDA","optional":false},{"name":"CUDA Toolkit","optional":false},{"name":"Hugging Face","optional":false},{"name":"LLM","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"PyTorch C++","optional":false},{"name":"Ray","optional":false},{"name":"Rust","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"TGI","optional":false},{"name":"TPU","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-06-26T00:00:00Z","employer_posted_date":"2026-06-26","last_verified_at":"2026-10-16T22:56:03Z","board_verified":true,"closed_at":null,"days_open":113,"trust":{"level":"ok","repost_count":0,"flags":[],"days_open":112},"description":"CommonAI CIC is a non-profit membership organisation, founded on a belief in collaborative engineering for the safe and responsible development of foundational AI technologies. A place where AI startups, enterprises large and small, public sector bodies and academia can share resources and knowledge, to codevelop and grow businesses, fast.\nWe are led by experienced founders, investors and engineers who believe that collaborative engineering drives faster AI innovation and are backed by a mix of UK Government and private funding in order to design, build and deploy innovative AI systems.\nThe Opportunity\nWe are seeking a Senior Software Engineer with a passion for open-source AI infrastructure to work on deploying, extending and optimising vLLM (and potentially other inference serving engines) to support our projects. You will play a crucial, high-impact role across both our key programmes, the Scaling Inference Lab (https://scalinginference.org) and the High Assurance programme.\nAs an AI-first company, we strongly believe in collaborative engineering powered by the tools we are helping to build. This role places a major emphasis on using LLMs, AI coding assistants, and autonomous agents for software development.\nWhat You'll Do\nDeploy, instrument and monitor open weight models served using vLLM.\nImplement new features within vLLM to support novel hardware architectures as part of the Scaling Inference Lab.\nWork with the Panopticon team to identify opportunities to extend vLLM to enhance accuracy, explainability, and accountability when using it to serve models in regulated environments.\nActively collaborate with the open-source vLLM community to propose, review, and upstream core changes.\nTroubleshoot, profile, and optimise inference performance, focusing on latency, throughput, and hardware utilisation.\nRequirements\nProven experience working as a Senior Software Engineer with deep expertise in both Python and low-level programming (e.g. C/C++, Rust, assembly or CUDA).\nA history of direct contributions to vLLM or similar high-performance open-source ML/AI projects (e.g. PyTorch, Hugging Face TGI, TensorRT-LLM, Ray).\nStrong understanding of LLM inference mechanics (e.g. KV caching, continuous batching, memory management, model quantisation).\nExperience interacting with, and upstreaming code to, active open-source communities.\nHands-on experience working on performance optimisation for hardware accelerators (GPUs, TPUs, CPU vector units or other accelerators).\nA strong enthusiasm for using LLMs, coding assistants, and agents as core tools in your own software development process.\nWe also value:\nExperience working on software systems that operate in highly regulated or high-assurance environments (e.g. financial services).\nAn understanding of the latest AI safety research and active involvement in that community.\nDeep knowledge of modern MLOps practices, CI/CD, and large-scale deployments.\nBenefits\nA collaborative and supportive work environment\nThe opportunity to have a high impact in a growing organisation\nCompetitive salary package and pension\nProfessional development opportunities\nNetworking opportunities with influential people from across the tech sector, financial services, and academia\nA vibrant office environment located a few minutes' walk away from Cambridge train station\nCommonAI CIC is an equal opportunity employer and is committed to creating an inclusive and diverse workplace.","description_format":"text","description_chars":3449,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Professional development"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-06-26T00:00:00Z"}],"visa":[],"liveness":{"score":14,"band":"cold","label":"Long shot","p_open":1,"p_active":0.508,"p_room":0.28,"age_days":112,"expected_fill_days":56,"reasons":["conf:2","win:tail","crowd:"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/commonai-senior-software-engineer-vllm","json_url":"https://alion.io/job/commonai-senior-software-engineer-vllm.json","meta":{"generated_at":"2026-10-17T04:23:36Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5746,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":38984},"rest":"https://alion.io/mcp/rest/get_company?id=38984"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcommonai-senior-software-engineer-vllm"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcommonai-senior-software-engineer-vllm"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcommonai-senior-software-engineer-vllm"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/commonai-senior-software-engineer-vllm\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcommonai-senior-software-engineer-vllm"}]}