{"id":1258072,"url":"https://alion.io/job/general-compute-head-of-infrastructure","title":"Head of Infrastructure","company":{"id":1776673,"name":"General Compute","domain":"generalcompute.com","url":"https://alion.io/company/generalcompute","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Leadership","role_family":"Leadership","seniority":"head","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":211000,"max_usd":396000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":2716},"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"HPC","optional":false},{"name":"Kubernetes","optional":false},{"name":"OpenRouter","optional":false},{"name":"Platform Engineering","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"Cerebras","optional":true},{"name":"InfiniBand","optional":true},{"name":"SGLang","optional":true},{"name":"TensorRT","optional":true},{"name":"TensorRT-LLM","optional":true},{"name":"TGI","optional":true},{"name":"TPU","optional":true},{"name":"vLLM","optional":true}],"status":"live","first_seen_at":"2026-09-01T20:52:09Z","employer_posted_date":"2026-09-01","last_verified_at":"2026-11-01T07:16:57Z","board_verified":true,"closed_at":null,"days_open":60,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":60},"description":"About Us\nGeneral Compute is the neocloud for alternative chips.\nInference is fragmenting: purpose-built silicon from SambaNova, Cerebras, Positron, d-Matrix, and others already beats GPUs on decode, and we productionize that hardware - we buy the racks, find the data center space, and run it for our customers. Each piece of hardware runs the workload it's actually built for: prefill stays on GPUs, decode moves to the chip built for it, and today that means generating tokens 5-7× faster than existing GPU-based competitors. Our customers are frontier labs, fast-growing AI application companies, and asset-light clouds.\nWe closed a $15M seed round in May 2026, and have since closed a $400M debt facility - $100M funded upfront by Upper90, with the balance available for drawdown - collateralized by our inference chips.\nAbout the role\nYou'll own the infrastructure layer of our inference cloud end-to-end. Today that means the control plane, the gateway in front of our ASIC fleet, and the observability stack that tells us where every millisecond goes. Over the next 6-8 months, it will grow into a heterogeneous fleet: ASICs for decode, GPUs for pre-fill, and the physical-layer ownership that comes with it.\nThe first six months are hands-on: k8s manifests, dashboards, oncall, and a direct line to our ASIC partner's engineering team when production behaves strangely. The team grows under you from there.\nWhat you'll do:\nOwn the inference control plane. At the moment, it's built on configuration provided by our ASIC partner; you'll be the person who understands it deeply enough to modify, extend, and eventually replace pieces of it.\n\nOwn the gateway and load balancer that fronts the fleet. Model placement, request routing, and tail-latency engineering live here, driven by live utilization and per-model SLOs.\n\nOwn observability end-to-end. Per-request tracing from OpenRouter ingress through to the accelerator, with p50/p95/p99 dashboards, SLOs, and alerting that wakes the right person.\n\nRun capacity planning against a real, distributed traffic mix across the open-weight models we serve.\n\nOwn the operational side of the ASIC partnership. Most weird production issues route through their engineering team until we build that expertise in-house, and you'll be our technical face in those conversations.\n\nBring up the pre-fill side of our disaggregated architecture on a second hardware platform as it comes online. Different vendor, different fabric, different kernels.\n\nBuild the on-call and incident response practice from zero. Hire and grow the team underneath you.\n\nWhat we need from you:\n7+ years in infrastructure, SRE, or platform engineering, with at least some of it at a serious inference, ML, or HPC shop.\n\nHands-on with Kubernetes at production scale - not just deploying, but debugging the weird stuff.\n\nStrong instincts for tail latency. You think about p99 and utilization as the same problem, not different ones.\n\nComfortable owning a vendor relationship where the vendor's bugs are now your production issues.\n\nTrack record of building observability practices that actually catch problems, not just generate dashboards.\n\nHave been on-call through real incidents and can talk about what you learned.\n\nWant to be the first infra hire at something early, not the tenth at something big.\n\nNIce-to-Haves:\nExperience operating non-NVIDIA accelerators in production - TPUs, ASICs, or alternative GPU vendors.\n\nBackground with model-serving stacks (vLLM, TGI, TensorRT-LLM, SGLang).\n\nNetwork fabric experience at data-center scale (RoCE, InfiniBand).\n\nHave hired and managed an infra team before.\n\nComfort at the hardware boundary - firmware, drivers, thermals - for when the roadmap takes us there.","description_format":"text","description_chars":3729,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Cloud Platforms (IaaS & PaaS)","AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-09-25T19:36:10Z"}],"visa":[],"liveness":{"score":16,"band":"cold","label":"Long shot","p_open":1,"p_active":0.582,"p_room":0.28,"age_days":60,"expected_fill_days":30,"reasons":["conf:2","win:tail","crowd:"],"computed_at":"2026-11-01T06:10:25Z"},"pay":null,"html_url":"https://alion.io/job/general-compute-head-of-infrastructure","json_url":"https://alion.io/job/general-compute-head-of-infrastructure.json","meta":{"generated_at":"2026-11-01T10:10:03Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":15658,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-02T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1776673},"rest":"https://alion.io/mcp/rest/get_company?id=1776673"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fgeneral-compute-head-of-infrastructure"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fgeneral-compute-head-of-infrastructure"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fgeneral-compute-head-of-infrastructure"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/general-compute-head-of-infrastructure\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fgeneral-compute-head-of-infrastructure"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1258072}},{"tool":"search_jobs","arguments":{"company":"generalcompute.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1258072},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}