{"id":3307714,"url":"https://alion.io/job/techchain-talent-senior-gpu-infrastructure-engineer","title":"Senior GPU Infrastructure Engineer","company":{"id":4476923,"name":"TechChain Talent","domain":"techchaintalent.xyz","url":"https://alion.io/company/tech-chain-talent","size_band":"11-50","is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Schema","truth_index":{"grade":"B","score":75,"open_postings":8,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-29T05:49:05Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":180000,"max":250000,"currency":"USD","period":"year","gross":null,"usd_annual":250000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Configuration Management","optional":false},{"name":"CUDA","optional":false},{"name":"Pulumi","optional":false},{"name":"Terraform","optional":false},{"name":"InfiniBand","optional":true},{"name":"Kubernetes","optional":true},{"name":"Ray","optional":true},{"name":"SLURM","optional":true}],"status":"live","first_seen_at":"2026-08-19T14:54:38Z","employer_posted_date":"2026-08-19","last_verified_at":"2026-10-29T22:25:48Z","board_verified":true,"closed_at":null,"days_open":71,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":71},"description":"Senior GPU Infrastructure Engineer\nLocation: San Francisco\nSalary: $180K - $250K\nAbout Hyperbolic Hyperbolic Labs is pioneering AI infrastructure with its open-access GPU cloud, aggregating computing resources across the globe to offer an innovative GPU marketplace and AI inference service at up to 75% cost savings compared to traditional cloud providers. The mission is to democratise AI by breaking down barriers to computing power, making it affordable and accessible to developers and researchers everywhere.\nFounded by co-founders with PhDs in AI, Math, and Computer Science, Hyperbolic raised a Series A and is preparing for significant growth. The team is approximately 30 people with an engineering-driven culture emphasising ownership, execution, and building at the cutting edge of GPU infrastructure. About the Role This is a foundational infrastructure role: building the multi-tenancy provisioning and virtualisation layer that transforms raw GPUs from diverse global suppliers into a programmable, orchestrated pool serving thousands of AI developers and researchers.\nThis is hands-on, deep infrastructure work - bare-metal provisioning, GPU scheduling, storage systems, and networking - not a wrapper around AWS. Key Responsibilities - Build and scale the GPU Cloud Marketplace by designing multi-tenancy provisioning and virtualisation solutions - Manage bare-metal provisioning and lifecycle management: IPMI/Redfish, BMC-based remote management, PXE boot, automated OS deployment - Design and implement GPU scheduling and orchestration: GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, fragmentation minimisation - Build and maintain infrastructure automation using Terraform or Pulumi, CI/CD pipelines, secrets management, configuration management, and observability stacks - Design storage and data infrastructure for AI/ML workloads: object storage, high-IOPS block storage, distributed file systems for training data and checkpoints - Implement API design and cloud-init for automated provisioning and configuration - Work with hardware vendors and vendor engineering teams to troubleshoot issues and optimise integrations Requirements - Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows - Deep understanding of GPU scheduling and orchestration: GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, fragmentation minimisation - Strong infrastructure and DevOps engineering skills: Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementation - Experience with storage and data infrastructure for AI/ML workloads: object storage, high-IOPS block storage, and distributed file systems - Solid understanding of GPU architecture, CUDA, and GPU compute optimisation - Proven experience building and scaling cloud infrastructure or distributed systems in production environments - Excellent communication skills across technical and non-technical stakeholders Bonus Skills - Familiarity with high-performance networking: InfiniBand and RoCE (RDMA over Converged Ethernet) - Experience with distributed storage systems: Ceph, Weka, or VAST Data - Experience with Kubernetes GPU operators, Slurm, or Ray for distributed training - Background at GPU cloud or AI infrastructure companies","description_format":"text","description_chars":3503,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-27T02:12:15Z"}],"visa":[],"liveness":{"score":7,"band":"cold","label":"Long shot","p_open":1,"p_active":0.263,"p_room":0.28,"age_days":70,"expected_fill_days":30,"reasons":["conf:20","agency","velocity","win:tail","crowd:"],"computed_at":"2026-10-29T05:49:05Z"},"pay":{"stated_usd_annual":250000,"is_top_pay":true},"html_url":"https://alion.io/job/techchain-talent-senior-gpu-infrastructure-engineer","json_url":"https://alion.io/job/techchain-talent-senior-gpu-infrastructure-engineer.json","meta":{"generated_at":"2026-10-30T01:57:03Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2570,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4476923},"rest":"https://alion.io/mcp/rest/get_company?id=4476923"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftechchain-talent-senior-gpu-infrastructure-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftechchain-talent-senior-gpu-infrastructure-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftechchain-talent-senior-gpu-infrastructure-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/techchain-talent-senior-gpu-infrastructure-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftechchain-talent-senior-gpu-infrastructure-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3307714}},{"tool":"search_jobs","arguments":{"company":"techchaintalent.xyz","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3307714},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}