{"id":750729,"url":"https://alion.io/job/sciforium-gpu-cluster-engineer-networking","title":"GPU Cluster Engineer, Networking","company":{"id":716759,"name":"Sciforium","domain":"sciforium.ai","url":"https://alion.io/company/sciforium-2","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":84,"open_postings":6,"ghost_share":0,"stale_share":0.833,"repost_share":0,"time_to_fill_p50_days":11,"computed_at":"2026-11-06T05:58:05Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":150000,"max":180000,"currency":"USD","period":"year","gross":null,"usd_annual":180000},"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Ansible","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"BGP","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Grafana","optional":false},{"name":"HPC","optional":false},{"name":"InfiniBand","optional":false},{"name":"Multimodal AI","optional":false},{"name":"NCCL","optional":false},{"name":"NVLink","optional":false},{"name":"OSPF","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"VLAN","optional":false},{"name":"VPN","optional":false},{"name":"Kubernetes","optional":true}],"status":"live","first_seen_at":"2026-08-06T22:28:43Z","employer_posted_date":"2026-08-06","last_verified_at":"2026-11-06T11:58:42Z","board_verified":true,"closed_at":null,"days_open":91,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":91},"description":"Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.\nRole Overview\nWe are looking for a Senior Network Engineer to own the complete networking stack of our GPU clusters - from the RDMA compute fabric to the data center perimeter to cross-site and cloud connectivity. You will design the network architecture for new large-scale clusters, lead its bring-up, and operate it in production. This role owns everything from the NIC port outward: backend InfiniBand/RoCE fabrics, frontend and storage networks, out-of-band management, firewalls and edge security, and the links that connect our clusters to each other and to the cloud. You will work alongside our Hardware Operations team (physical install) and Systems & Platform team (host software stack) to deliver a fabric that never becomes the bottleneck.\nKey Responsibilities\nFabric Architecture & Cluster Network Design\nGreenfield Design: Architect the full network for new GPU clusters - compute/backend fabric, storage network, in-band frontend, out-of-band management (BMC/IPMI), and perimeter - including topology (fat-tree/Clos, rail-optimized), oversubscription analysis, and growth planning.\n\nRDMA Fabric Selection: Design and justify InfiniBand (NDR/XDR, Quantum-class) vs. lossless Ethernet/RoCE v2 (Spectrum-X, Tomahawk-class) fabrics for training and inference workloads, including scale-up domains (NVLink/NVSwitch, NVL72-class rack systems).\n\nHardware & Physical Plant: Specify switches, NICs (ConnectX/BlueField), optics (400/800G OSFP/QSFP-DD), and cabling plans; produce the port maps and cable schedules Hardware Operations executes.\n\nLogical Design: Own IP addressing plans, VLAN/VRF segmentation, and BGP/EVPN-VXLAN underlay-overlay architecture.\n\nRDMA & Performance Engineering\nLossless Ethernet: Configure and validate RoCE v2 at scale - PFC, ECN/DCQCN congestion control, QoS/DSCP classification, buffer tuning - and prove no-drop behavior under full training load.\n\nInfiniBand Operations: Run subnet managers (UFM/OpenSM), adaptive routing, SHARP in-network aggregation, partition keys, and virtual-lane QoS.\n\nFabric Validation: Benchmark and sign off new fabrics with perftest/ib_write_bw and nccl-tests/rccl-tests; verify GPUDirect RDMA paths and topology-aware placement with the Systems & Platform team.\n\nPerformance Debugging: Root-cause fabric-level issues - congestion trees, ECMP polarization, link flaps, degraded optics, straggler nodes caused by the network.\n\nProduction Network Operations & Security\nRouting & Switching: Configure and maintain BGP, OSPF, ECMP, and EVPN-VXLAN across multi-vendor NOSes (Arista EOS, NVIDIA Cumulus, Cisco NX-OS, Junos, SONiC).\n\nPerimeter & Security: Own firewalls, VPNs (WireGuard/IPsec), NAT, ACLs, and network segmentation between production, research, and management domains.\n\nNetwork as Code: Generate configs from a source of truth (NetBox), deploy via Ansible/Nornir/NAPALM with Git-reviewed, CI-validated changes and zero-touch provisioning for new switches.\n\nTelemetry: Build fabric observability - streaming telemetry/gNMI, sFlow, optics DOM, buffer/drop counters - into Prometheus/Grafana with actionable alerting.\n\nLifecycle & On-Call: Run switch/NIC firmware upgrade campaigns with minimal workload disruption, and serve as escalation point for network incidents.\n\nCross-Cluster & Cloud Connectivity\nInter-Site Links: Design and operate dark fiber and DWDM capacity between sites, including latency budgeting and carrier/IX peering.\n\nHybrid Cloud: Architect AWS Direct Connect / Azure ExpressRoute / GCP Interconnect links, VPC and Transit Gateway designs, and VPN failover paths.\n\nData Movement: Engineer WAN QoS and traffic paths for cross-cluster replication, dataset transfer, and checkpoint traffic.\n\nQualifications\nMust-Haves:\n7+ years designing and operating production data center networks, including at least one large-scale HPC/AI cluster fabric (InfiniBand or RoCE v2) you designed or ran.\n\nExpert-level routing and switching: BGP (including EVPN-VXLAN), OSPF, ECMP, VRF segmentation, across at least two major vendor platforms.\n\nDeep RDMA expertise: lossless RoCE v2 tuning (PFC/ECN/DCQCN) and/or InfiniBand fabric management (subnet managers, adaptive routing, SHARP).\n\nHands-on experience with 100-800G optics, high-radix switching, and Clos/rail-optimized topologies.\n\nProduction network security experience: enterprise firewalls, site-to-site and remote-access VPNs, segmentation design.\n\nNetwork automation proficiency: Python plus Ansible (or Nornir/NAPALM), with Git-based configuration workflows.\n\nWorking knowledge of the host-side RDMA stack (MOFED/DOCA, NIC tuning, GPUDirect) and how NCCL/RCCL collectives map onto physical fabric.\n\nCloud networking experience: VPC design and dedicated interconnects (Direct Connect/ExpressRoute class).\n\nNice-to-Haves:\nDark fiber / DWDM procurement and operations experience.\n\nBlueField DPU or SmartNIC deployments.\n\nExperience supporting distributed training at 1,000+ GPU scale, or multi-cluster/cross-site training.\n\nKubernetes networking for GPU serving (CNI, SR-IOV, Multus).\n\nExpert certifications (CCIE/JNCIE) or NVIDIA networking certification (InfiniBand/Spectrum-X/UFM).\n\nBenefits include\nMedical, dental, and vision insurance\n\n401k plan\n\nDaily lunch, snacks, and beverages\n\nFlexible time off\n\nCompetitive salary and equity\n\nEqual opportunity\nSciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.","description_format":"text","description_chars":5878,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["401k plan","Equity","Flexible time off","Vision insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-09-11T15:41:32Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 5","filings_12m":5,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":175500,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":5}],"liveness":{"score":9,"band":"cold","label":"Long shot","p_open":1,"p_active":0.333,"p_room":0.28,"age_days":91,"expected_fill_days":11,"reasons":["conf:2","win:tail","crowd:"],"computed_at":"2026-11-06T05:58:05Z"},"pay":{"stated_usd_annual":180000,"is_top_pay":false},"html_url":"https://alion.io/job/sciforium-gpu-cluster-engineer-networking","json_url":"https://alion.io/job/sciforium-gpu-cluster-engineer-networking.json","meta":{"generated_at":"2026-11-06T14:37:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":27189,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":716759},"rest":"https://alion.io/mcp/rest/get_company?id=716759"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsciforium-gpu-cluster-engineer-networking"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsciforium-gpu-cluster-engineer-networking"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsciforium-gpu-cluster-engineer-networking"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sciforium-gpu-cluster-engineer-networking\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsciforium-gpu-cluster-engineer-networking"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":750729}},{"tool":"search_jobs","arguments":{"company":"sciforium.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":750729},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}