{"id":43431,"url":"https://alion.io/job/perplexity-ai-member-of-technical-staff-software-engineer-gpu-cluster-infrastructure","title":"Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)","company":{"id":3,"name":"Perplexity AI","domain":"perplexity.ai","url":"https://alion.io/company/perplexity","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":81,"open_postings":35,"ghost_share":0,"stale_share":0.771,"repost_share":0,"time_to_fill_p50_days":52,"computed_at":"2026-10-30T05:48:23Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States","Toronto, Canada","Seattle, United States","New York, United States"],"countries":["US","CA"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":250000,"max":485000,"currency":"USD","period":"year","gross":null,"usd_annual":485000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"C++","optional":false},{"name":"CoreWeave","optional":false},{"name":"CUDA","optional":false},{"name":"GCP","optional":false},{"name":"Grafana","optional":false},{"name":"HPC","optional":false},{"name":"InfiniBand","optional":false},{"name":"kubectl","optional":false},{"name":"Kubernetes","optional":false},{"name":"Perplexity","optional":false},{"name":"Prometheus","optional":false},{"name":"Rust","optional":false},{"name":"SGLang","optional":false},{"name":"SLURM","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"Weights & Biases","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-08-05T00:06:48Z","employer_posted_date":"2026-10-28","last_verified_at":"2026-10-30T11:36:46Z","board_verified":true,"closed_at":null,"days_open":86,"trust":{"level":"ok","repost_count":1,"flags":[],"days_open":85},"description":"Perplexity serves hundreds of millions of queries a month, and every one of them fans out into multiple AI inference requests running in real time. Behind that sits a large GPU fleet spread across several cloud providers. Today, our inference engineers and researchers build models while also managing networking, securing capacity, and operating the underlying GPU clusters, responsibilities we want a dedicated platform team to own. Your job is to take ownership of that infrastructure and hide its complexity behind a unified, self-serve platform for running training and inference workloads.\nResponsibilities\nBuild a self-serve compute platform. Design and own the systems that let inference engineers and researchers launch training jobs and operate inference services without managing GPU provisioning, cluster configuration, or provider-specific infrastructure.\n\nOperate the GPU fleet. Own provisioning, lifecycle management, reliability, and capacity integration across providers, giving teams a consistent way to use compute regardless of where it runs.\n\nSolve for GPU scarcity. Build the scheduling and placement logic that finds available capacity across providers, packs it efficiently, and gets the right workload onto the right hardware under real constraints.\n\nSupport two very different workloads. Keep long-running distributed training jobs healthy while simultaneously guaranteeing the availability and latency of production inference services on the same fleet.\n\nOwn the Kubernetes for GPU orchestration. Write the operators and CRDs, and manage many clusters across providers so the platform behaves the same everywhere we run.\n\nMake failure boring. Build the fault tolerance, autoscaling, and observability that keep the fleet utilized and let workloads survive node loss, provider hiccups, and capacity shifts without human intervention.\n\nSet technical direction across teams. Partner with inference and cloud infrastructure engineers to turn operational constraints into a coherent platform architecture and roadmap.\n\nQualifications\nWe expect you to have real depth in most of these:\nDeep Kubernetes experience - custom operators, CRDs, and multi-cluster federation, not just running kubectl apply.\n\nYou've managed GPU clusters at scale: NVIDIA hardware, CUDA, and the networking that makes them fast (InfiniBand or RoCE).\n\nYou've orchestrated compute across multiple clouds (CoreWeave, AWS, GCP, or similar) and understand how different each one really is.\n\nStrong distributed systems fundamentals: scheduling, resource allocation, and fault tolerance under load.\n\nYou write infrastructure and systems-level code in Go, Rust or C++.\n\nYou've supported both long-running training jobs and high-availability inference services, and you know why they pull infrastructure in opposite directions.\n\nYou own problems end-to-end and do well when the path forward isn't laid out for you.\n\nAdditional experience we value\nInference serving stacks: vLLM, SGLang, or TensorRT-LLM.\n\nSlurm or other HPC schedulers.\n\nGPU kernel work in CUDA or Triton - not required, but notable.\n\nHigh-speed interconnects: InfiniBand, RoCE, or RDMA in production.\n\nObservability for ML workloads: Prometheus, Grafana, or Weights & Biases.","description_format":"text","description_chars":3229,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","Search Engines","Foundation Models","AI Search"],"lifecycle":[{"event":"open","at":"2026-08-05T00:06:48Z"},{"event":"close","at":"2026-08-17T18:16:11Z"},{"event":"reopen","at":"2026-10-28T06:53:54Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 18","filings_12m":18,"filings_prev_12m":10,"green_card_filings_12m":0,"median_offered_wage_usd":212500,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":14}],"liveness":{"score":19,"band":"cold","label":"Long shot","p_open":1,"p_active":0.541,"p_room":0.36,"age_days":86,"expected_fill_days":52,"reasons":["conf:2","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-30T05:48:23Z"},"pay":{"stated_usd_annual":485000,"is_top_pay":true},"html_url":"https://alion.io/job/perplexity-ai-member-of-technical-staff-software-engineer-gpu-cluster-infrastructure","json_url":"https://alion.io/job/perplexity-ai-member-of-technical-staff-software-engineer-gpu-cluster-infrastructure.json","meta":{"generated_at":"2026-10-30T14:40:24Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2269,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3},"rest":"https://alion.io/mcp/rest/get_company?id=3"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fperplexity-ai-member-of-technical-staff-software-engineer-gpu-cluster-infrastructure"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fperplexity-ai-member-of-technical-staff-software-engineer-gpu-cluster-infrastructure"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fperplexity-ai-member-of-technical-staff-software-engineer-gpu-cluster-infrastructure"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/perplexity-ai-member-of-technical-staff-software-engineer-gpu-cluster-infrastructure\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fperplexity-ai-member-of-technical-staff-software-engineer-gpu-cluster-infrastructure"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":43431}},{"tool":"search_jobs","arguments":{"company":"perplexity.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":43431},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}