654,929open jobs
38,112companies
91,902added this week
Browse all
Salary
$220k – $260k per year
Location
In office (New York)
Seniority
Senior · 5+ years exp
Overview
Company
Impact
Profile match
Nscale is a London-based AI infrastructure company that builds and operates GPU data centres and runs a full-stack AI cloud offering managed inference, Kubernetes and Slurm clusters, bare-metal instances and dedicated GPU capacity. Founded in 2024 by Josh Payne and Nathan Townsend, it develops sites in Norway, the UK, South Korea and North America, works with Microsoft and NVIDIA, and acquired Anyscale in July 2026 to extend its cloud platform. Its hiring spans data centre design and construction, electrical and infrastructure operations, HPC and storage engineering, networking, solutions architecture, legal, finance and marketing.

.

About Nscale

Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As an Nscaler, you'll build trust through openness and transparency, where everyone is inspired to do their best work. Collaboration is key, and we work together swiftly and respectfully, embracing adaptability and resilience in all we do.

About the role

Technical Product Managers at Nscale own the definition, delivery, and ongoing evolution of a slice of the Nscale platform. You partner closely with engineering, design, research, and go-to-market teams to translate customer problems and operational realities into shippable product outcomes. As a Senior Technical Product Manager for Fleet Operations, you own the product strategy for the day 0-2+ operational software that runs our global GPU fleet - the systems that bring capacity online, keep it healthy, and restore it fast when things go wrong. You partner daily with Fleet Software engineering teams, SRE, and Support to turn operational pain into durable product: provisioning and bringup (day 0), testing and deployment (day 1), and the full lifecycle of monitoring, incident response, repair, RMA, firmware, and decommissioning (day 2+). You operate at team scope, owning a major product area and driving multi-quarter initiatives that directly move fleet availability, utilisation, and time-to-recover. Senior Technical Product Manager, Fleet Operations 1

What you'll be doing

  •  Own the strategy and roadmap for a significant Fleet Operations product area - e.g. provisioning and bring-up, fleet health and telemetry, incident and repair workflows, firmware and lifecycle management, or capacity and inventory.
  • Lead multi-sprint, cross-functional initiatives from problem framing through rollout across live GPU clusters, working hand-in-hand with Fleet Software, SRE, data centre operations, and Support.
  • Turn operational ambiguity into product: shadow on-call rotations, ride along with support and repair workflows, and translate recurring toil into tooling, automation, and platform capabilities. 
  • Define the metrics that matter for a GPU fleet - availability, utilisation, MTTR, time-to-bring-up, hardware failure rates, support ticket deflection - and drive the roadmap against them.
  • Partner with engineering on architecture and trade-offs for systems that span bare metal, orchestration, observability, and control planes.
  • Drive incident reviews and postmortems into product commitments; close the loop so the same class of issue doesn't recur.
  • Mentor junior product managers and raise the quality bar for PRDs, reviews, and product decisions across the team. 
  • Represent Fleet Operations in planning, reviews, and leadership updates.

What you need

  • 5-8 years of product management experience in software or technology, with a track record of owning significant product areas in infrastructure, platform, or operations-facing products.
  • Strong technical fluency in large-scale systems: you can lead discussions with engineering on architecture, trade-offs, and feasibility across provisioning, orchestration, observability, and control-plane design
  • Experience building products for operators - SREs, NOC/support teams, data centre technicians, or similar - and a genuine appetite for understanding their workflows.
  • Demonstrated ability to move from an ambiguous operational problem space to shipped product outcomes that measurably improve reliability, efficiency, or time-to-recover.
  • Experience mentoring or informally leading peers. Excellent written and verbal communication; you can make complex product decisions legible to engineers, operators, and executives alike.
  • Experience with data centre networking technologies, including high-performance GPU interconnects such as InfiniBand and RoCE (RDMA over Converged Ethernet), and an understanding of how backend (east-west/compute) and frontend (north-south/storage and management) network fabrics are designed and operated at scale.
  • Familiarity with WAN, edge, and global backbone architectures - including how multi-site connectivity, peering, and traffic engineering support a globally distributed GPU fleet.
  • Experience partnering with network engineering teams on fabric health, congestion monitoring, and link-level failure workflows, ideally in environments where network performance directly impacts training or inference workloads.
    • Experience with data center networking technologies, including high-performance GPU interconnects such as InfiniBand and RoCE (RDMA over Converged Ethernet), and an understanding of how backend (east-west/compute) and frontend (north-south/storage and management) network fabrics are designed and operated at scale.
    • Familiarity with WAN, edge, and global backbone architectures - including how multi-site connectivity, peering, and traffic engineering support a globally distributed GPU fleet.
    • Experience partnering with network engineering teams on fabric health, congestion monitoring, and link-level failure workflows, ideally in environments where network performance directly impacts training or inference workloads.

Nice to haves

  • Degree in computer science, engineering, or a related field, or prior experience as an engineer or SRE.
  • Hands-on background in cloud infrastructure, bare-metal provisioning, fleet or hardware lifecycle management, observability/monitoring platforms, or incident management tooling.
  • Experience with bare-metal provisioning systems such as OpenStack Ironic (or equivalents like MAAS, Tinkerbell, or in-house provisioning stacks).
  • Experience with DCIM tools such as NetBox (or equivalents like Device42 or Nautobot) for inventory, cabling, and rack/asset management.
  • Experience with ITSM and ticketing platforms such as Jira Service Management (or equivalents like ServiceNow, Zendesk, or Freshservice) for support, incident, and RMA workflows.
  • Experience with observability and monitoring platforms such as Grafana, Prometheus, Datadog, or equivalents - ideally including defining SLOs, dashboards, and alerting for large fleets.
  • Familiarity with GPU or accelerated compute environments, data centre operations, or hyperscaler-style fleet management.
  • Experience operating in high-growth or early-stage environments where the product is being built alongside the fleet itself

Join Nscale as we build a world-class AI cloud platform. If you're excited about owning the software that keeps a global GPU fleet running - and raising the bar for the team around you - we'd love to hear from you!

At Nscale, we are committed to fostering an inclusive, diverse, and equitable workplace. We believe that a variety of perspectives enriches our work environment, and we encourage applications from candidates of all backgrounds, experiences, and abilities.  We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neurodivergent people, parents, carers, and people from lower socio-economic backgrounds.

If there’s anything we can do to accommodate your specific situation, please let us know.

The responsibilities outlined in this job description are not exhaustive and are intended to provide a general overview of the position. The employee may be required to perform additional duties, tasks, and responsibilities as assigned by management, consistent with the skills and qualifications required for the role.

The range below reflects the base salary for the position. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs. Nscale may offer a competitive benefits package including medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.

Salary Range

$220,000—$260,000 USD

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice:  Here.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
654,929 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
New York
$140k – $200k per year • In office • Full-Time • Bend
AI/ML
InfiniBand
Apply
$121k – $296k per year (Estimated) • In office • Full-Time • 8+ years exp • Bachelor's Degree • Yokneam
AI/ML
InfiniBand
DevOps
HPC
Apply
In office
AI/ML
InfiniBand
DevOps
OpenShift
Kubernetes
Ubuntu
Amazon ECS
Apply
$127k – $274k per year (Estimated) • Remote/Hybrid • Full-Time • 12+ years exp • Bellevue
Bash
AI/ML
CUDA Toolkit
CUDA
InfiniBand
DevOps
Terraform
Ansible
SLURM
Kubernetes
Platform Engineering
Configuration Management
HPC
Apply
$372k – $550k per year • Equity • Remote/Hybrid • Full-Time • 8+ years exp • Bellevue • San Francisco
Python
Databases
ClickHouse
AI/ML
InfiniBand
DevOps
Terraform
Ansible
GCP
OpenTelemetry
Datadog
Prometheus
AWS
Grafana
Configuration Management
AWS Lambda
HPC
Apply
$170k – $300k per year • In office • 7+ years exp • Houston
Apply
$140k – $240k per year • In office • 7+ years exp
DevOps
Terraform
SLURM
Kubernetes
Amazon S3
Apply
$170k – $260k per year • In office • 8+ years exp • Houston
DevOps
GCP
Azure
AWS
SLI/SLO/SLA
Apply
$160k – $210k per year • In office • 8+ years exp • Seattle
AI/ML
Edge AI
Apply
$152k – $309k per year (Estimated) • In office • 12+ years exp • Singapore
Apply
$97k – $214k per year (Estimated) • Remote • Full-Time • 5+ years exp • New York
Marketing
Salesforce
Apply
$164k – $295k per year (Estimated) • Remote/Hybrid • Full-Time • 6+ years exp • New York
AI/ML
AI Agents
LLM
Apply
$156k – $265k per year • In office • Full-Time • New York
Marketing
Salesforce
Apply
$92k – $100k per year • In office • 6+ years exp • PhD • New York
Apply
$50k – $65k per year • In office • Part-Time • High School Diploma • New York
Apply
See all jobs
This is one of many
654,929 more open roles from verified company boards, updated every day.