{"id":2201309,"url":"https://alion.io/job/nscale-principal-observability-platform-engineer-2","title":"Principal Observability Platform Engineer","company":{"id":48155,"name":"Nscale","domain":"nscale.com","url":"https://alion.io/company/nscale","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"A","score":92,"open_postings":23,"ghost_share":0,"stale_share":0.13,"repost_share":0,"time_to_fill_p50_days":69,"computed_at":"2026-10-10T05:45:15Z"}},"role":"DevOps","role_family":"DevOps","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":190000,"max":300000,"currency":"USD","period":"year","gross":null,"usd_annual":300000},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Ansible","optional":false},{"name":"Apache Kafka","optional":false},{"name":"ClickHouse","optional":false},{"name":"Fluent Bit","optional":false},{"name":"Grafana","optional":false},{"name":"HPC","optional":false},{"name":"Kubernetes","optional":false},{"name":"Loki","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"SLURM","optional":false},{"name":"Terraform","optional":false},{"name":"Thanos","optional":false},{"name":"Vector","optional":false},{"name":"VictoriaMetrics","optional":false}],"status":"live","first_seen_at":"2026-10-09T19:21:39Z","employer_posted_date":"2026-10-09","last_verified_at":"2026-10-12T03:29:12Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":".\nPrincipal Observability Platform Engineer - Nscale\nAbout Nscale\nNscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale simplifies AI development while enabling superior results, supporting strategic business outcomes such as cost management, rapid innovation, and environmental responsibility.\nWe thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As an Nscaler, you’ll build trust through openness and transparency while contributing to the technology that powers the future.\nAbout the Role\nAs a Principal/Staff Observability Platform Engineer, you'll own the technical direction of Nscale's observability platform: the systems that give us deep visibility into GPU clusters, AI workloads, and the infrastructure running them. You treat observability as a product and a discipline, not a tooling exercise. You'll set the architectural roadmap, raise the engineering bar across teams, and ensure our platform scales ahead of the business, not behind it.\nYou understand that complexity is a cost. Solutions that require constant babysitting don't scale, and neither does operational burden. The platforms you build should be simple to operate, easy to understand, and self-evidently correct when something goes wrong.\nThis isn't a \"maintain and operate\" role. It's a \"define, build, and lead\" role.\nWhat You'll Do\nOwn the technical strategy and architecture for observability across metrics, logs, traces, and alerting at scale.\nDrive platform decisions that have multi-year impact: tooling, data models, ingestion patterns, retention, cardinality management.\nIdentify systemic gaps before they become incidents; design platforms that make failure visible and fast to diagnose.\nPartner with SRE, infrastructure, and AI/ML teams to embed observability natively into how Nscale builds and operates.\nDefine standards and patterns that other engineers adopt, not by mandate, but because they're clearly better.\nMentor and technically grow the observability team; raise the ceiling on what the team can build and own.\nLead incident postmortems and use them to drive durable platform improvements.\nEvaluate and introduce tooling that meaningfully improves signal quality, operational efficiency, or scalability, and retire what doesn't.\nAbout You\n8+ years in SRE, infrastructure engineering, platform engineering, or observability-focused roles.\nYou've operated observability infrastructure at serious scale. You know what breaks at 10x and you design for it.\nYou have a strong bias toward simplicity. You've seen over-engineered observability stacks collapse under their own weight and you build accordingly.\nDeep hands-on experience with a significant subset of: Prometheus, Thanos, VictoriaMetrics, Grafana, Loki, Tempo, OpenTelemetry, ClickHouse, Elastic.\nStrong engineering fundamentals, proficient in Python, Go, or similar; comfortable owning complex systems end to end.\nExperience with Kubernetes at scale; familiarity with GPU infrastructure or HPC environments (Slurm) is a strong plus.\nYou can architect systems, write the code, review others' work, and explain the tradeoffs clearly, all in the same week.\nInfrastructure-as-Code is default, not optional (Terraform, Ansible, or equivalent).\nYou influence without authority. Teams want your opinion because it makes their work better.\nPreferred\nExperience with high-volume streaming pipelines for observability data (Kafka, Vector, Fluent Bit, etc.).\nBackground in AI/ML infrastructure observability: GPU utilisation, training job visibility, inference latency.\nPrior experience defining observability strategy at an organisation level.\nEqual Opportunities Statement\nWe strongly encourage applications from people of color, the LGBTQ+ community, people with disabilities, neurodivergent individuals, parents, carers, and people from lower socio-economic backgrounds.\nIf there’s anything we can do to accommodate your specific situation, please let us know.\nNote: Responsibilities outlined are not exhaustive and may evolve as business needs change.\nThe range below reflects the base salary for the position. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs. Nscale may offer a competitive benefits package including medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.\nSalary Range\n$190,000—$300,000 USD\nFor information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here.\nNscale does not accept unsolicited candidate submissions from recruitment agencies.","description_format":"text","description_chars":4898,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity","Parental leave","Retirement plans"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Centers & Colocation","AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-10-09T21:19:31Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 10","filings_12m":10,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":198500,"route":null,"cap_exempt":false,"checked_at":"2026-10-03T21:08:04+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":7}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":69,"reasons":["conf:2","velocity","win:early","comp:brand"],"computed_at":"2026-10-10T05:45:15Z"},"pay":{"stated_usd_annual":300000,"is_top_pay":true},"html_url":"https://alion.io/job/nscale-principal-observability-platform-engineer-2","json_url":"https://alion.io/job/nscale-principal-observability-platform-engineer-2.json","meta":{"generated_at":"2026-10-12T05:28:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8758,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":48155},"rest":"https://alion.io/mcp/rest/get_company?id=48155"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnscale-principal-observability-platform-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnscale-principal-observability-platform-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnscale-principal-observability-platform-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nscale-principal-observability-platform-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnscale-principal-observability-platform-engineer-2"}]}