{"id":2009444,"url":"https://alion.io/job/hippocratic-ai-staff-site-reliability-engineer","title":"Staff Site Reliability Engineer","company":{"id":4396,"name":"Hippocratic AI","domain":"hippocraticai.com","url":"https://alion.io/company/hippocratic-ai","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Welcome to the Jungle","truth_index":{"grade":"A","score":97,"open_postings":9,"ghost_share":0,"stale_share":0.333,"repost_share":0,"time_to_fill_p50_days":20,"computed_at":"2026-10-23T05:54:15Z"}},"role":"DevOps","role_family":"DevOps","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Menlo Park, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":150000,"max_usd":292000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":564},"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Datadog","optional":false},{"name":"Docker","optional":false},{"name":"GCP","optional":false},{"name":"GitLab CI","optional":false},{"name":"Grafana","optional":false},{"name":"HashiCorp Vault","optional":false},{"name":"HIPAA","optional":false},{"name":"HPC","optional":false},{"name":"KServe","optional":false},{"name":"Kubernetes","optional":false},{"name":"Python","optional":false},{"name":"Ray Serve","optional":false},{"name":"SOC 2","optional":false},{"name":"Terraform","optional":false},{"name":"Triton","optional":false},{"name":"Vault","optional":false},{"name":"Ray","optional":true}],"status":"live","first_seen_at":"2026-09-28T00:04:30Z","employer_posted_date":"2026-10-07","last_verified_at":"2026-10-24T03:20:08Z","board_verified":true,"closed_at":null,"days_open":26,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":26},"description":"Join our team as a Staff Site Reliability Engineer, where you'll take ownership of managing a large fleet of GPU-backed models. You'll design and build our GPU management and scheduling platform, implement admission control, and develop cloud orchestration systems. This is a senior role for someone with over 10 years of experience in site reliability and software engineering.\nMissions\nDesign and build the GPU management and scheduling platform, including the metrics pipeline and admission control logic.\nImplement autoscaling that adjusts the number of model replicas in response to real-time demand and utilization.\nArchitect and operate scalable, fault-tolerant, secure production systems on AWS, GCP, or Azure, and develop infrastructure automation and deployment pipelines.\nProfil recherché\n - Strong software engineering fundamentals - you build orchestration and scheduling systems in Python and/or Go, not just configure off-the-shelf tools- 10+ years of professional experience across site reliability / DevOps engineering and software engineering\n- Strong knowledge of containerization and orchestration (Docker, Kubernetes)\n- Experience with monitoring and logging stacks (ELK, Grafana, Datadog, or similar)\n- Excellent problem-solving skills and the ability to work both independently and collaboratively\n- Computer Science Degree Required from a top CS program\n- Experience designing systems that make decisions from operational metrics - collecting signals, interpreting them, and driving control loops such as autoscaling, load shedding, or admission control\n- Hands-on production experience with at least one major cloud platform (AWS, GCP, or Azure)\n- Deep experience with infrastructure automation and CI/CD (Terraform, GitLab CI/CD, or similar)\n- Familiarity with secrets management and security tooling (HashiCorp Vault, AWS KMS, Azure Key Vault)\n- Strong communication and interpersonal skills\n- Experience managing GPU fleets or scheduling workloads across heterogeneous accelerators\n- Familiarity with ML inference serving and model deployment (e.g. Triton, KServe, Ray Serve, or similar)\n- Experience implementing HIPAA and SOC 2 compliance\n- Experience with Kubernetes autoscaling internals (HPA/VPA, custom metrics, custom controllers)\n- Experience operating in an HPC environment\n- Bachelor's or Master's in Computer Science, Computer Engineering, or a related field","description_format":"text","description_chars":2397,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Conversational AI","AI Agents","Medical AI"],"lifecycle":[{"event":"open","at":"2026-10-07T12:59:16Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 36","filings_12m":36,"filings_prev_12m":6,"green_card_filings_12m":0,"median_offered_wage_usd":235278,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":10}],"liveness":{"score":41,"band":"fade","label":"Fading","p_open":1,"p_active":0.745,"p_room":0.55,"age_days":25,"expected_fill_days":20,"reasons":["conf:1","velocity","win:tail"],"computed_at":"2026-10-23T05:54:15Z"},"pay":null,"html_url":"https://alion.io/job/hippocratic-ai-staff-site-reliability-engineer","json_url":"https://alion.io/job/hippocratic-ai-staff-site-reliability-engineer.json","meta":{"generated_at":"2026-10-24T05:27:19Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7714,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-25T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4396},"rest":"https://alion.io/mcp/rest/get_company?id=4396"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhippocratic-ai-staff-site-reliability-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhippocratic-ai-staff-site-reliability-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhippocratic-ai-staff-site-reliability-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hippocratic-ai-staff-site-reliability-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhippocratic-ai-staff-site-reliability-engineer"}]}