{"id":2203946,"url":"https://alion.io/job/openrouter-site-reliability-engineer-provider-operations","title":"Site Reliability Engineer, Provider Operations","company":{"id":12361,"name":"OpenRouter","domain":"openrouter.ai","url":"https://alion.io/company/openrouter-ai","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":91,"open_postings":6,"ghost_share":0,"stale_share":0.167,"repost_share":0,"time_to_fill_p50_days":72,"computed_at":"2026-10-12T06:55:09Z"}},"role":"DevOps","role_family":"DevOps","seniority":"middle","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":130000,"max_usd":242000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":84},"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Commander.js","optional":false},{"name":"Function Calling","optional":false},{"name":"LLM","optional":false},{"name":"OpenRouter","optional":false},{"name":"Prompt Caching","optional":false},{"name":"Python","optional":false},{"name":"Quantization","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"Tool Use","optional":false},{"name":"TypeScript","optional":false},{"name":"API Gateway","optional":true},{"name":"ClickHouse","optional":true},{"name":"Cloudflare","optional":true},{"name":"GCP","optional":true},{"name":"JavaScript","optional":true},{"name":"Node JS","optional":true},{"name":"PostgreSQL","optional":true},{"name":"Vercel","optional":true}],"status":"live","first_seen_at":"2026-10-09T21:14:24Z","employer_posted_date":"2026-10-09","last_verified_at":"2026-10-12T13:03:45Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"About OpenRouter\nOpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize the best large language models across providers-without lock-in, capacity constraints, or unnecessary cost. We power the most advanced AI teams in the world by giving them the flexibility to move fast, scale confidently, and stay future-proof as models evolve.\nAs enterprise adoption of AI accelerates, OpenRouter sits at the center of how organizations operationalize LLMs across research, product, and production workloads.\nAbout the Role\nOpenRouter routes almost a billion requests and more than 20 trillion tokens a day, across 80+ providers and thousands of endpoints. Every one of those providers can degrade, rate-limit, change behavior, or go down without warning. Our customers count on us to absorb that chaos so their apps never notice.\nWe're hiring our first AI Inference SRE to own the operational health of our provider supply. You'll make sure every endpoint we route to is fast, correct, and available, and that we detect and route around problems before customers do. You'll sit on the Provider Operations team, reporting to the Provider Operations Manager.\nWhat You'll Do\nProvider health and observability. Build and own monitoring for every provider and endpoint: latency, throughput, error rates, uptime, and output correctness. Set SLOs per provider tier and alert on them.\n\nDetection and failover. Improve how quickly we detect degraded endpoints, and work with the routing team so traffic shifts away from them automatically.\n\nIncident response. Own on-call for provider incidents: triage, mitigate, communicate with providers, run postmortems, and drive follow-ups to closure.\n\nProvider accountability. Turn telemetry into scorecards and SLO reporting that providers act on, and be the technical escalation point when a provider's endpoint is misbehaving.\n\nQuality regression detection. Build continuous canaries and evals that catch silent regressions (quantization changes, broken tool calling, truncated streams, pricing or usage-reporting mismatches), not just outright downtime.\n\nAutomate the toil. Replace manual provider-ops work (disabling endpoints, capacity changes, deprecations, rate-limit tuning) with safe, auditable tooling.\n\nCapacity and launch readiness. Build tooling to load-test endpoints before big launches so day-zero traffic doesn't take them down.\n\nAbout You\n4+ years in SRE, production engineering, or infrastructure roles running high-traffic, customer-facing systems.\n\nStrong with observability tooling and practice: metrics, tracing, logs, SLOs/error budgets, alerting that is always actionable.\n\nCapable software engineer who prefers writing tools over executing runbooks. TypeScript and/or Python.\n\nExperienced with distributed systems failure modes: timeouts, retries, backpressure, partial outages, noisy neighbors.\n\nCalm, clear incident commander who communicates well with external partners under pressure.\n\nUnderstands, or is eager to learn deeply, how LLM inference is served: streaming, tool calling, prompt caching, throughput/latency tradeoffs, and how provider APIs differ.\n\nNice to Have\nExperience at an inference provider, model lab, GPU cloud, or API gateway/CDN company.\n\nExperience with our stack: TypeScript, Cloudflare Workers, Postgres, ClickHouse, GCP, Vercel.\n\nBackground in routing, load balancing, or traffic management systems.\n\nExperience with evals or synthetic monitoring for ML systems.","description_format":"text","description_chars":3500,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","AI Compute & Inference","AI Development Tools"],"lifecycle":[{"event":"open","at":"2026-10-09T22:22:35Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 1","filings_12m":1,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":177500,"route":null,"cap_exempt":false,"checked_at":"2026-10-03T21:08:04+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":0}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":2,"expected_fill_days":72,"reasons":["conf:1","velocity","win:early"],"computed_at":"2026-10-12T06:55:09Z"},"pay":null,"html_url":"https://alion.io/job/openrouter-site-reliability-engineer-provider-operations","json_url":"https://alion.io/job/openrouter-site-reliability-engineer-provider-operations.json","meta":{"generated_at":"2026-10-12T14:28:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":22797,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":12361},"rest":"https://alion.io/mcp/rest/get_company?id=12361"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fopenrouter-site-reliability-engineer-provider-operations"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fopenrouter-site-reliability-engineer-provider-operations"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fopenrouter-site-reliability-engineer-provider-operations"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/openrouter-site-reliability-engineer-provider-operations\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fopenrouter-site-reliability-engineer-provider-operations"}]}