{"id":95715,"url":"https://alion.io/job/together-senior-software-engineer-observability","title":"Senior Software Engineer, Observability","company":{"id":36054,"name":"Together AI","domain":"together.ai","url":"https://alion.io/company/together","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"A","score":92,"open_postings":71,"ghost_share":0,"stale_share":0.31,"repost_share":0,"time_to_fill_p50_days":55,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":200000,"max":280000,"currency":"USD","period":"year","gross":null,"usd_annual":280000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Anomaly Detection","optional":false},{"name":"Ansible","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Chaos Engineering","optional":false},{"name":"CI/CD","optional":false},{"name":"ClickHouse","optional":false},{"name":"Cursor","optional":false},{"name":"Docker","optional":false},{"name":"ElevenLabs","optional":false},{"name":"Fine-tuning","optional":false},{"name":"GCP","optional":false},{"name":"GitOps","optional":false},{"name":"Grafana","optional":false},{"name":"Helm","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Pre-training","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"Redis","optional":false},{"name":"Reinforcement Learning","optional":false},{"name":"Service Mesh","optional":false},{"name":"Terraform","optional":false},{"name":"Time Series Forecasting","optional":false},{"name":"Together AI","optional":false}],"status":"live","first_seen_at":"2025-11-08T17:19:30Z","employer_posted_date":"2026-09-23","last_verified_at":"2026-10-17T09:57:06Z","board_verified":true,"closed_at":null,"days_open":342,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":342},"description":"About the Role\nTogether AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.\nThe AI Infrastructure team at Together AI is at the forefront of building and scaling the foundational systems that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining robust distributed storage solutions, ensuring seamless data access and management. They are also responsible for developing comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively identifying and resolving issues.\nResponsibilities\nDesign and implement a scalable observability platform (metrics, logs, traces) using tools like Prometheus, Grafana, ClickHouse, ClickStack, and OpenTelemetry, including telemetry data pipelines and log aggregation workflows.\nDevelop automated monitoring, alerting, and anomaly detection systems, including SLIs/SLOs, runbooks, and predictive analytics for critical services.\nBuild and deploy custom observability tools and infrastructure-as-code using Go, Python, Terraform, Ansible, and Helm.\nCollaborate with engineering teams to enhance distributed tracing and application monitoring, and lead incident response with post-mortem analysis.\nDefine observability best practices.\nRequirements\nExpertise in observability platforms (Prometheus, Grafana, ClickStack, OpenTelemetry) and cloud-native monitoring services (AWS, GCP, Azure).\nStrong programming skills in Go, Python, or similar languages, with proficiency in infrastructure-as-code tools (Terraform, Ansible, Helm).\nExperience designing, operating, and scaling large-scale distributed systems and pipelines for high-volume data ingestion and real-time querying.\nDeep understanding of containerization (Docker) and orchestration (Kubernetes).\nKnowledge of microservices architecture, service mesh technologies, CI/CD pipelines, and GitOps workflows.\nExpertise in managing databases (PostgreSQL, MongoDB, Redis) and time-series databases with high-cardinality data.\nPreferred\nExperience monitoring AI/ML infrastructure, GPU clusters, and custom metrics for model performance and training pipelines.\nBackground in high-frequency, low-latency systems monitoring, chaos engineering, and reliability testing.\nContributions to open-source observability projects.\nFamiliarity with security monitoring and compliance frameworks.\nAbout Together AI\nTogether AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.\nCompensation\nWe offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $200,000 - $280,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.\nEqual Opportunity\nTogether AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.\nPlease see our privacy policy at https://www.together.ai/privacy","description_format":"text","description_chars":3822,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity","Health insurance"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Cloud Platforms (IaaS & PaaS)","Foundation Models","AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2025-11-08T17:19:30Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 48 · green card filings: 1","filings_12m":48,"filings_prev_12m":22,"green_card_filings_12m":1,"median_offered_wage_usd":207398,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":33}],"liveness":{"score":12,"band":"cold","label":"Long shot","p_open":1,"p_active":0.444,"p_room":0.28,"age_days":342,"expected_fill_days":55,"reasons":["conf:3","velocity","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":280000,"is_top_pay":true},"html_url":"https://alion.io/job/together-senior-software-engineer-observability","json_url":"https://alion.io/job/together-senior-software-engineer-observability.json","meta":{"generated_at":"2026-10-17T12:31:15Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":16559,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":36054},"rest":"https://alion.io/mcp/rest/get_company?id=36054"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftogether-senior-software-engineer-observability"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftogether-senior-software-engineer-observability"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftogether-senior-software-engineer-observability"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/together-senior-software-engineer-observability\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftogether-senior-software-engineer-observability"}]}