{"id":17116,"url":"https://alion.io/job/cerebras-staff-software-engineer-inference-cloud","title":"Senior Software Engineer, Inference Cloud","company":{"id":31,"name":"Cerebras Systems","domain":"cerebras.ai","url":"https://alion.io/company/cerebras-systems","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":86,"open_postings":116,"ghost_share":0.155,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":97,"computed_at":"2026-10-27T05:46:45Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Sunnyvale, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":206000,"max_usd":383000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":3667},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon EKS","optional":false},{"name":"ArgoCD","optional":false},{"name":"Cerebras","optional":false},{"name":"DNS","optional":false},{"name":"Envoy","optional":false},{"name":"Go","optional":false},{"name":"gRPC","optional":false},{"name":"Istio","optional":false},{"name":"Kubernetes","optional":false},{"name":"Kustomize","optional":false},{"name":"OpenAI","optional":false},{"name":"Service Mesh","optional":false},{"name":"Terraform","optional":false},{"name":"AWS","optional":true},{"name":"C++","optional":true}],"status":"live","first_seen_at":"2024-07-12T03:15:09Z","employer_posted_date":"2024-07-12","last_verified_at":"2026-10-27T16:59:08Z","board_verified":true,"closed_at":null,"days_open":837,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":837},"description":"Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. \nThis order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.\nCerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.\nAbout the Role\nWe’re hiring a Senior Software Engineer for our Inference Cloud team. This team owns the cloud layer behind our Inference Service, including availability, latency, reliability, and global scale.\nThis is a hands-on individual contributor role focused on building cloud services and the Kubernetes infrastructure that runs them. You’ll design and own cloud components, improve request routing and service connectivity, work with production databases, and debug issues across the stack. You’ll take projects from design through rollout and ongoing operation, partnering closely with ML, Product, and Infrastructure teams.\nResponsibilities\nKubernetes Infrastructure. Build and improve production Kubernetes environments on Amazon EKS. Own improvements to workload scheduling, autoscaling, cluster upgrades, resource utilization, network policies, and failure recovery.\n\nService Networking & Traffic Control. Develop and operate traffic management infrastructure using Envoy and Istio. Improve routing, rate limiting, connection management, timeouts, retries, and failover to keep services responsive under changing demand.\n\nDatabases. Build database-backed services and improve the reliability and performance of their data stores. Troubleshoot query performance, connection pooling, and availability issues, and strengthen backup and recovery practices.\n\nReliability & Performance. Identify bottlenecks across applications, Kubernetes, networking, and databases. Improve latency, throughput, and capacity efficiency in high-QPS systems, including during traffic spikes and partial failures.\n\nInfrastructure & Deployment Automation. Use Terraform, Argo CD, and Kustomize to automate infrastructure provisioning and application delivery. Improve deployment validation, rollback, and operational tooling.\n\nProduction Operations & Collaboration. Build actionable metrics, logs, traces, dashboards, and alerts. Investigate incidents, deliver lasting fixes, and contribute to design reviews, code reviews, and shared engineering practices.\n\nSkills & Qualifications\n5+ years of software engineering experience, including building and operating production services or cloud infrastructure.\n\nStrong Kubernetes expertise, including workload lifecycle, networking, service discovery, storage, autoscaling, and troubleshooting cluster and application failures.\n\nHands-on experience with Amazon EKS or a comparable managed Kubernetes service.\n\nExperience configuring and troubleshooting Envoy and Istio, or comparable proxy and service mesh technologies. Solid understanding of HTTP, gRPC, DNS, TLS, and mTLS.\n\nExperience developing services that use production databases, with practical knowledge of query optimization, indexing, connection management, and database reliability.\n\nStrong programming skills in Go or another backend or systems language, with the ability to write, test, and maintain production software.\n\nExperience with infrastructure as code and automated deployment workflows using Terraform, Argo CD, Kustomize, or equivalent tools.\n\nExperience diagnosing performance and reliability issues using metrics, logs, and tracing.\n\nAbility to independently deliver projects, explain technical tradeoffs, and collaborate effectively across engineering teams.\n\nPreferred Skills & Qualifications\nAWS networking experience, including VPNs, Transit Gateway (TGW), Direct Connect (DX), VPC routing, and security groups.\n\nExperience designing distributed systems, including replication, consistency, fault tolerance, and multi-region operation.\n\nProduction programming experience in C++.\n\nExperience optimizing latency, throughput, and efficiency in high-QPS systems.\n\nExperience reducing time to first token (TTFT) and tail latency is a strong plus.\n\nFamiliarity with ML inference infrastructure or model serving systems.\n\nWhy Join Cerebras\nPeople who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:\nBuild a breakthrough AI platform beyond the constraints of the GPU.\n\nPublish and open source their cutting-edge AI research.\n\nWork on one of the fastest AI supercomputers in the world.\n\nEnjoy job stability with startup vitality.\n\nOur simple, non-corporate work culture that respects individual beliefs.\n\nFind out more about what it's like to work at Cerebras here!\nApply today and become part of the forefront of groundbreaking advancements in AI!\nCerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.\nThis website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.","description_format":"text","description_chars":5884,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","Servers & Data Center Hardware","AI Compute & Inference","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2024-07-12T03:15:09Z"},{"event":"open","at":"2026-09-25T19:38:34Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 43 · green card filings: 5","filings_12m":43,"filings_prev_12m":27,"green_card_filings_12m":5,"median_offered_wage_usd":200938,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":19}],"liveness":{"score":7,"band":"cold","label":"Long shot","p_open":1,"p_active":0.238,"p_room":0.28,"age_days":837,"expected_fill_days":97,"reasons":["conf:1","velocity","ghost","win:tail","crowd:brand"],"computed_at":"2026-10-27T05:46:45Z"},"pay":null,"html_url":"https://alion.io/job/cerebras-staff-software-engineer-inference-cloud","json_url":"https://alion.io/job/cerebras-staff-software-engineer-inference-cloud.json","meta":{"generated_at":"2026-10-27T17:47:13Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7503,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-28T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":31},"rest":"https://alion.io/mcp/rest/get_company?id=31"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcerebras-staff-software-engineer-inference-cloud"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcerebras-staff-software-engineer-inference-cloud"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcerebras-staff-software-engineer-inference-cloud"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/cerebras-staff-software-engineer-inference-cloud\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcerebras-staff-software-engineer-inference-cloud"}]}