{"id":52981,"url":"https://alion.io/job/anyscale-software-engineer-infrastructure","title":"Software Engineer, Infrastructure","company":{"id":12971,"name":"Anyscale","domain":"anyscale.com","url":"https://alion.io/company/anyscale","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Backend","role_family":"Backend","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":200000,"max":240000,"currency":"USD","period":"year","gross":null,"usd_annual":240000},"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Anyscale","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CoreWeave","optional":false},{"name":"GCP","optional":false},{"name":"Go","optional":false},{"name":"Grafana","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"Machine Learning","optional":false},{"name":"OpenAI","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"Ray","optional":false},{"name":"TPU","optional":false}],"status":"live","first_seen_at":"2026-07-10T18:05:49Z","employer_posted_date":"2026-08-19","last_verified_at":"2026-10-16T22:48:07Z","board_verified":true,"closed_at":null,"days_open":98,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":98},"description":"About Anyscale:\nAt Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We're commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.\nWith Anyscale, we're building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.\nProud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.\nAbout the role\nAnyscale is looking for a Software Engineer to join the Platform and Infrastructure team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. As part of the team, we build the scalable, secure, and robust backbone that enables this vision, ensuring that our \"infinite laptop\" vision scales to meet the most demanding distributed AI workloads in the world.\nOur team is responsible for both the control plane, which orchestrates cluster management, scheduling, and user access, and the data plane, which ensures high-performance execution of distributed workloads.\nWe are seeking a talented Software Engineer with a strong background in control plane and data plane development, along with expertise in Kubernetes, container orchestration, and cloud-native infrastructure. You will play a crucial role in designing, implementing, and optimizing the critical infrastructure that powers Anyscale's cloud platform.\nYou will have the opportunity to work on open-source Ray, contribute to our infinite laptop proprietary product, and develop seamless integration between the two, while also delivering high-impact features for our customers.\nA snapshot of projects you may work on\nDesign, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments, supporting both VM-based and Kubernetes-based deployments\n\nOptimize control plane components for large-scale, distributed AI/ML workloads\n\nBuild intelligent scheduling and resource management systems for heterogeneous compute clusters\n\nDevelop features to enhance the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads\n\nSupport and optimize accelerator integration (e.g., GPUs, TPUs).\n\nHandle container image management and dependency resolution for distributed workloads\n\nParticipate in code reviews, design and architecture discussions\n\nProvide on-call support, working closely with customer and field teams to troubleshoot infrastructure issues\n\nCollaborate with leading distributed systems and machine learning experts to push the boundaries of AI infrastructure\n\nWe'd love to hear from you if have\nBachelor's degree in Computer Science, Engineering, or equivalent practical experience\n\n3+ years of experience writing high-quality production code\n\nHands-on experience in building and maintaining highly available, scalable, and performant distributed system\n\nExpertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments\n\nDeep understanding of networking, security, and authentication mechanisms in cloud environment\n\nFamiliarity with observability stacks (Prometheus, Grafana etc)\n\nProficiency in Go and Python\n\nKnowledge of low-level operating system foundations (Linux kernel, file systems, containers)\n\nWhy Anyscale\nWe're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms\n\nOur tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise\n\nWe're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date\n\nRecent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments\n\nCompetitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)\n\nWe offer flexible time off, paid parental leave, and mental health support\n\nAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.\nAnyscale Inc. is an E-Verify company and you may review theNotice of E-Verify Participationand the Right to Work posters in English and Spanish","description_format":"text","description_chars":4698,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity","Flexible time off","Parental leave"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["MLOps","AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-07-10T18:05:49Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 19 · green card filings: 4","filings_12m":19,"filings_prev_12m":19,"green_card_filings_12m":4,"median_offered_wage_usd":192717,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":13}],"liveness":{"score":29,"band":"fade","label":"Fading","p_open":1,"p_active":0.649,"p_room":0.44,"age_days":97,"expected_fill_days":68,"reasons":["conf:0","velocity","win:tail","crowd:"],"computed_at":"2026-10-16T05:45:00Z"},"pay":{"stated_usd_annual":240000,"is_top_pay":true},"html_url":"https://alion.io/job/anyscale-software-engineer-infrastructure","json_url":"https://alion.io/job/anyscale-software-engineer-infrastructure.json","meta":{"generated_at":"2026-10-16T23:59:35Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6236,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":12971},"rest":"https://alion.io/mcp/rest/get_company?id=12971"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fanyscale-software-engineer-infrastructure"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fanyscale-software-engineer-infrastructure"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fanyscale-software-engineer-infrastructure"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/anyscale-software-engineer-infrastructure\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fanyscale-software-engineer-infrastructure"}]}