{"id":2121735,"url":"https://alion.io/job/arm-holdings-staff-software-engineer-ai-compute-infrastructure","title":"Staff Software Engineer, AI Compute Infrastructure","company":{"id":268,"name":"Arm Holdings","domain":"arm.com","url":"https://alion.io/company/arm","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Radancy","truth_index":{"grade":"A","score":87,"open_postings":62,"ghost_share":0,"stale_share":0.516,"repost_share":0,"time_to_fill_p50_days":44,"computed_at":"2026-10-25T05:49:26Z"}},"role":"Backend","role_family":"Backend","seniority":"staff","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Seattle, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":177000,"max_usd":328000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1432},"experience_years_min":5,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon EKS","optional":false},{"name":"ArgoCD","optional":false},{"name":"AWS","optional":false},{"name":"CUDA","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Go","optional":false},{"name":"Grafana","optional":false},{"name":"Helm","optional":false},{"name":"HPC","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"NCCL","optional":false},{"name":"NVLink","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Ray","optional":false},{"name":"SGLang","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Terraform","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-09-09T00:00:00Z","employer_posted_date":"2026-09-09","last_verified_at":"2026-10-26T03:22:45Z","board_verified":true,"closed_at":null,"days_open":47,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":47},"description":"As an engineer on the AI Compute Infra team, you will design, build, and operate large-scale infrastructure for AI training, fine-tuning, evaluation, and inference. You will work across Kubernetes clusters, accelerator enablement, workload scheduling, high-performance networking, storage, and capacity management, partnering with AI researchers and engineers to improve reliability, performance, scalability, and developer productivity.\nResponsibilities:\nBuild and operate Kubernetes clusters while improving workload scheduling, topology-aware placement, capacity use, and recovery.\nEnable new CPU and GPU systems by integrating and validating drivers, networking, storage, monitoring, and health checks.\nInvestigate performance and reliability issues across applications, cloud infrastructure, clusters, and hardware, then turn findings into lasting improvements.\nPartner with AI teams to understand their workloads and automate cluster provisioning, upgrades, monitoring, and maintenance around their needs.\nNecessary Skills and Experience:\n5+ years of experience building or operating cloud, compute, HPC, or distributed infrastructure in a production environment.\nProgramming experience in Go, Python, or another systems language, with an interest in developing reliable infrastructure software.\nPractical knowledge of Kubernetes, containers, Linux, networking, and storage.\nExperience supporting GPU, accelerator, or distributed machine-learning workloads.\nAn ability to troubleshoot complex systems and communicate clearly with engineers from different technical backgrounds.\n“Preferred” Skills and Experience:\nFamiliarity with Kubernetes scheduling, operators, quotas, or resource management.\nExperience with NVIDIA technologies such as CUDA, NVLink, NVSwitch, NCCL, EFA, or DCGM.\nKnowledge of AWS EKS, Terraform, Argo CD, Helm, Prometheus, or Grafana.\nFamiliarity with frameworks such as PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM, or experience qualifying accelerators and tuning distributed workloads.\nIn Return:\nYou will join a driven group committed to developing world-class AI compute infrastructure. We provide a cooperative setting where your ideas can come to life. Your efforts will directly impact the success of our AI projects, guaranteeing smooth operations and outstanding results. Join us and help build the future of AI compute infrastructure!\nAdditional Information\nPlease note that a relocation package (including visa sponsorship support) is available for this role, for candidates who require it.\nWe are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.\nSalary Range:\n$209,100-$282,900 per yearWe value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.\nOur 10x Mindset\nAt Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Discover how the 10x mindset shapes life at Arm: https://careers.arm.com/10x-mindset\nUse of AI in Your Application\nAt Arm, we embrace the benefits AI can bring, including in recruitment. You may use AI to support your preparation, such as improving the clarity of written responses, practicing interview questions, or learning more about our industry. However, your application and interview responses must reflect your own thinking, experience, and abilities. We want to understand your authentic perspective, creativity, and approach to problem solving. As such, you may not use AI to complete assigned tasks as part of any assessments. If you plan to use AI-supported or assistive technologies as part of a reasonable adjustment, please contact  so we can support you.\nRecruitment Adjustments and Accommodations\nAt Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.\nHybrid Working\nArm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.\nEqual Opportunities\nArm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.","description_format":"text","description_chars":6612,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Hybrid work"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":true,"industries":["Processors, MCUs & AI Chips","Semiconductor IP & Chip Design Services"],"lifecycle":[{"event":"open","at":"2026-10-09T00:02:13Z"}],"visa":[],"liveness":{"score":26,"band":"fade","label":"Fading","p_open":1,"p_active":0.582,"p_room":0.44,"age_days":46,"expected_fill_days":44,"reasons":["conf:1","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-25T05:49:26Z"},"pay":null,"html_url":"https://alion.io/job/arm-holdings-staff-software-engineer-ai-compute-infrastructure","json_url":"https://alion.io/job/arm-holdings-staff-software-engineer-ai-compute-infrastructure.json","meta":{"generated_at":"2026-10-26T04:47:44Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6399,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":268},"rest":"https://alion.io/mcp/rest/get_company?id=268"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Farm-holdings-staff-software-engineer-ai-compute-infrastructure"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Farm-holdings-staff-software-engineer-ai-compute-infrastructure"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Farm-holdings-staff-software-engineer-ai-compute-infrastructure"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/arm-holdings-staff-software-engineer-ai-compute-infrastructure\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Farm-holdings-staff-software-engineer-ai-compute-infrastructure"}]}