Staff Software Engineer - Agentic AI Compute

We are looking for experienced and motivated engineers who are up for a new challenge to be part of a team building the compute platform for AI at scale!

Job Description

Agentic AI is changing what CPU performance means in the cloud. As AI systems evolve from individual model calls towards complex, distributed workflows, performance increasingly depends on efficiently orchestrating models, data, tools and services across the whole system.

You will join a diverse, dedicated and inclusive group based in Arm's vibrant office at the heart of Manchester. Your work will help ensure the latest developments in AI take full advantage of Arm Neoverse platforms and pioneering cloud-server technologies like AGI-CPU, our CPU for next-generation AI data centers. Together with teams from across Arm, the open source community, and our partners, you will be accelerating AI and helping build the future of computing on Arm.

We work on the full stack, from applications and frameworks, to compilers, libraries, and assembly; we encourage everyone in the team to get involved in all parts. The team has a wide remit, but we are all aligned on a common goal. We trust and empower engineers with the autonomy to identify and solve problems without silos and with the support of their team mates.

Key skills

We're looking for people who are motivated to learn, we will support your growth. You don't need all of these to be successful!

• Excellent software engineering and programming skills, preferably C++ and Python
• Eager to dive into unfamiliar software stacks and codebases, debug complex issues, and identify performance opportunities
• Familiarity with Linux development environments, profiling, debugging and performance analysis
• An interest in understanding end-to-end application and system performance, from higher-level applications through runtimes and libraries to the underlying hardware
• Experience being responsible for the delivery of sophisticated technical work involving multiple contributors
• A degree in a computational or numerate subject, or equivalent experience

Nice-to-have skills and experience

We’d also be interested to hear about any experience you have in the following areas:

• Experience with ML frameworks and LLM inference, such as PyTorch, vLLM, SGLang, llama.cpp or similar
• Experience analysing and optimizing CPU performance inheterogeneous CPU + accelerator systems
• Familiarity with agentic AI frameworks and protocols
• Understanding ofCPU bottlenecks in agentic workloads
• Understanding of databases, vector search and retrieval systems
• Familiarity with containers and cloud/server infrastructure
• Familiarity with batching, scheduling, KV-cache management, collective communications and distributed AI workloads
• Practical understanding of parallel programming
• Comfortable working across abstractions in the stack, from low-level optimisation to high level operators
• Experience engaging with the open-source community and contributing to large open-source software projects
• Experience optimizing software for AArch64/Arm servers, including SIMD technologies such as Neon™, SVE and SME

Interpersonal strengths

• Strong and clear communication skills
• Able to work independently, make pragmatic decisions and navigate ambiguity and change
• People management or mentoring experience - wellbeing, performance review, supporting career development and coaching

In Return

You will receive an attractive reward package with generous stock awards. We also know that people do their best work when they feel rested and psychologically safe, so we have a progressive leave policy including generous parental leave, days of care and 4 weeks of sabbatical every 4 years. We are flexible on working hours, and allow hybrid working. We strive to provide an open and accepting environment where you are encouraged to share your ideas and opinions; which enables collective innovation and creativity, and supports your professional and personal growth.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Please note this role does not meet the eligibility requirements for sponsorship, and therefore the successful candidate must have the right to work in the UK without relying on sponsorship by Arm.

Our 10x Mindset

At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Discover how the 10x mindset shapes life at Arm: https://careers.arm.com/10x-mindset

Use of AI in Your Application

At Arm, we embrace the benefits AI can bring, including in recruitment. You may use AI to support your preparation, such as improving the clarity of written responses, practicing interview questions, or learning more about our industry. However, your application and interview responses must reflect your own thinking, experience, and abilities. We want to understand your authentic perspective, creativity, and approach to problem solving. As such, you may not use AI to complete assigned tasks as part of any assessments. If you plan to use AI-supported or assistive technologies as part of a reasonable adjustment, please contact [email protected] so we can support you.

Recruitment Adjustments and Accommodations

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [email protected]. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Hybrid Working

Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Equal Opportunities

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.