Software Engineering Manager, Google Cloud TPU

About the job

Like Google's own ambitions, the work of a Software Engineer goes beyond just Search. Software Engineering Managers have not only the technical expertise to take on and provide technical leadership to major projects, but also manage a team of Engineers. You not only optimize your own code but make sure Engineers are able to optimize theirs. As a Software Engineering Manager you manage your project goals, contribute to product strategy and help develop your team. Teams work all across the company, in areas such as information retrieval, artificial intelligence, natural language processing, distributed computing, large-scale system design, networking, security, data compression, user interface design; the list goes on and is growing every day. Operating with scale and speed, our exceptional software engineers are just getting started -- and as a manager, you guide the way.

With technical and leadership expertise, you manage engineers across multiple teams and locations, a large product budget and oversee the deployment of large-scale projects across multiple sites internationally.

This role is a unique leadership opportunity to manage an engineering team dedicated to critical Google Cloud TPU software services, which empower Google’s global AI customers. As a Software Engineering Manager, you will lead the architecture and execution of large-scale ML infrastructure, requiring a deep understanding of Large Language Model (LLM) operations from chip level to fleet level. You will be responsible for solving complex ML infrastructure issues, driving technical strategy, fostering a high-performance team culture, and working directly with customers to ensure successful landings.Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

Responsibilities

• Build, mentor, and inspire a software engineering team. Cultivate a culture of high performance, innovation, psychological safety, and deliberate career development where every engineer grows.
• Shape the technical strategy and multi-year product roadmap, seamlessly aligning team objectives with the broader Google Cloud goal and our pioneering AI-first initiative.
• Drive engineering velocity across the entire project lifecycle, ensuring the predictable, high-quality delivery of scalable features.
• Drive deep technical decision-making for our infrastructure components, fostering a culture of code reviews, scalable architecture design, AI-first and data-driven development, while mentoring engineers.
• Advocate an unyielding customer-first mindset, establishing standards for service reliability, performance, and operational excellence, transforming complex customer requirements into technical realities, and maintaining a healthy production.

Qualifications

Minimum qualifications:

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development, focusing on building distributed cloud services.
• 3 years of experience in an engineering management role, guiding software engineering teams, including hiring or team development.
• 2 years of experience in LLM training or inference, including performance optimizations, distributed execution, GPU or TPU acceleration, or PyTorch, JAX, or TensorFlow programming.

Preferred qualifications:

• Master's degree or PhD in Computer Science or related technical field.
• 3 years of experience working in a complex, matrixed organization.