Arm Logo

Arm

Product Manager, AI Infrastructure

Posted Yesterday
Be an Early Applicant
In-Office
San Jose, CA
263K-355K Annually
Senior level
In-Office
San Jose, CA
263K-355K Annually
Senior level
The Product Manager for AI Infrastructure will define and manage AI compute products, ensuring hardware and software integration for production platforms, while resolving system integration challenges and driving product decisions.
The summary above was generated by AI
Product Management, Datacenter AI / ML
The future isn't just about technology - it's about people and the limitless possibilities AI can unlock for us all. As AI transforms how we live, work, and connect, Arm is at its very foundation, powering the innovations that are shaping our world.
Arm's Cloud AI team is building next-generation platforms to power the AI workloads of tomorrow and we're growing our product management organization to help guide this journey. This is an opportunity to help shape the product direction of a major strategic investment while also helping build a new team and culture.
As a member of the team, you'll own the integration of hardware, software, and services into a production AI compute platform that supports critical customer workloads. You'll be responsible for defining the end-to-end product, identifying mismatches across system components, and driving decisions required to deliver a production system. We're looking for deeply technical, independent product leaders who thrive in ambiguity and can move seamlessly between product definition, system-level problem solving, technical analysis, and partner & customer engagement.
Responsibilities:
  • Define the AI compute product, including supported workloads, system capabilities, and constraints
  • Own system integration for AI compute platforms, ensuring hardware, software, and services combine into a production-ready system
  • Identify and resolve gaps across hardware, software, and deployment plans (e.g.: performance, system behavior, capacity)
  • Drive multi-functional decisions when system components or timelines don't align
  • Translate customer, system, and technical constraints into clear product tradeoffs and priorities for engineering teams

Required Skills and Experience:
  • Proven experience delivering complex, multi-component compute systems (including hardware & software)
  • Strong systems thinking - ability to reason across layer boundaries and understand end-to-end system behavior
  • Proven ability to drive ambiguous, multi-functional problems to resolution, including making product tradeoffs across competing constraints
  • Solid understanding of datacenter AI infrastructure (compute, memory, networking, software & services)
  • 6+ years of experience in product management, systems or solution engineering, or related product leadership role
  • Bachelor's degree or equivalent experience in Electrical or Computer Engineering

"Nice-to-Have" Skills and Experience:
  • Experience with data center compute deployment at scale, including service readiness, fleet rollout, or capacity planning for AI compute
  • Experience working with ML accelerators
  • Hands-on experience building or running GenAI workloads at scale
  • Experience with real-world hardware-software codesign (e.g., accelerators, distributed systems, or large-scale cloud services)
  • Masters or PhD degree in Electrical or Computer Engineering

In Return:
Help shape products that will define the future of AI compute and define what world-class product management looks like in AI infrastructure. You'll grow as a leader and technical voice - and help ensure Arm delivers the products our customers need today and the platforms that will power tomorrow.
Accommodations at Arm
At Arm, we want our people to Do Great Things. If you need support or an accommodation to Be Your Brilliant Self during the recruitment process, please email [email protected]. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Equal Opportunities at Arm
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Hybrid Working at Arm
Arm's hybrid approach to working is centered around flexibility, where we split our time between the office and other locations to get our work done. Within that framework, we empower groups and teams to determine their own particular hybrid working pattern, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Salary Range:
$262,700-$355,400 per year
We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.
Accommodations at Arm
At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [email protected] . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working at Arm
Arm's approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities at Arm
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Top Skills

Ai Infrastructure
Datacenter Systems
Machine Learning

Similar Jobs at Arm

Yesterday
In-Office
212K-286K Annually
Senior level
212K-286K Annually
Senior level
Artificial Intelligence • Internet of Things • Semiconductor
The Product Manager for AI Infrastructure will lead performance analysis, inform product roadmaps, and drive alignment across teams for AI compute platforms.
Top Skills: Ai Compute PlatformsComputer EngineeringData Center Ai WorkloadsElectrical EngineeringMl Accelerators
15 Hours Ago
In-Office
174K-236K Annually
Senior level
174K-236K Annually
Senior level
Artificial Intelligence • Internet of Things • Semiconductor
Lead and drive licensing strategies for semiconductor IP portfolio, collaborating with teams, engaging clients, negotiating agreements, and managing contract lifecycle.
Yesterday
In-Office
177K-240K Annually
Mid level
177K-240K Annually
Mid level
Artificial Intelligence • Internet of Things • Semiconductor
Lead market studies on physical AI segments, build TAM models, maintain competitive analysis, and present recommendations to leadership.
Top Skills: ExcelPowerPoint

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account