Microsoft Logo

Microsoft

Senior AI Hardware Product Manager

Reposted 17 Days Ago
Be an Early Applicant
In-Office
Austin, TX
120K-261K Annually
Senior level
In-Office
Austin, TX
120K-261K Annually
Senior level
Leads product definition and development for next-generation AI hardware supporting Azure training and inference workloads. Identifies customer needs, market opportunities, and competitive gaps; translates them into product requirements, roadmaps, investment proposals, and hardware strategies. Drives technical programs from concept through execution while collaborating with architecture, engineering, business teams, customers, and senior leadership. Requires expertise in AI systems, GPU architecture, networking, data centers, reliability, and cloud infrastructure.
The summary above was generated by AI
Overview

Do you want to be at the forefront of innovating the latest hardware designs to propel Microsoft’s cloud growth? Are you seeking a unique career opportunity that combines technical capabilities, cross-team collaboration, with business insight and strategy?  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to achieve our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

Join the Systems Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s “Intelligent Cloud” mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live.    

We are seeking a Senior AI Hardware Product Manager to join the AI Hardware Products Planning team to drive definition of the next generation hardware used in Azure to train and infer on the best-in-class AI models for a plethora of use cases.  This role will help define the future of Supercomputing systems at a planet scale. 


Responsibilities

Responsibilities: 

  • Collaborate with customers and partner organizations to define future generations of Artificial Intelligence (AI) Hardware for Azure at Microsoft.  

  • Identify and prioritize customer needs, market opportunities, and competitive gaps, and translate them into clear and actionable product requirements and specifications.  

  • Drive executive decision making for new investments, including competitive analysis, program goals and business requirements, architectural concepts, risk management strategies, financial analysis, schedule and hardware strategy.  

  • Lead technical programs from concept to execution, collaborating with architecture, engineering and business teams to develop and drive end-to-end product development  

  • Develop and maintain a high level of technical proficiency in AI workload requirements, AI technology landscape and AI Industry roadmaps. 

  • Engage with senior leadership, highlighting risks across functional teams and providing recommendations to support product level decisions.  

  • Operate effectively in ambiguity. Apply process where it creates value, and design process where it’s needed. Recognize the situations where each approach is most appropriate.


Qualifications

Required/Minimum Qualifications 

  • Bachelor's Degree AND 5+ years experience in product/service/program management or software development OR equivalent experience.

Other Requirements 

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Preferred Skills:

  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience.
    2+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework).
    4+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn).
    4+ years experience disrupting a market for a product, feature, or experience (e.g., competitive disruption, taking the place of an established competing product).
  • 2+ years of experience working on AI systems as an architect or a product manager 
  • Familiar with AI systems roadmaps from Nviida, AMD, Microsoft and AI infrastructure challenges 

  • Strong understanding of several of the below areas: GPU Architecture, Scale Up and Scale out networking, Data Center Specifications, Model Architecture and System Reliability 

  • 3+ years of technical product management experience, including products within datacenter Hardware systems and/or Cloud infrastructure.  

  • 3+ years experience creating product roadmap(s) from conception to launch, driving end-to-end program execution, defining product go-to-market strategy, and leading program direction discussions.  
     


Product Management IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar Jobs

A Minute Ago
Remote or Hybrid
United States
129K-198K Annually
Senior level
129K-198K Annually
Senior level
Beauty • Robotics • Design • Appliances • Manufacturing
Serves as the strategic HR partner for Direct-to-Consumer and Sales teams. Responsibilities include workforce planning, organizational design, talent management, hiring, onboarding, training, performance management, employee engagement, succession planning, change management, and HR metrics analysis. The role advises senior leaders, partners with HR Centers of Excellence, supports organizational transformation, and promotes an inclusive, high-performance culture.
Top Skills: Ai ToolsClaude
13 Minutes Ago
Remote or Hybrid
United States
Expert/Leader
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Software • Biotech
Own strategic client relationships across onboarding, adoption, renewals, and expansion. Lead business reviews, value realization plans, account strategies, and cross-functional delivery. Use usage and health metrics to improve retention, identify expansion opportunities, and build business cases. Partner with Sales on upsell opportunities and forecasting while developing executive-level client advocates and feeding customer insights into Product and leadership. Travel 30–40% across the USA.
Top Skills: BioinformaticsGenomicsNgs WorkflowsSophia Ddm
An Hour Ago
Remote or Hybrid
United States
17-25 Hourly
Entry level
17-25 Hourly
Entry level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Processes, codes, audits, and indexes service-provider invoices for fleet billing operations. Responsibilities include resolving invoice discrepancies, verifying approval limits, completing WACC requirements, processing rebills, performing VMRS coding and costing, managing purchase-order inquiries, and responding to overflow calls. The role requires accurate high-volume data entry, attention to detail, and communication with service providers and internal teams.
Top Skills: TmcareVmrs

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account