Senior Product Manager (Compute)

Job Description:

DataRobot delivers AI that maximizes impact and minimizes business risk. Our platform and applications integrate into core business processes so teams can develop, deliver, and govern AI at scale. DataRobot empowers practitioners to deliver predictive and generative AI, and enables leaders to secure their AI assets. Organizations worldwide rely on DataRobot for AI that makes sense for their business — today and in the future. 

We are seeking a skilled and passionate Senior Product Manager for AI Compute. In this role, you will be crucial in driving the vision, strategy, and execution for the full stack of computing resources that power agentic AI at DataRobot. Your mission is to deliver a world-class distributed compute platform that enables our customers to tackle complex challenges, from large-scale model training to low-latency inference for sophisticated AI agents.

This role is pivotal in defining the future of AI infrastructure at DataRobot. You will own the roadmap for our compute offerings, ensuring they are cost-effective, performant, and equipped with the latest technologies. You will work closely with our engineering teams and strategic partners to deliver a seamless experience that abstracts away the complexity of underlying hardware and orchestration, allowing users to focus on building breakthrough AI solutions.

Key Responsibilities:

• Product Vision & Strategy: Own and articulate the vision, strategy, and product roadmap for DataRobot's core compute platform, encompassing general-purpose compute, specialized distributed compute for AI model training, and low-latency inference serving for agentic AI applications.

• Lifecycle Management: Manage the entire product life cycle from strategic planning to tactical execution, including defining requirements, setting priorities, and working with engineering to deliver new compute capabilities.

• Infrastructure & Hardware Expertise: Define and manage a portfolio of compute offerings across various architectures (e.g., NVIDIA Blackwell, AMD Zen5, ARM Neoverse) and hyperscale providers (AWS, Azure, GCP, Oracle Cloud).

• Distributed Compute Orchestration: Drive the strategy for our distributed workflow and job scheduling layer, evaluating and integrating technologies such as Covalent, Ray, Slurm, NVIDIA run:ai, Volcano, and Kueue to optimize for performance, cost, and user experience for large-scale AI workloads.

• AI Inference Optimization: Lead the product strategy for our ML inference serving technologies, incorporating cutting-edge solutions like NVIDIA Dynamo and Ray Serve to ensure low-latency, high-throughput model deployment for real-time agentic systems.

• Customer & Market Analysis: Engage deeply with internal and external customers to understand their AI workload patterns, performance bottlenecks, and future needs. Translate these insights into actionable product requirements.

• Stakeholder & Partner Management: Work closely with stakeholders across Engineering, Product, GTM, and Customer Success. Collaborate with key technology partners like NVIDIA, AMD, Intel, and major cloud providers to align roadmaps and bring new innovations to the platform.

• Future Technologies: Stay abreast of emerging trends in computing and explore the potential integration of future technologies, including quantum computing, into the DataRobot ecosystem.

Knowledge, Skills, and Abilities:

• Proven experience (5+ years) in a technical product management role, preferably with a focus on IaaS, PaaS, cloud infrastructure, or distributed compute products.

• Strong technical background with a deep understanding of compute, networking, storage, and the software that orchestrates it. You are comfortable discussing the merits of different CPU/GPU architectures, job schedulers, and distributed systems.

• Familiarity with the AI/ML landscape and the unique infrastructure requirements for large-scale training and inference workloads.

• Experience working directly with public cloud services (AWS EC2, GCP Compute Engine, Azure VMs).

• Demonstrated ability to own and drive the product lifecycle for highly technical, developer-focused products.

• Excellent communication skills, with the ability to articulate a complex technical vision to both technical and business stakeholders.

• Bachelor’s degree in Computer Science, Engineering, or a related technical field.

Nice to Have:

• Direct experience with modern distributed compute frameworks (e.g., Ray, Dask) and large-scale job schedulers (e.g., Slurm, Kueue).

• Experience with Kubernetes and container orchestration, particularly with custom schedulers and resource management for AI workloads.

• An interest in or exposure to emerging compute paradigms like quantum computing.

• Experience with software in isolated, air-gapped, or otherwise network-restricted environments.

• Master’s degree in Engineering, Data Science, or a related field.

• MBA.

This is a unique opportunity to shape the foundational layer that will power the next generation of AI applications. If you are passionate about building performant, scalable, and cutting-edge compute platforms, we would love to hear from you.

The talent and dedication of our employees are at the core of DataRobot’s journey to be an iconic company. We strive to attract and retain the best talent by providing competitive pay and benefits with our employees’ well-being at the core. Here’s what your benefits package may include depending on your location and local legal requirements: Medical, Dental & Vision Insurance, Flexible Time Off Program, Paid Holidays, Paid Parental Leave, Global Employee Assistance Program (EAP) and more!

DataRobot Operating Principles:

• Wow Our Customers
• Set High Standards
• Be Better Than Yesterday
• Be Rigorous
• Assume Positive Intent
• Have the Tough Conversations
• Be Better Together
• Debate, Decide, Commit
• Deliver Results
• Overcommunicate

Research shows that many women only apply to jobs when they meet 100% of the qualifications while many men apply to jobs when they meet 60%. At DataRobot we encourage ALL candidates, especially women, people of color, LGBTQ+ identifying people, differently abled, and other people from marginalized groups to apply to our jobs, even if you do not check every box. We’d love to have a conversation with you and see if you might be a great fit. 

DataRobot is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. DataRobot is committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. Please see the United States Department of Labor’s EEO poster and EEO poster supplement for additional information.

All applicant data submitted is handled in accordance with our Applicant Privacy Policy.