JPMorganChase Logo

JPMorganChase

Executive Director, Product Director – GenAI Gateway & Orchestration

Posted 23 Minutes Ago
Be an Early Applicant
Hybrid
Seattle, WA
Senior level
Hybrid
Seattle, WA
Senior level
Leads the vision, roadmap, architecture, adoption, and enterprise-scale delivery of a generative AI gateway and orchestration platform. Oversees model routing, token management, traffic management, resiliency, security, governance, observability, telemetry, cost optimization, and multi-cloud deployment. Partners with Engineering, Architecture, Cybersecurity, Risk, Finance, and senior leadership while mentoring product teams and driving platform outcomes.
The summary above was generated by AI

Job Description

Ignite your passion for product innovation by leading customer-centric development, inspiring solutions, and shaping the future with your strategic vision and influence. Step into a role where you define how the firm builds and runs the next generation of AI applications, turning a powerful runtime platform into a true point of leverage for the teams you serve. You will remove friction, accelerate the path from idea to production, and set the standard for how secure, resilient infrastructure is delivered at scale.

As a Product Director in the Model & Serving team, you lead innovation through the development of products and features that delight customers. As a leader on the team, you leverage your advanced capabilities to challenge traditional approaches, remove barriers to success, and foster a culture of continuous innovation that helps inspire cross-functional teams create groundbreaking solutions that address customer needs. You shape how enterprise teams access models through a runtime layer with routing, guardrails, observability, telemetry, evaluation, and cost management built in by default. Partnering across Engineering, Architecture, Cybersecurity, Risk, Finance, and the business, you deliver a secure, resilient platform that dramatically shortens the time from idea to production.

This role calls for a senior product leader with deep expertise in AI infrastructure, distributed systems, and model serving who can set a clear vision and lead execution at enterprise scale. You balance speed and simplicity for application teams with enterprise requirements for security, compliance, multi-tenancy, and cost control, ensuring the platform scales reliably as demand grows.

Job responsibilities

  • Oversees the product roadmap, vision, development, execution, risk management, and business growth targets
  • Leads the entire product life cycle through planning, execution, and future development by continuously adapting, developing new products and methodologies, managing risks, and achieving business targets like cost, features, reusability, and reliability to support growth
  • Coaches and mentors the product team on best practices, such as solution generation, market research, storyboarding, mind-mapping, prototyping methods, product adoption strategies, and product delivery, enabling them to effectively deliver on objectives
  • Owns product performance and is accountable for investing in enhancements to achieve business objectives
  • Monitors market trends, conducts competitive analysis, and identifies opportunities for product differentiation
  • Serves as the accountable product leader for the generative AI Gateway across both federated and managed deployment models, driving adoption and platform outcomes
  • Defines the target-state gateway architecture with Engineering and Architecture partners, including data, multi-cloud, and multi-region deployment strategies and consistent capabilities across federated and managed models
  • Leads token management and intelligent model routing across policy, cost, and latency to support multi-model and agentic workloads
  • Drives traffic management and resiliency capabilities so the platform scales reliably with demand, partnering with Engineering to optimize inference performance and cost
  • Makes security and governance default capabilities applied to every model call, and owns guardrails, observability, and telemetry that give teams full visibility into production behavior
  • Communicates strategy, delivery progress, risks, dependencies, and recommendations to senior leadership and governance forums

Required qualifications, capabilities, and skills

  • 8+ years of experience or equivalent expertise delivering products, projects, or technology applications
  • Extensive knowledge of the product development life cycle, technical design, and data analytics
  • Proven ability to influence the adoption of key product life cycle activities including discovery, ideation, strategic development, requirements definition, and value management
  • Experience driving change within organizations and managing stakeholders across multiple functions
  • Experience building or scaling AI or cloud platform infrastructure, such as generative AI or large language model gateways, API gateways and API management, model serving platforms, cloud networking and traffic management, or enterprise observability and telemetry platforms
  • Experience building AI and machine learning platform products for enterprise customers on one or more major cloud providers (Amazon Web Services, Microsoft Azure, or Google Cloud), including compute, networking, storage, and security for AI workloads
  • Strong knowledge of generative AI architectures, large language models, and how AI applications consume models in production
  • Solid understanding of AI infrastructure and model serving, including inference performance, capacity planning, scalability, and reliability engineering
  • Experience with cost management for cloud or AI workloads, including usage metering, cost attribution, and optimization
  • Ability to translate complex technical concepts into clear product strategy, prioritized roadmaps, and executive communications
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience

Preferred qualifications, capabilities, and skills

  • Recognized thought leader within a related field
  • Experience building or leading a generative AI gateway, large language model proxy, model routing, or machine learning serving product at enterprise scale
  • Full-stack technical fluency across the AI platform, from GPU and accelerator infrastructure and low-latency serving stacks to APIs, SDKs, and the applications built on them
  • Experience operating both federated and centrally managed platform models, including shared standards, policy enforcement, and multi-tenant design
  • Familiarity with open-source and commercial gateway and model serving technologies, as well as techniques for optimizing inference performance and cost
  • Familiarity with AI observability, evaluation, and guardrail tooling, and with agent orchestration
  • Experience partnering closely with Legal, Compliance, and Risk teams, with working knowledge of the regulatory landscape for AI, data privacy, and third-party risk in financial services

This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorganChase’s review of criminal conviction history, including pretrial diversions or program entries.

About Us
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. 

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

About the TeamOur professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success.

Similar Jobs

3 Hours Ago
Remote or Hybrid
United States
150K-200K Annually
Senior level
150K-200K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Leads Cadillac sales performance across the Northeast zone by managing district teams, developing dealer relationships, improving market share and profitability, and executing customer, marketing, inventory, training, and aftersales strategies. Analyzes market and sales data, oversees dealer compliance and facility standards, coaches teams, manages contractual performance expectations, and drives adoption of digital marketing and dealership tools. This field-based role requires frequent travel and relocation or residence within the assigned territory.
Top Skills: Google Workspace
5 Hours Ago
Hybrid
2 Locations
99K-232K Annually
Senior level
99K-232K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Leads client advisory and implementation work for Zuora quote-to-revenue solutions. Designs Zuora CPQ X, Billing, and Revenue architectures, integrations, billing workflows, and revenue recognition automation. Manages project plans, budgets, timelines, testing, deployment readiness, training, and post-implementation support. Coaches delivery teams, resolves complex design issues, communicates trade-offs, and improves finance operations through analytical thinking and AI-assisted collaboration.
Top Skills: AIZuora BillingZuora Cpq XZuora Revenue
5 Hours Ago
Hybrid
2 Locations
77K-202K Annually
Senior level
77K-202K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Design and implement Appian-based BPM and low-code solutions for clients, including process models, enterprise integrations, cloud deployment architectures, and secure data flows. Lead implementation workstreams using Scrum and Jira, analyze process data with Celonis or SAP Signavio, troubleshoot platform and network issues, and coordinate deployment plans. Review technical deliverables, coach junior colleagues, explain architecture decisions, and incorporate client feedback into scalable solution designs.
Top Skills: AppianAWSBusiness Process Management (Bpm)Business Process ModelingCelonisGoogle Cloud PlatformIt Service Management (Itsm)Jira SoftwareLow-Code Application DevelopmentAzureRobotic Process Automation (Rpa)Sap SignavioScrum

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account