CSI Logo

CSI

Product Manager, Applied AI

Posted Yesterday
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Own the strategy and roadmap for generative and agentic AI products across data and digital banking. Lead reliable AI experience development, evaluation frameworks, LLMOps, observability, guardrails, and responsible AI practices. Partner with architecture, data science, engineering, design, risk, and compliance to deliver trustworthy AI features in a regulated financial-services environment.
The summary above was generated by AI

Job Description:

This role shapes how generative and agentic AI shows up across our data and digital banking products — building AI experiences that are genuinely useful, and the evaluation backbone that makes them reliable and safe in a regulated industry. The hard part of this work isn't access to models; it's the product discipline to turn powerful but probabilistic capabilities into experiences people trust. You will partner with AI architecture, data science, and engineering to bring AI from promising prototype to dependable production feature.
Responsibilities:

AI Product Strategy & Roadmap

  • Own the vision, strategy, and roadmap for LLM-powered and agentic AI experiences across multiple products.
  • Identify the highest-value applications of AI for our users and translate them into a prioritized roadmap.
  • Balance ambitious experimentation with a clear-eyed view of what can be delivered reliably.

Building Reliable AI Experiences

  • Turn probabilistic model capabilities into reliable, valuable, and trustworthy user experiences.
  • Define how AI features behave, where humans stay in the loop, and how the product degrades gracefully when models are uncertain.
  • Work across emerging agentic patterns and tool/interface standards to expand what AI can do for users.


Evaluation, Quality & LLMOps

  • Define the evaluation frameworks, quality bars, and guardrails for AI features, balancing reliability, cost, latency, and safety.
  • Partner with AI architecture and data science on the tooling and operating practices — evaluation, observability, and LLMOps — that let AI scale across the portfolio.
  • Use quantitative and qualitative signals to continuously improve AI feature performance.


Responsible AI & Compliance

  • Champion responsible AI — fairness, privacy, transparency, and accountability — throughout the product lifecycle.
  • Partner with risk and compliance stakeholders to ensure AI practices meet the expectations of a regulated, financial-services environment.


Cross-Functional Partnership

  • Collaborate closely with AI architecture, data science, engineering, and design to ship AI features from concept to production.
  • Communicate AI capabilities, limitations, and trade-offs clearly to both technical and non-technical audiences.


Requirements

  • 6+ years of product management experience, with proven experience shipping LLM/GenAI or ML-powered products to production.
  • Working knowledge of model evaluation, LLMOps and observability, prompt and agent design, and retrieval-augmented generation (RAG).
  • Hands-on familiarity with the modern AI product stack — e.g., LLM evaluation and observability platforms (Langfuse, LangSmith, Helicone), orchestration and agent frameworks (such as LangChain), vector databases and retrieval tooling, and experiment-tracking tools (such as MLflow) — along with comfort using Python and SQL.
  • Strong cross-functional leadership and sound judgment on AI risk and safety.
  • A Bachelor's degree in a technical or quantitative discipline, with a Master's degree a plus.

Preferred Qualifications

  • Financial services or banking industry experience (preferred).
  • Experience with agentic systems and tool protocols (e.g., Model Context Protocol).
  • A conversational UX background, or experience delivering AI in a regulated industry.

As a forward-thinking software provider, Computer Services, Inc. (CSI) helps community and regional financial institutions solve their customers’ needs through open and flexible technologies. In addition to its award-winning core banking platform, these include the latest in lending, digital banking, payments, financial crime prevention and cybersecurity. Building on its 60-year track record of personalized service, CSI is shaping the future of banking and empowering its customers to rival their competition. For more information about CSI, visit www.csiweb.com 

CSI provides rewarding and challenging career opportunities for our employees. When determining your pay, we consider various factors such as your skills, qualifications, experience and location. Along with a competitive salary, this position includes eligibility for incentive awards based on both individual and business performance. We also offer a comprehensive range of benefits. To learn more about our benefits, visit: Benefits Summary

CSI is an Equal Opportunity Employer.  All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, physical and mental disability, marital status, veteran status, or any other characteristic protected by applicable law. If you need an accommodation during the recruitment process, please email us at [email protected] and we will work with you to meet your accessibility needs.

For applicants residing in California, please read Privacy Notice for California Residents | CSI (csiweb.com)

Visa Sponsorship: We are unable to offer visa sponsorship for this position. Applicants must be authorized to work in the United States without the need for sponsorship now or in the future.

Similar Jobs

One Month Ago
Easy Apply
Remote
United States
Easy Apply
181K-213K Annually
Senior level
181K-213K Annually
Senior level
Artificial Intelligence • Fintech • Software • Travel
Own internal AI and automation products that make Engine’s business functions faster and more scalable. Map workflows, identify high-value repetitive workloads, establish baseline metrics, partner with engineering to build and launch solutions, and drive adoption. The role requires evaluating LLMs and agents, incorporating human review, controlling scope and costs, measuring cycle-time improvements, and transitioning successful workflows to functional owners.
Top Skills: AIAi AgentsEvalsLlmsWorkflow Automation
28 Days Ago
Remote
USA
230K-280K Annually
Senior level
230K-280K Annually
Senior level
Artificial Intelligence • Computer Vision • Machine Learning • Software
Own the end-to-end product strategy and lifecycle for AI research products, from model development and user research through launch, pricing, and go-to-market. Partner with research, engineering, design, and business teams to define requirements, ship products, analyze metrics, run experiments, and prioritize features. The role requires strong technical or quantitative foundations, product management experience, SQL and Python fluency, knowledge of machine learning, and experience taking products from zero to one.
Top Skills: Ai Code Generation ToolsArtificial IntelligenceMachine LearningPythonSQLVersion Control
21 Days Ago
Remote
United States
136K-169K Annually
Senior level
136K-169K Annually
Senior level
Software
Owns product strategy, roadmap, and execution for AI-powered experiences serving home service professionals. Responsibilities include researching workflows, defining requirements, shaping model behavior and user experiences, prioritizing roadmaps, establishing product and AI performance metrics, coordinating launches, and improving products through customer feedback and analytics. The role partners closely with Engineering, Design, Data, Marketing, Sales, Customer Success, Operations, and AI platform teams.
Top Skills: AmplitudeArtificial Intelligence (Ai)BrazeLarge Language Models (Llms)LaunchdarklyRetrievalSegmentTool Use

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account