Kinetic (kineticcomp.com) Logo

Kinetic (kineticcomp.com)

Product Manager, Agentic AI

Posted Yesterday
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Own the agent orchestration platform and co-lead AI agent solutions across the insurance lifecycle. Define agent roadmaps, prompts, tools, autonomy tiers, evaluation datasets, governance, rollout gates, observability, and cost controls. Partner with product, engineering, data, and experience teams to translate business needs into agent specifications and measurable outcomes. Establish regression testing, human escalation policies, audit trails, and production quality standards for LLM-powered products.
The summary above was generated by AI
At Kinetic, a single, powerful mission unites us: Creating the best Workers’ Comp experience. Our culture is the engine that drives this mission forward—a culture built on togetherness, excellence, accountability, and a deep commitment to our customers.
About Kinetic 

We’re transforming workers’ comp with technology-driven solutions for injury prediction, prevention, and management—helping employers create safer, healthier workplaces.

Our platform is built for labor intensive industries including parcel delivery, manufacturing, and wholesale/warehousing operations. Our tech-driven program speeds up return-to-work and offers generative AI for claims management. Through these and other products and services, we're redefining what workers' comp can do.

We’re a remote-first team headquartered in New York City, growing fast—10x in the past two years—and driven by accountability, continuous improvement, and collaboration. If you're excited to build a career with impact, we’d love to meet you.

Kinetic has been named to: Business Insurance's Best Place to Work in Insurance 2025 & 2026.

About the role

Kinetic Insurance is building AI agents across the insurance lifecycle. We are seeking a Product Manager to lead our Agentic AI efforts. This role makes sure every agent Kinetic ships is a component of one coherent platform rather than a one-off automation. You'll decide what gets built as an agent, how it's evaluated, how much autonomy it earns, and how we prove it moved a real business metric. 

The role has two tracks. You'll own the agent platform outright: orchestration, tooling, observability, and guardrails. You'll co-own agent solutions with our experience team PMs, who bring the customer problem while you bring the judgment on whether and how an agent should solve it. This role leans more technical than business, though it is not an engineering role. You'll write and test prompts, build evaluation sets, read traces, and prototype ideas. You won't ship production code, but you won't need an engineer to test whether an idea works.

You'll report to the VP of Product and sit on the product management team, working alongside the PMs who lead our Broker, Policyholder, Underwriter, Claims, Data, and Business Systems teams.

What you'll do

Agent platform and orchestration (owned outright)
  • Own the roadmap for Kinetic's agent orchestration layer: models and routing, tools and memory, observability, and permissions and guardrails. 
  • Run the agent registry. Every agent has exactly one owner, one documented purpose, one autonomy tier, and one place its behavior is logged.
  • Define how agents are deployed, versioned, and rolled back, with prompts, tool definitions, and model versions managed like code.
  • Track usage, cost, and latency per agent. Cost per orchestration matters more than cost per token, and you'll know both.
  • Lead the cleanup of the agents we already have: inventory every script and workflow touching AI, then retire, replatform, or sunset each one.
  • Keep business logic, specs, and evaluation data portable so a future framework or model change is an engineering project, not a rewrite.
Agent solutions with experience teams (co-owned)
  • Partner with PMs to define the problem or opportunity, and make the call on whether an agent is the right tool or simpler automation will do.
  • Translate use cases into agent specs: inputs, tools, autonomy boundary, human escalation path, success metric, and baseline.
  • Write, test, and iterate on system prompts, tool descriptions, and structured outputs side by side with agent and data engineers.
  • Tie every agent to one business metric before it scales, such as time-to-quote, bind rate, override rate, or hours saved.
Evaluation, governance, and quality
  • Build golden datasets with our data team for every agent, and run them as a regression suite whenever a prompt, tool, or model changes.
  • Own the rollout gates from shadow mode to staged rollout to full production, with each go/no-go decided by evaluation thresholds rather than a calendar date.
  • Write and maintain Kinetic's autonomy-tier policy, including which decisions always keep a human checkpoint, such as a decline, a denial, a bind, or a price.
  • Produce the artifacts a regulator or acquirer will ask for as a byproduct of good practice: architecture map, evaluation history, audit trail, and before-and-after metrics.

What you've done

  • 5+ years in Product Management, Technical Product Management, or a similar role, including 1+ years shipping LLM-powered or agentic products into production, not just demos.
  • Hands-on prompt engineering: system prompts, tool definitions, multi-step chains, and structured outputs. 
  • Built or ran evaluation for LLM systems, such as golden datasets, LLM-as-judge graders, and regression testing.
  • Working knowledge of agent frameworks and platforms such as CrewAI, LangGraph, OpenAI Agents SDK, or AWS Bedrock AgentCore, along with RAG, tool calling, and MCP.
  • Demonstrated ability to convert messy business needs into requirements, user stories, and acceptance criteria.
  • Experience in startups or high-growth environments. You're comfortable building from scratch.
  • Excellent communication skills, with the ability to explain probabilistic systems to business leaders.

Big plus if

  • Prior experience at an insurtech, MGA, or carrier, or in another regulated industry such as financial services or healthcare.
  • Familiarity with workers' compensation, commercial lines underwriting, or claims workflows.
  • Experience with AI governance frameworks.
  • Experience with multi-model routing, cost optimization, or human-in-the-loop design for agents.

What we offer
  • Fully distributed, remote team across all continental US time zones
  • Medical, dental, and vision insurance
  • 20 vacation days per year
  • 9 federal holidays off 
  • Parental Leave
  • Pre-tax 401k contribution
  • HSA with compatible health plans
  • FREE: Health Advocate
  • FREE: Telehealth Membership
  • FREE: OneMedical Account

Note
Candidates must reside within the US with existing authorization to work in the United States. This role requires domestic travel for company offsites and team alignment. Verification of government-issued identity and employment eligibility will be conducted in person prior to employment.

Security Notice: Kinetic is committed to a secure hiring process. All offers of employment are contingent upon successful completion of a comprehensive identity and background verification process. We will never ask for financial information or payment during the application process.

Similar Jobs

Yesterday
Remote
United States
82K-130K Annually
Mid level
82K-130K Annually
Mid level
HR Tech • Consulting
Own defined product features and workflows from discovery through launch and post-launch improvement. Create product artifacts, partner with engineering and design, incorporate customer feedback and analytics, manage roadmaps and backlogs, prepare launch plans, and monitor adoption and quality. The role requires cross-functional collaboration, benefits administration domain learning, responsible use of AI-enabled tools, and hands-on technical engagement with engineers, including troubleshooting and scripting for production support.
Top Skills: AgileSaaS
15 Days Ago
Remote
United States
280K-300K Annually
Senior level
280K-300K Annually
Senior level
Artificial Intelligence • Software
Lead the end-to-end development of agentic AI products for workforce management, from operational research and agent definition through prototyping, evaluation, enterprise deployment, and commercialization. Define human-in-the-loop controls, tools, escalation rules, specifications, and release criteria. Build prototypes, prompts, evaluation sets, and code contributions while diagnosing model and system failures. Partner with enterprise design customers, engineering, AI Lab, executives, and go-to-market teams to deliver reliable, compliant products.
Top Skills: Agentic AiAi Agent FrameworksAudit TrailsClaude CodeLarge Language Models (Llms)Model RoutingMulti-Tenant SaasPull RequestsRetrieval-Augmented Generation (Rag)Role-Based Access Control (Rbac)Single Sign-On (Sso)Structured Outputs
2 Months Ago
In-Office or Remote
90K-168K Annually
Senior level
90K-168K Annually
Senior level
HR Tech
Lead strategy, roadmap, and execution of agentic AI product experiences across HR domains. Identify high-value AI use cases, define requirements, platform capabilities, evaluation frameworks, and partner cross-functionally to deliver scalable, compliant, and measurable AI solutions from discovery through launch and continuous optimization.
Top Skills: Agent-To-Agent OrchestrationAi Product PlatformsConversational AiKnowledge/Data PipelinesMcp ServerPrompt ChainingPrompt Management

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account