Create clinically realistic prompts and attend-level reference responses, grade AI outputs using rubrics, give feedback to improve model behavior, and take part in onboarding and calibration sessions.
What You'll Do
- Design clinically realistic prompts and scenarios drawn from your specialty (diagnostic reasoning, treatment planning, risk stratification, guideline concordance)
- Write "golden" reference responses at attending-level quality
- Grade AI-generated responses against structured rubrics
- Provide written feedback the research team uses to improve model behavior
- Participate in onboarding office hours and specialty calibration sessions
Who You Are
- Attending Physicians: Must be board certified with current, active, unrestricted medical license
- Resident physicians: Must be in final year of residency (recent graduates must be board-eligible)
- Fellows: Must be board-certified/board-eligible in primary specialty and have current active, unrestricted, medical license.
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead product vision and execution for a 0-1 agentic AI platform, prototyping and shipping autonomous agent capabilities. Drive roadmap for orchestration, memory, action execution, and governance; partner with engineering, GTM, and ecosystem to drive adoption, metrics, and platform primitives that scale across ServiceNow AI offerings.
Top Skills:
Agentic AiAutonomous AgentsLlm Fine-TuningLlm OrchestrationLlmsLow-Code/No-CodeMemory ArchitecturesMulti-Agent SystemsOpen-Source Agent FrameworksPrompt EngineeringRpaServicenow Ai Platform
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead product vision and execution for an agentic AI platform: prototype and ship autonomous agent capabilities, define platform primitives (orchestration, memory, execution, governance), drive adoption and measurable outcomes, partner with engineering, frontier AI teams, and GTM to scale enterprise deployments.
Top Skills:
Agentic AiAutonomous AgentsLlm OrchestrationLlmsLow-Code/No-CodeModel Fine-TuningOpen-Source Agent FrameworksPrompt EngineeringRpaServicenow Ai
Cloud • Healthtech • Social Impact • Software • Biotech
Drive new business within 1-3 top global accounts by generating pipeline, managing complex enterprise sales cycles, forecasting to targets, negotiating with multi-level stakeholders, and collaborating with internal and partner teams to align Benchling solutions to customer R&D and IT needs.
Top Skills:
AIAi Agents And ModelsAWSBenchlingMeddiccSalesforce
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering


