Medeloop Logo

Medeloop

Senior Software Development Engineer in Test - SF

Posted Yesterday
Be an Early Applicant
In-Office
San Francisco, CA
80K-120K Annually
Senior level
In-Office
San Francisco, CA
80K-120K Annually
Senior level
The Senior SDET will own quality across all products, develop automated testing frameworks, and manage test infrastructure, focusing on agentic AI systems and healthcare applications.
The summary above was generated by AI

We're looking for a Senior SDET who thinks deeply about quality in systems that are inherently non-deterministic. Agentic AI doesn't fail the same way traditional software does — and testing it requires a new toolkit: eval frameworks, prompt regression, tool-call reliability, adversarial scenarios, and more.

You'll own the entire quality infrastructure across our product portfolio — from test data and CI pipelines to the standards and culture of how we ship. You'll work directly with product, devops, and AI engineering, with no layers between your decisions and their impact.

What You'll Own
  • Test infrastructure, test data, test processes across the entire product portfolio while working with Devops and Infrastructure engineers
  • Test Framework - build and enhance automated testing frameworks and tools that facilitate automated testing across different layers of application.
  • The reliability bar for all Web applications, Mobile applications and AI agent outputs — from hallucination detection to latency regressions and tool-call correctness
  • Test infrastructure, test data, and test processes across the entire product portfolio, alongside DevOps and Infrastructure engineers
  • Automated testing frameworks that span all layers of the application — unit, integration, contract, and end-to-end
  • Evaluation frameworks designed for LLM-based systems: non-deterministic output scoring, prompt regression, and adversarial test suites
  • HIPAA-aware test data management — de-identification pipelines, synthetic data generation, and audit trail validation
  • Integration of automated tests into CI/CD pipelines for continuous delivery confidence
  • Build stability monitoring and release gate enforcement before any deployment
  • Documentation of test plans, test results, and evaluation standards to support knowledge sharing
  • The "safety net" for product quality — you define what done looks like
What We're Looking For
  • 8+ years of hands-on SDET experience, with recent work building or testing agentic AI systems (single- or multi-agent) in production
  • Experience in healthcare or life sciences — you understand what's at stake when a system fails in this domain
  • A true tester's mindset: you seek out edge cases, adversarial inputs, and failure modes others overlook
  • Proficiency across the full test pyramid — unit, integration, system, performance, and exploratory — plus familiarity with LLM-specific evaluation approaches
  • Strong debugging skills across multi-tier web and mobile architectures; comfortable jumping into production incidents
  • Proficiency with testing frameworks such as Jest, React Testing Library, Supertest, and pytest.
  • Hands-on experience with testing tools like Cypress, Playwright, Supertest, and pytest (including requests or Selenium-based testing)
  • Experience testing RESTful APIs using tools like Postman or Supertest
  • Solid command of JavaScript and Python
Bonus Points
  • Multi-cloud experience (AWS, Azure, GCP)
  • Experience with red-teaming or adversarial testing of AI systems
  • Native mobile testing experience (iOS, Android)
  • Prior work with 21 CFR Part 11, GxP, or similar regulated-software validation frameworks
Why Medeloop
  • Ownership from day one: small team, high-trust, no layers between your work and its impact
  • Technically ambitious: you'll build AI-powered workflows, not just support them
  • Real-world stakes: your work accelerates drug development, addresses health equity, and improves clinical research for institutions that matter

Strong foundation: Series A, top-tier investors, and a data asset (200M+ patient records) that most companies spend years trying to build

Top Skills

Ci/Cd
Cypress
JavaScript
Jest
Playwright
Postman
Pytest
Python
React Testing Library
Restful Apis
Supertest

Similar Jobs

2 Hours Ago
Hybrid
Los Angeles, CA, USA
213K-377K Annually
Senior level
213K-377K Annually
Senior level
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Provide legal counsel on AR, AI, and hardware products (Spectacles) throughout development and launch. Review specs for privacy-by-design and regulatory compliance, analyze legal and safety risks, develop go-to-market and compliance strategies, draft public-facing materials and terms, conduct trainings, and create processes to scale product legal support.
Top Skills: AIArHardwareLens StudioSpectaclesWearable Technology
2 Hours Ago
Hybrid
80K-100K Annually
Mid level
80K-100K Annually
Mid level
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
The Talent Acquisition Advisor manages the recruitment lifecycle, partners with hiring managers, and develops sourcing strategies for high-volume and standard roles.
Top Skills: Oracle Applicant Tracking System
2 Hours Ago
Remote or Hybrid
California, USA
60K-75K Annually
Junior
60K-75K Annually
Junior
Fintech • Professional Services • Sales • Financial Services
The Marketing Specialist will manage customer journeys, reputation, content development, and brand advocacy while analyzing insights and leveraging AI in marketing workflows.
Top Skills: Ai ToolsData AnalyticsGoogle SheetsGoogle SlidesMS Office

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account