xCures Logo

xCures

AI Quality Engineer

Posted One Month Ago
Remote
Hiring Remotely in United States
100K-130K Annually
Mid level
Remote
Hiring Remotely in United States
100K-130K Annually
Mid level
Own quality control, regulatory alignment, and performance reporting for AI-powered clinical extractors. Analyze accuracy, consistency, data quality, provenance, and performance drift; guide extraction logic and clinical interpretation; support FHIR and CSV data exports; and contribute to governance, de-identification, validation, and client reporting. Collaborate with Data Science, Engineering, and Clinical Informatics while serving as a clinical subject-matter expert, particularly in oncology and real-world evidence.
The summary above was generated by AI
About xCures

Lots of data, little understanding. Medical records for a single patient live scattered across dozens of providers, and critical data is buried in unstructured faxes, PDFs, and notes that no one has time to read. Access to health data is no longer the problem. Getting a clear, structured, trusted piece of information out of that mess is. That’s the problem xCures® exists to solve.
The xCures Clinical Clarity Engine turns fragmented records into validated, source-linked answers built for the next decision. Every extracted data point traces back to the exact document and page it came from. Automatically get the patient history you need, so you can make decisions based on more accurate information without digging through documents.

We work with anyone that needs information from medical data for their next decision: diagnostic labs, providers, telehealth providers, health systems, payers, consumer health platforms, and more. Wherever a decision is stuck behind 200 scattered documents no one has time to read, that’s our problem to solve. We’re a remote-first, Series B, venture-backed team that holds itself to the same standard as our product: trustworthy, precise, and purposeful. If you like solving problems that are genuinely hard and useful, you’ll feel at home here. 


Here’s Where You’ll Make An Impact:

As xCures scales its clinical extractors across new clients and clinical domains, every structured output has to hold up to scientific and regulatory scrutiny. As our AI Quality Engineer, reporting to the Vice President of Scientific and Medical Affairs, you own that standard.

You run the quality control that keeps our extractors trustworthy. You lead the regulatory alignment that lets clients rely on our outputs. You translate extractor performance into clear, evidence-backed reporting that clients and internal teams act on. Working closely with Data Science, Engineering, and Clinical Informatics, you help turn messy medical text into source-linked clinical data that stands up to review.

If you want your scientific rigor to shape a platform used for real clinical decisions, this is where it lands.

Key Responsibilities:
  • Lead ongoing quality control of clinical extractor outputs, running systematic accuracy and consistency analyses across detection, data-set composition, and value extraction, and resolving discrepancies before they reach clients
  • Lead regulatory alignment for the extraction and validation program, keeping quality processes, methodology, and documentation consistent with applicable privacy, de-identification, and clinical-data standards
  • Lead client-facing performance reporting, translating validation metrics and extractor capabilities and limitations into clear, evidence-backed reports for client and internal audiences
  • Serve as an internal subject-matter expert for clinical domains, with an emphasis on oncology and real-world evidence, guiding the Data Science team on interpretation, clinical relevance, and the limits of current extraction methods
  • Partner with Data Science to prototype and refine extraction logic, inferred variables, normalization, and binning, contributing domain expertise on the nuances of medical text
  • Define and monitor clinical quality KPIs, track extractor performance drift over time, and recommend retraining or recalibration when the data warrants it
  • Work with Engineering and Clinical Informatics to ensure accurate export of structured clinical data into downstream formats such as FHIR bundles and CSV tables
  • Support data governance and dataset integrity, contributing to data-dictionary alignment, de-identification, and the quality of clinical datasets used for development and delivery
  • Serve as a clinical reviewer in internal quality reviews, client demos, and QA events, and support business development with feasibility analysis for prospective and current clients
Qualifications:Required:
  • Strong background in computational biology, bioinformatics, or a related life sciences discipline, whether through formal education or hands-on experience 
  • Strong clinical knowledge across major disease areas, including diagnostic criteria, staging or severity classifications, and standard-of-care treatment patterns
  • Demonstrated experience with electronic medical records and the current healthcare data landscape, including Health Information Exchanges (HIE) and Qualified Health Information Networks (QHIN)
  • Demonstrated experience with structured clinical data and real-world data analysis
  • Strong grasp of data quality principles, data validation processes, and the ability to assess the provenance and limitations of real-world data
  • Proficiency in Python, R, or SQL for data manipulation and analysis
  • Ability to translate complex scientific concepts into clear, actionable findings for technical and non-technical audiences
  • Strong written and verbal communication skills
  • Proven ability to manage multiple complex, unrelated projects at once, with strong organization and time management
  • Comfort working remotely with virtual collaboration tools
Bonus Points:
  • 4+ years of relevant industry experience
  • Master's degree in computational biology, bioinformatics, or a life sciences discipline
  • Experience with medical coding ontologies (SNOMED, LOINC, RxNorm, OMOP)
  • Familiarity with version control (Git/GitHub) and collaborative code workflows
  • Comfort in a command-line environment and cloud development tools (AWS, GCP, or similar)
  • Experience defining or reporting quality and performance metrics for AI or data-extraction systems
  • Familiarity with de-identification (HIPAA Safe Harbor or Expert Determination) and clinical data governance
Location

xCures operates in a distributed, remote-first environment, with occasional travel to company offsites or key meetings throughout the year. Candidates may be located anywhere in the United States. The successful candidate must already have authorization to work in the United States. At this time, xCures does not offer sponsorship. All candidate information will be held in confidence and in accordance with EEOC guidelines.

Additional Considerations

We recognize that people bring a wealth of experience and talent beyond just the requirements listed in a job description. Diversity of experience and skills, combined with a shared passion for healthcare, is what drives us to innovate. We welcome candidates from all backgrounds and encourage you to apply, even if you don’t meet every qualification listed. xCures is an equal opportunity employer, committed to creating an inclusive environment for all employees. 

Benefits


Great work deserves great support. We believe our people are our greatest asset, and we’re committed to supporting them with a strong, competitive benefits package. Our goal is to be a place where people genuinely want to build their careers, and our benefits are designed to support our team in the ways that matter most.

  • Remote-First 
  • Paid Time Off and 13 Company Holidays
  • Equity Package 
  • Paid Parental Leave 
  • Medical, Vision, and Dental 
  • Employer HSA Contribution 
  • Employer 401(k) Match 
  • STD, LTD, Life Insurance and Critical Illness Plans
  • Employee Assistance Program
  • Adoption Assistance 
  • Company Offsites 
  • Monthly Internet Allowance 
  • Professional Development Funds 
  • And more! 
Compensation

The anticipated base salary range for this role is $100,000 to $130,000. 

Similar Jobs

4 Days Ago
In-Office or Remote
Senior level
Senior level
Information Technology
Designs and executes functional, regression, integration, automated, voice, and end-to-end testing for conversational AI, IVR, and customer engagement platforms. Validates intents, entities, utterances, speech recognition, call routing, integrations, APIs, and customer journeys. Creates test plans, cases, automation suites, reports, and quality metrics; tracks defects and collaborates with technical and product teams. Requires extensive Cyara experience, conversational AI platform testing, IVR validation, and strong QA methodologies.
Top Skills: Amazon ConnectAws LexCi/CdCyara CruncherCyara VelocityCyara Virtual AgentDtmfGenesys CloudGoogle Dialogflow CxGoogle Dialogflow EsSip
6 Days Ago
Remote
United States
Mid level
Mid level
Enterprise Web • Legal Tech • Software • Automation
Hands-on QA Engineer responsible for exploratory, functional, regression, API, security, accessibility, integration, and AI-feature testing across a legal SaaS platform. The role validates document retrieval and delivery workflows, investigates defects, uses SQL, logs, dashboards, and simulators for backend verification, and creates targeted automated checks with tools such as Playwright. Responsibilities also include testing authentication, permissions, LLM behavior, prompt injection, third-party integrations, and production issues while collaborating with engineering and product teams.
Top Skills: BrunoChatgptClaudeClaude CodeCsrfCurlCursorDockerGrafanaHTTPJIRAJSONKubernetesLokiMcpOauth2PlaywrightPlaywright McpPostgresPostmanRestSAMLSeleniumSentrySQLVueXss
9 Days Ago
Remote or Hybrid
200K-280K Annually
Senior level
200K-280K Annually
Senior level
Artificial Intelligence • Software • Generative AI
Improve the quality and reliability of Glean’s AI assistants and agents through evaluation-driven development, model routing, retrieval, prompting, and post-training. Build supervised and preference-optimized models, reinforcement-learning environments, evalsets, LLM judges, and agentic verifiers. Analyze production traces, calibrate evaluation signals against human graders, balance quality with latency and cost, and partner with product, platform, research, and customer teams to ship production ML improvements.
Top Skills: Agentic VerifiersAi AgentsDpoEvalsetsGoGrpoLarge Language Models (Llms)Llm-As-A-JudgeMachine Learning FrameworksModel RoutingPpoPythonReinforcement LearningRetrievalSupervised Fine-Tuning (Sft)Typescript

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account