UpDoc Logo

UpDoc

Senior Software Engineer, AI

Posted Yesterday
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead development of a patient-facing conversational AI agent for chronic disease management. Build scalable, low-latency voice and multimodal systems, engineer prompts, define evaluation metrics, develop fine-tuning data pipelines, deploy AI models and APIs, assess emerging LLM technologies, and collaborate with clinical experts to validate medical accuracy. Develop backend services using FastAPI and Pydantic while supporting secure, reliable medical AI infrastructure.
The summary above was generated by AI

About UpDoc

At UpDoc, we are building the first clinically validated, physician-supervised AI agent that manages chronic diseases. We are an early-stage startup founded by Stanford physicians.

We are seeking a talented and motivated senior engineer to join our team. You will primarily work on UpDoc’s patient-facing conversational agent. This is a fully remote position.

Who You Are

You’re an experienced senior engineer with a backend tilt. You’re well-versed in all things web and have experience building LLM applications end-to-end, even if not in a professional context. You follow the AI/LLM space closely, play with new technologies as they come out, and are excited to use these technologies to build safe, reliable medical AI systems.

What You'll Do

  • Lead the development of our patient-facing conversational agent

  • Implement a scalable, low-latency system for voice/multimodal conversations

  • Implement rigorous prompt engineering processes and develop useful metrics for system evaluation

  • Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation

  • Work with other backend engineers to deploy AI models and chat/voice APIs

  • Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks

  • Collaborate with clinical experts to validate performance and medical accuracy

  • Work on developing backend services using FastAPI and Pydantic

What You’ll Need

  • 5+ years of professional software development experience, including 2+ years of experience with backend web development

  • Experienced and comfortable working with type-hinted, modern Python

  • 2+ years of experience building end-to-end LLM applications, personally or professionally

    • Experience integrating/optimizing LLMs in production environments

    • Knowledge of evaluation frameworks

    • Knowledge and experience with MLOps/LLMOps best practices

    • Experience building AI infrastructure from 0 -> 1

  • Experience with cloud platforms (especially Azure) and containerization technologies

Highly Desired

  • Professional experience building end-to-end LLM-powered applications

  • Experience with model fine-tuning/alignment

  • Experience in an early stage startup environment

  • Experience with healthcare industry standards, such as FHIR, and regulations, including HIPAA and SOC 2

Similar Jobs

3 Days Ago
Remote or Hybrid
OH, USA
Senior level
Senior level
Financial Services
Leads software engineering efforts within an agile infrastructure platform team. Develops, reviews, debugs, and governs secure production code using Java full-stack technologies, React, cloud platforms, containers, and relational databases. Drives adoption of AI-assisted engineering tools, establishes validation and security standards, coaches technical teams, promotes SDLC automation, and influences technology decisions. Balances hands-on development with technical leadership and contributes to an inclusive engineering culture.
Top Skills: AWSAzureDockerGCPGithub CopilotHibernate/JpaJava 11+KubernetesLarge Language Models (Llms)MySQLOraclePostgresReactRestful ApisSpring BootSpring Framework
7 Days Ago
In-Office or Remote
180K-240K Annually
Senior level
180K-240K Annually
Senior level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Architect and build high-performance distributed infrastructure for batch and streaming data across global regions. Optimize state management, checkpointing, JVM performance, and exactly-once processing. Develop AI infrastructure including vector indexing, agentic workflows, and real-time data streaming. Own the full software development lifecycle, contribute to shared tooling and SDKs, and mentor engineers through technical leadership and design reviews.
Top Skills: Apache FlinkSparkGoJavaJvmKafkaKotlinKubernetesOlap EnginesVector Indexing
Yesterday
Remote
United States
119K-161K Annually
Senior level
119K-161K Annually
Senior level
Aerospace • Information Technology • Professional Services • Security • Software
Develop and improve production software using AI and automation for USPS mission-critical systems. Build distributed, cloud-based microservices; improve reliability, scalability, and system performance; identify bottlenecks; contribute to modernization and architecture; own solutions end to end; mentor junior developers; and communicate technical decisions and trade-offs.
Top Skills: Agentic AiAIAsynchronous SystemsCachingCloud ComputingDistributed SystemsJavaMicroservicesService IntegrationStorage Layers

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account