UpDoc Logo

UpDoc

Senior Software Engineer, AI

Posted One Month Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead development of a patient-facing conversational AI agent for chronic disease management. Build scalable, low-latency voice and multimodal systems, engineer prompts, define evaluation metrics, develop fine-tuning data pipelines, deploy AI models and APIs, assess emerging LLM technologies, and collaborate with clinical experts to validate medical accuracy. Develop backend services using FastAPI and Pydantic while supporting secure, reliable medical AI infrastructure.
The summary above was generated by AI

About UpDoc

At UpDoc, we are building the first clinically validated, physician-supervised AI agent that manages chronic diseases. We are an early-stage startup founded by Stanford physicians.

We are seeking a talented and motivated senior engineer to join our team. You will primarily work on UpDoc’s patient-facing conversational agent. This is a fully remote position.

Who You Are

You’re an experienced senior engineer with a backend tilt. You’re well-versed in all things web and have experience building LLM applications end-to-end, even if not in a professional context. You follow the AI/LLM space closely, play with new technologies as they come out, and are excited to use these technologies to build safe, reliable medical AI systems.

What You'll Do

  • Lead the development of our patient-facing conversational agent

  • Implement a scalable, low-latency system for voice/multimodal conversations

  • Implement rigorous prompt engineering processes and develop useful metrics for system evaluation

  • Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation

  • Work with other backend engineers to deploy AI models and chat/voice APIs

  • Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks

  • Collaborate with clinical experts to validate performance and medical accuracy

  • Work on developing backend services using FastAPI and Pydantic

What You’ll Need

  • 5+ years of professional software development experience, including 2+ years of experience with backend web development

  • Experienced and comfortable working with type-hinted, modern Python

  • 2+ years of experience building end-to-end LLM applications, personally or professionally

    • Experience integrating/optimizing LLMs in production environments

    • Knowledge of evaluation frameworks

    • Knowledge and experience with MLOps/LLMOps best practices

    • Experience building AI infrastructure from 0 -> 1

  • Experience with cloud platforms (especially Azure) and containerization technologies

Highly Desired

  • Professional experience building end-to-end LLM-powered applications

  • Experience with model fine-tuning/alignment

  • Experience in an early stage startup environment

  • Experience with healthcare industry standards, such as FHIR, and regulations, including HIPAA and SOC 2

Similar Jobs

5 Days Ago
In-Office or Remote
100K-140K Annually
Senior level
100K-140K Annually
Senior level
Fintech
Build and deploy governed AI agents, automations, and multi-agent systems for business teams. Responsibilities include identifying AI opportunities, translating needs into requirements, prototyping, integrating enterprise systems, instrumenting telemetry, measuring ROI, monitoring risks and costs, and applying governance controls. The role also develops reusable patterns, documents solutions, enables business users, and communicates lessons learned to the AI Center of Excellence.
Top Skills: Ai AgentsAssistant And Agent FrameworksConversational AiDocument IntelligenceIso/Iec 42001Low-Code Workflow AutomationMcp ServersNatural Language AnalyticsNist Ai RmfRetrieval
5 Days Ago
In-Office or Remote
225K-235K Annually
Senior level
225K-235K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Design, build, and ship scalable backend features for Confluence Cloud AI automation and search. Develop RESTful microservices using object-oriented programming languages and work with relational and NoSQL databases in a distributed environment. Collaborate with engineering, architecture, product, and design teams; participate in Agile ceremonies; review code; and ensure reliability, security, performance, testing, documentation, monitoring, and error reporting.
Top Skills: Backend ServicesDistributed SystemsMonitoring And Error ReportingNosql DatabasesObject-Oriented Programming LanguagesRdbmsRestful Microservices
8 Days Ago
Easy Apply
Remote
United States
Easy Apply
173K-255K Annually
Senior level
173K-255K Annually
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services
Build and operate Affirm’s AI platform, including LLM and MCP gateways, agent runtimes, evaluation services, and governance controls. Design highly available backend systems, manage identity, quotas, routing, caching, reliability, observability, and security for AI workloads. Own projects from design through launch and on-call, establish engineering standards, collaborate across teams, mentor engineers, and help scale AI systems into production.
Top Skills: AWSAws BedrockChatgptClaudeKotlinKubernetesLitellmMcpMySQLPython

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account