Machine Learning Engineer II

As a Machine Learning Engineer on our AI and ML Infrastructure team, you'll be a key player in our mission to accelerate improvements that remove barriers to mental health. Your role is to build the foundational LLM infrastructure, tools, and automated systems that empower all of our product teams to deliver features faster, safer, and more reliably.

This is a hands-on role where you will build the "paved road" for AI development at Spring Health. You will tackle complex technical challenges by turning clear solutions into well-defined technical plans for LLM Ops and shared LLM components. You will not only build for today's needs but also lay the groundwork for future capabilities.

Please note that this is a hybrid role based in San Francisco, with an expectation to be in office 2-3 days a week. Our office is located at 2 Embarcadero Ctr.

• Build Foundational LLM Tooling: Design, build, and maintain the core components of our LLM infrastructure. This includes operationalizing tools like LangSmith for observability, creating shared patterns for using orchestration frameworks, and developing reusable libraries that make our feature teams more productive.
• Develop Advanced AI Capabilities: Build the platform to support sophisticated LLM use cases. You will help deploy and build the pipelines for a vector database to enable Retrieval-Augmented Generation (RAG) across multiple product teams.
• Pioneer Future-State Infrastructure: Contribute to proofs-of-concept and the architectural groundwork for future innovations.
• Ensure Platform Excellence & Scalability: Consistently add logging, monitoring, and alerting to the platform services you build. Your team is accountable to ensure the platform is stable, performant, and cost-effective for its internal users.
• Partner with Feature Teams: Work closely with engineers across the organization to understand their needs and challenges. You will act as a consultant and enabler, providing the tools and patterns that unblock their work and accelerate their AI roadmaps.

1. Platform Adoption & Developer Enablement

• Accelerate onboarding by cutting the time it takes for new engineers to make their first successful call to the platform.
• Improve developer satisfaction and drive adoption of new platform features each quarter.

1. Operational Excellence & Reliability

• Meet or exceed SLOs for core services, such as uptime and latency, and lower the average time to resolve incidents (MTTR).
• Increase automation by improving test coverage and reducing repetitive support questions through better documentation.

1. Roadmap Delivery & Project Execution

• Deliver committed roadmap items on schedule each sprint or quarter.
• Produce high-quality work, from clear technical designs to clean, maintainable code.

1. Team & Cross-functional Collaboration

• Earn positive feedback from internal platform users and stakeholders.
• Elevate the team by improving internal processes and sharing knowledge through mentorship and documentation.

• Proven Experience: Demonstrated experience building and delivering production-grade software, with significant, hands-on experience in LLM or Generative AI engineering.
• A Platform Builder's Mindset: You think in terms of abstractions, reusability, and creating leverage for other engineers. You have experience building internal tools, libraries, or platforms and understand the importance of clear documentation and API design for your internal customers.
• Technical Proficiency: Strong proficiency in Python and familiarity with the modern AI/ML stack, including cloud services (AWS, GCP, or Azure) and CI/CD pipelines. You are adept at making smart, practical tradeoffs to meet goals.
• LLM & Generative AI Expertise: Hands-on experience building or working with key components of the modern LLM stack. Direct experience with orchestration frameworks (e.g., LangChain, LangGraph), observability tools (e.g., LangSmith), and the infrastructure for Retrieval-Augmented Generation (RAG) like vector databases is a significant plus.
• Pragmatic Problem-Solving: The ability to operate at a feature scope, breaking down clearly defined solutions into smaller, manageable tasks. You can proactively identify and mitigate risks and think through what might be coming in the next sprint.
• Resilience and Drive: A high degree of grit and comfort with the ambiguity that comes with a fast-paced, high-growth environment. You take ownership, see challenges as opportunities, and are resourceful in finding solutions.
• Education: A Bachelor's degree in a technical field or equivalent practical experience. We value the diverse perspectives that different backgrounds bring to our team.
• Security and Privacy Awareness: A deep understanding of the importance of handling sensitive data.

The target base salary range for this position is $120,000 - 165,275, and is part of a competitive total rewards package including stock options and benefits. Individual pay may vary from the target range and is determined by a number of factors including experience, location, internal pay equity, and other relevant business considerations. We review all employee pay and compensation programs annually using Radford Global Compensation Database at minimum to ensure competitive and fair pay. 

Note: We have even more benefits than listed here and below, your recruiter will provide more in-depth information as you continue in the interview process. Benefits are subject to individual plan requirements and eligibility criteria.

• Health, Dental, Vision benefits start on your first day at Spring. You and your dependents also receive access to One Medical accounts HSA and FSA plans are also available, with Spring contributing up to $1K for HSAs, depending on your plan type.
• Employer sponsored 401(k) match of up to 2% for retirement planning
• A yearly allotment of no cost visits to the Spring Health network of therapists, coaches, and medication management providers for you and your dependents.
• We offer competitive paid time off policies including vacation, sick leave and company holidays.
• At 6 months tenure with Spring, we offer parental leave of 18 weeks for birthing parents and 16 weeks for non-birthing parents.
• Access to Noom, a weight management program—based in psychology, that’s tailored to your unique needs and goals. 
• Access to fertility care support through Carrot, in addition to $4,000 reimbursement for related fertility expenses.
• Access to Wellhub,  which connects employees to the best options for fitness, mindfulness, nutrition, and sleep in one subscription
• Access to BrightHorizons, which provides sponsored child care, back-up care, and elder care
• Up to $1,000 Professional Development Reimbursement a year.
• $200 per year donation matching to support your favorite causes.