Boson AI Logo

Boson AI

Software Engineer - Platform & Application

Reposted 6 Days Ago
In-Office
Santa Clara, CA
150K-270K Annually
Junior
In-Office
Santa Clara, CA
150K-270K Annually
Junior
Build and operate the core platform for Boson AI's model APIs and agentic products: API serving, state management, distributed services, data pipelines, SDKs, retrieval and caching, observability, and integrations with ML and product teams. Grow ownership under senior mentorship while shipping production features.
The summary above was generated by AI

About Boson AI: At Boson AI, we are not just building AI solutions; we are pioneering the future of enterprise AI. Driven by a passion for cutting-edge AI research, particularly in the transformative areas of large language models and agentic systems, our mission is to tackle the most complex real-world problems for businesses and unlock significant value. We are a dynamic and collaborative team of researchers and engineers who thrive on pushing the boundaries of what's possible, dedicated to delivering high-quality, reliable products that seamlessly integrate into the fabric of enterprise workflows and set new industry standards.

About the Role: Help build and operate the core platform behind Boson's model APIs and agentic products. You'll work alongside senior engineers on the infrastructure that every Boson agent runs on — API serving, state management, data pipelines, context retrieval, and execution runtime — shipping real features while growing into deeper ownership over time. This is a role for someone early in their career who wants to learn distributed systems by building them, with strong mentorship and meaningful production responsibility from day one.

Responsibilities

  • Contribute to the core platform infrastructure: the API serving layer, state management, policy enforcement, and execution runtime for agentic workflows — starting with well-scoped components and taking on broader ownership as you grow.
  • Help build and maintain distributed services that back our model API products, including request routing, rate limiting, and multi-tenant isolation, under the guidance of senior engineers.
  • Build and maintain pieces of our data pipelines (ETL/ELT) for API logs, usage analytics, and billing, with a focus on data correctness and freshness.
  • Develop and improve internal SDKs and libraries — writing clean, well-tested code with clear contracts that product teams can rely on.
  • Support our context and memory systems for conversational workloads: retrieval, caching, and integration with vector stores and retrieval pipelines.
  • Add observability across the platform — structured logging, tracing, and metrics — and help investigate and resolve reliability issues.
  • Collaborate with ML and product teams to integrate model serving, voice runtime, and tooling infrastructure, learning how the full stack fits together.

Qualifications

  • 0–2 years of professional software engineering experience (internships, co-ops, and strong personal or open-source projects count), or a recent CS degree with equivalent hands-on work.
  • Solid programming fundamentals and a genuine interest in backend and distributed systems — you understand concepts like concurrency and fault tolerance and are eager to apply them in production.
  • Some exposure to building backend services, APIs, or data processing — through work, coursework, or projects.
  • Proficiency in at least one language such as Python, Go, Java, Rust, or C++, and a willingness to pick up new ones.
  • Familiarity with the basics of cloud infrastructure (AWS/GCP), containers (Docker/K8s), version control, and CI/CD — or clear enthusiasm to learn them quickly.
  • Curiosity, strong communication, and a collaborative mindset — you ask good questions, welcome feedback, and want to grow.

Bonus points

  • Coursework, projects, or internship experience touching LLM serving, retrieval, or agentic systems.
  • Exposure to data pipeline tools (Kafka/Kinesis, Spark/Flink, Airflow) or agent frameworks.
  • Experience with real-time media (audio/video streaming) or any latency-sensitive system.
  • A track record of shipping something end-to-end — a side project, a hackathon build, or an open-source contribution you're proud of.

Similar Jobs

6 Days Ago
Hybrid
153K-376K Annually
Senior level
153K-376K Annually
Senior level
Productivity • Professional Services • Software • Design
Build and evolve shared Ruby frameworks and backend systems powering Figmas REST APIs, async jobs, and workflow orchestration. Improve availability, scalability, performance, developer tooling, CI, and observability while modernizing a large Ruby codebase and partnering with product engineers to create reusable platform capabilities. Mentor teammates and establish shared libraries, APIs, documentation, and best practices.
Top Skills: Aws EksAws SqsKubernetesRuby on RailsRubySinatraTemporalTerraform
11 Days Ago
In-Office or Remote
300K-300K Annually
Senior level
300K-300K Annually
Senior level
Software • Analytics • Business Intelligence
The Senior Engineer will build and operate backend systems for AI agents, design APIs, optimize performance, and uphold engineering standards to ensure platform reliability and scalability.
Top Skills: AIPostgresPythonSQL ServerTypescript
22-33 Hourly
Junior
Fintech • Real Estate • Sales • Financial Services
Manage the escrow/closing process remotely: communicate with agents, buyers, sellers and third parties; open orders; review contracts and verify transaction details; order/payoff items and follow up; explain settlement and title insurance; ensure timely delivery of funds and provide excellent customer service throughout closing.
Top Skills: Qualia

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account