Solo.io Logo

Solo.io

Senior AI Software Engineer

Reposted 12 Days Ago
Remote
Hiring Remotely in US
Senior level
Remote
Hiring Remotely in US
Senior level
The role involves delivering solutions to technical problems, optimizing APIs, transforming requirements into tasks, mentoring, and participating in hiring.
The summary above was generated by AI

Who we are.

Solo empowers teams to build and scale their AI infrastructure using cloud-native tech. Most companies have shifted from asking 'How can we make AI useful?' and are instead now asking 'How do we take our AI projects to production?'. A recent MIT study reveals a shocking 95% of GenAI projects never make it there or fail to deliver positive ROI. At Solo, our AI initiatives are helping teams bridge that gap from pilot to production.

With our roots in critical cloud infrastructure (gateways, proxies, service mesh) trusted by Fortune 500s, Solo is uniquely positioned to lead AI's next wave. As a nimble startup, we innovate faster, our engineers contribute to high-impact OSS (we're a top CNCF contributor) and solve real scalability challenges.

Solo is a VC-backed company, founded in 2017 by Idit Levine. In 2021, Solo was valued at $1B. Solo’s customers are some of the largest in the world, spanning all geographies and industries. Solo’s team has deep expertise in Cloud Computing, Linux, Containers, Kubernetes, Service Mesh, APIs, AI, Security, Networking, Microservice Applications and Infrastructure Modernization.

About the role.

This role will have opportunities to contribute to both our cloud networking stack and our AI products, as the line between the two is beginning to fade. Dive into OSS projects like kagent (kagent.dev) for Kubernetes-based AI orchestration, agentgateway (agentgateway.dev) which redefines proxies for AI workflows, and kgateway (kgateway.dev), our CNCF project handling billions of API calls. All of these projects integrate seamlessly with Istio’s Ambient Mesh (ambientmesh.io), a sidecar-less mesh pioneered by Solo to make service meshes easy and resource-efficient - driving a massive surge in adoption. You will have chances to work with customers, contribute to open source, and shape the future of AI infrastructure. 

You will work with the latest cloud and container technologies like Kubernetes, Envoy, and Istio - as well as with AI tooling, protocols and standards like MCP, A2A and more! You will review customer feedback in order to promote adoption and simplify usability of complex technology.

This is a remote role for applicants based in the US. Unfortunately we are unable to sponsor work visas for this role at this time.

Job Description:

  • Deliver high-quality solutions to the complex technical problems our customers are facing.
  • Manage and optimize our APIs within the ever-evolving landscape of cloud-native environments, maintaining a seamless user experience.
  • Transform ambiguous requirements into actionable tasks, focusing on high-impact deliverables that provide the most value for our users.
  • Challenge the status quo by proposing ambitious and innovative solutions, driving our product forward.
  • Introduce and uphold best practices to ensure the health and maintainability of our codebase.
  • Act as a mentor and guide, offering constructive feedback during code and design reviews to foster growth within the team.
  • Participate in the hiring process, helping identify and recruit top talent so that our engineering team can continue to scale successfully.

Job Requirements:

  • 5+ years of experience as a software engineer
  • 2+ years working with Containers, Kubernetes, and Golang
  • Experienced in building server side software in production and recognizes the challenges, complexities and tradeoffs to be made when building and deploying new systems to production.

Bonus Experience

  • Istio or other service mesh platforms
  • Worked directly on a proxy before, such as Envoy Proxy
  • Having built k8s controllers and operators
  • Worked with Agentic frameworks and protocols such as, ADK, MCP, A2A
  • Experience working with GlooShot
  • Implemented or used the kubernetes gateway API

What you’ll love about Solo.

At Solo, our culture is all about hiring great people, creating a fun and fast-paced work culture, and letting our teams work with our customers to successfully solve their challenges.

Solo works collaboratively with our customers, partners and open source communities to deliver technology innovation, technology solutions, architectural best-practices, and hands-on education. Solo uses a unique engagement model with our customers that allows us to quickly make them successful, and continue to work closely with them as their production environments grow.


Solo is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.

Similar Jobs

Yesterday
Easy Apply
Remote
USA
Easy Apply
186K-219K Annually
Senior level
186K-219K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Design and deliver LLM-powered agentic systems to automate customer support and compliance. Build scalable, secure backend infrastructure (Python/Go), model integration pipelines, grounding and guardrail mechanisms, monitoring, and measurement frameworks. Drive end-to-end AI projects, partner with cross-functional teams, lead code reviews, mentor engineers, and participate in on-call and incident response.
Top Skills: Agentic Ai FrameworksDockerGoLlmsModel ApisMongoDBPostgresPrompt EngineeringPythonRetrieval-Augmented Generation (Rag)
6 Days Ago
Remote or Hybrid
201K-352K Annually
Senior level
201K-352K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design, build, and operate production-grade agentic AI systems: multi-agent orchestration, enterprise-grounded reasoning using CMDB/Knowledge Graph, retrieval/RAG pipelines, model integration with frontier SDKs, and trust/safety/governance. Lead architecture, code quality, and mentor engineers for scalable, safe autonomous agents.
Top Skills: AnthropicC++CmdbGoGoogle (Ai Sdks)Hybrid SearchInference OptimizationJavaKnowledge GraphLlm Fine-TuningMlopsModel ObservabilityOpenaiPrompt EngineeringPythonRagRe-RankingRetrieval Evaluation MetricsVector StoresWorkflow Data Fabric
7 Days Ago
Easy Apply
Remote
USA
Easy Apply
Senior level
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Build and operate Coinbase's LLM and agent platform: unified model gateway, AI Hub, secure microVM agent runtime, knowledge base integrations, AI FinOps, observability and evaluation tooling, and production-grade agent deployments with teams across the company.
Top Skills: Ai AgentsAuthenticationAWSCloud ProvidersFine-TuningFinopsKnowledge BasesLlmsMicrovmsObservabilityPii RedactionTracingVector Stores

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account