LM Studio Logo

LM Studio

OSS SDK Engineer

Posted 10 Days Ago
Be an Early Applicant
In-Office or Remote
2 Locations
175K-275K Annually
Mid level
In-Office or Remote
2 Locations
175K-275K Annually
Mid level
Lead the design and development of Python SDK features, improve CI/CD packaging, optimize performance, and support developer experience.
The summary above was generated by AI
About the role

We are investing heavily in our Python developer experience. As a Python SDK Engineer you’ll design new APIs and programming patterns, improve performance, work on packaging and release automation, and enable many thousands of developers to run customizable AI workloads entirely on-device.

Your work will focus initially on two of our open-source Python projects:

lmstudio-python – our MIT-licensed Python SDK that exposes local chat, completion, embeddings, agentic .act() workflows, model life-cycle management, and more.

venvstacks – a layered-virtual-environment toolchain that lets us ship reproducible Python runtimes and applications (this is how we ship our MLX Engine: https://github.com/lmstudio-ai/mlx-engine).


Key responsibilities

Design & build new Python SDK features — chat, completion, embeddings, agentic workflows, structured output, speculative decoding, multi-GPU settings, and more, always keeping API ergonomics first-class.

Contribute to venvstacks CLI & core library — evolve sub-commands lock, build, publish, local-export), dependency-resolution algorithms, and archive formats for deterministic, multi-layer builds.

Packaging & distribution — collaborate on many-linux, macOS universal2, and Windows wheels; automate CI/CD releases to PyPI and internal artifact stores; keep binary sizes lean.

Performance engineering — profile and optimize token throughput, memory use, streaming latency, and cross-process IPC between the LM Studio daemon and Python clients.

Developer experience & docs — write clear docstrings, Sphinx guides, examples, and blog posts; triage GitHub issues and review community pull requests.

Cross-team collaboration — work daily with desktop-app, TypeScript-SDK, and core-eng teams to ensure consistent behavior across languages and platforms.

Minimum qualifications
  • Passion for local LLMs (you’ve already experimented with LM Studio or similar tools).

  • 3+ years professional Python development, including packaging for PyPI or internal indexes.

  • Solid OS & networking fundamentals (process isolation, sockets/WebSockets, file permissions, GPU drivers).

  • Excellent problem-solving skills and written/spoken communication.

  • Familiarity with Pydantic, asyncio, multiprocessing, and gRPC or HTTP/2 streaming protocols.

  • Prior work on SDKs or CLI developer-tools with public APIs and semantic-versioning discipline.

  • Mastery of Python internals (GIL mechanics, byte-code execution, import system, C-API/PyO3).

Preferred qualifications
  • Proven open-source contributor with a track record of thoughtful PRs, issues, or design docs.

  • Deep understanding of virtual-environment tooling venv, pipx, pdm, pip, wheels) and dependency resolution.

About Element Labs

Element Labs is an AI software company based out of New York, USA. We build LM Studio, a desktop application and developer platform for building on-device AI applications. Our mission is to make local AI accessible, useful, and ubiquitous. We are looking for teammates who want to take a huge swing at this mission with us.

Top Skills

Asyncio
Grpc
Http/2
Multiprocessing
Pydantic
Pypi
Python

Similar Jobs

21 Minutes Ago
Remote or Hybrid
4 Locations
117K-161K Annually
Senior level
117K-161K Annually
Senior level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
The Senior Brand Manager leads innovation initiatives and cross-functional teams to drive brand growth, develop strategies, and manage project execution.
Top Skills: Brand ManagementCommunicationConsumer InsightsMarketingProject Management
31 Minutes Ago
Remote
United States
158K-185K Annually
Mid level
158K-185K Annually
Mid level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
As an Institutional Sales Associate at Coinbase, you will prospect clients, support senior sales efforts, and nurture client relationships to drive growth in the crypto space.
Top Skills: Google SuiteSalesforce
37 Minutes Ago
Remote or Hybrid
United States
160K-185K Annually
Senior level
160K-185K Annually
Senior level
Fintech • Marketing Tech • Professional Services • Financial Services
The Senior Social SEO Manager will develop and execute strategies for optimizing brand content on social platforms and AI-driven search interfaces, ensuring increased discoverability and improved rankings.
Top Skills: AhrefsGoogle Search ConsoleSemrushSocial Analytics PlatformsYoutube Studio

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account