Design, build, and maintain a scalable internal LLM agent framework and backend services in Python. Ensure observability and reliability via metrics, tracing, and monitoring. Collaborate with ML/NLP teams to adapt the framework for customers, build automated LLM evaluation pipelines, and support integrations and parallel processing for production systems.
Description
We are now expanding our team and are looking for a skilled, goal-oriented backend developer to help us grow. You'll work on services, APIs, databases, and integrations with external systems, collaborating closely with a small, hands-on, technically strong team that moves fast and makes decisions without unnecessary bureaucracy.
Requirements- 6+ years of production experience with Python
- At least 2 years of hands-on experience with async Python (FastAPI, aiohttp, or similar frameworks) in production
- Ability to debug issues across service boundaries
- Comfortable working with partially defined tasks and evolving requirements
- Ready to work in a fast-changing, high-uncertainty environment
- Open to using AI tools in daily development and troubleshooting
Nice to have:
- Experience with AI Tracing Tools like LangSmith
- Develop and maintain the internal LLM agent framework with focus on scalability, processing, and parallelism
- Ensure system observability and reliability using metrics, tracing and monitoring tools
- Adapt the framework for specific customer use cases and collaborate closely with ML/NLP teams
- Build and support automated LLM evaluation pipelines
- Design backend services using Python () and modern cloud-native architecture.
- The team has built award-winning AI products for tech corporations: devices, voice assistants, products that are actually in the world
- Cutting-edge tech stack: Speech Technologies, NLP, Generative AI (LLMs, diffusion models), voice-first agentic architecture with privacy-first and on-premises deployment
- High engineering bar and real ownership: the team cares about what actually works in production, not what looks good in a demo, and you'll see the impact of your work directly
- Fast career progression: a senior-heavy team and a high volume of real problems means you grow faster than you would anywhere else
- Startup pace with enterprise stability: real clients, real revenue, no bureaucracy
- Fully remote across Europe
- 21 vacation days + public holidays + 5 sick days
- Private English lessons via Preply
- Company-paid subscriptions to top AI tools (ChatGPT, Claude, Cursor, and others)
Similar Jobs
Software
Lead ownership of major backend subsystems, design scalable APIs and architectures, improve reliability, mentor engineers, drive cross-team technical initiatives, contribute hands-on to codebase, and support production stability and CI/CD practices.
Top Skills:
Ai/Ml ServicesAWSCi/CdNoSQLPineconePostgresQdrantRedisRubyRuby On RailsSidekiqVector DatabasesWeaviate
Machine Learning • Software • Database
Design and implement execution primitives for AI/agent workflows in Kestra's Java core, build and maintain plugins to connect LLM providers and agent frameworks, convert agent use cases into reusable blueprints with product, and ensure AI executions are observable, debuggable, correct, and reliable.
Top Skills:
AWSAzureBootstrapDockerElasticsearchGCPGitGithub ActionsJavaKafkaKubernetesLangchain4JMicronautMySQLPostgresTerraformVue
Artificial Intelligence • Software • Generative AI
Design, build, and maintain scalable backend services that deliver ML-enriched product attributes and badges. Develop high-throughput, low-latency APIs and manage a dedicated database, CI/CD pipelines, observability, and tests. Collaborate with ML engineers and cross-functional teams to ensure reliability, performance, and availability for downstream systems and customer dashboards.
Top Skills:
AWSAws CloudwatchCachingGithub ActionsGoGrafanaJenkinsNoSQLPagerdutyPrometheusPytestPythonRelational DatabasesRustUnittest
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
