idler is a frontier data research lab. We build the evals and environments that the world's leading frontier labs use to measure and train their models.
After raising a $9m seed round led by Paradigm, we spent the last year developing coding evals for top coding models you know and love. At the same time, we've expanded into other domains besides coding: RSI & Auto-Research, Law, Enterprise Business, Cybersecurity, and others. Now, we are facing more lab demand for our data than we can serve, and are rapidly scaling the team to grow the business.
Our approach to creating training data scales using technology, and all of our data products are built on a unified self-reinforcing platform that learns through experience.
You would be joining a close-knit team that has reached product market fit, and your work would directly help to multiply our revenue.
You can see some of our work here: https://idler.ai/collections
About the RoleForward Deployed Engineers are heavily customer and partner-facing technical experts who own the entire system that turns our partners’ real work into evals & RL environments.
You’ll work directly with researchers at top AI labs to understand how they measure and train their models, identifying capability gaps and proposing what we should build next. You’ll establish and maintain partnerships with leaders of companies, civil institutions, and research labs, and you’ll build reusable, robust technical infrastructure to model entire organizations’ workflows to a high degree of precision.
This role combines hands-on technical work, customer & partner management, and rapid execution. You'll switch context frequently and stay ahead of issues before they become blockers. You're expected to employ sophisticated systems-level thinking, make sound judgment calls, and take ownership of outcomes.
In this role, you will:
Own the end to end product pipeline — you will maintain a clear, complete model of customer demand and partnership opportunities, and you will directly shape our product roadmap.
Manage both the technical AND relational sides of the customer and partner lifecycles — you will build the tooling you need to manage relationships successfully, while also advocating for customers’ and partners’ needs with the rest of the team.
Build systems rather than one-off solutions — every customer or partner onboarding should be easier than the last because you built the tooling that made it so.
What we value
Customer & partner empathy — you enjoy the process of understanding what people want, and you come up with creative and repeatable ways to create win-win scenarios.
Grit, coupled with good judgement — you’re comfortable operating in ambiguous, high-intensity environments. You’re independent and resourceful, but you know when you should ask for help before acting.
Meticulous attention to detail — you would rather find and fix the problems in your work than let someone else discover them for you.
Ownership mindset — you take responsibility for results, not just tasks.
Global curiosity — you explore far beyond your scope, and you easily make connections between topics which are not obviously related.
Requirements
Strong engineering foundation from a rigorous technical environment.
Advanced in at least one modern programming language (Python, TypeScript, or similar), with experience writing and debugging production systems.
Extraordinary literacy, as evidenced by written and verbal communication. You can hold your own with senior researchers and non-technical executives alike.
A track record of exceptional performance in whatever you've pursued — academic, athletic, professional, or entrepreneurial.
A high tolerance for ambiguity, intensity, and sustained effort when the problem demands it.
Willingness to travel.
You might excel if you…
Have worked at an early-stage startup, or in a role where you operated well beyond your job description.
Learn quickly by being embedded in challenging, real-world environments.
Have thought seriously about starting your own company.
In-person in San Francisco
Competitive salary + meaningful equity
Free meals in office
Healthcare, 401(k), 15 days of PTO per year
Relocation assistance
Small, ambitious team
This is an in-person role in San Francisco. We're a tight-knit founding team and we play to win. Join us if you like to win too.
Similar Jobs at Idler
What you need to know about the Los Angeles Tech Scene
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
