Lead the Workers AI platform team in optimizing model scheduling, routing requests, and enhancing performance using Rust and Typescript. Foster team collaboration and leverage experience in distributed systems and load balancing.
Available Locations: Austin or Lisbon or London (Hybrid)
About the Department
Emerging Technologies & Incubation (ETI) is where new and bold products are built and released within Cloudflare. Rather than being constrained by the structures which make Cloudflare a massively successful business, we are able to leverage them to deliver entirely new tools and products to our customers. Cloudflare's edge and network make it possible to solve problems at massive scale and efficiency which would be impossible for almost any other organization.
About The Team
Workers AI is Cloudflare's AI inference service, enabling customers to use a wide variety of AI models both within Cloudflare's Workers developer platform and via API. The Workers AI team owns the whole stack that powers the product, from front-end development all the way to low-level inference code. Accordingly we're a team with a diverse array of technical skills, but everyone on the team is curious and passionate about the possibilities of generative AI
What You'll Do
The Workers AI platform team is responsible for scheduling models and routing requests to the best model instance to handle it. Our stack is built using Rust and Typescript and takes advantage of Cloudflare's internal container platform. You will lead the team to use quantitative metrics to deliver improved flexibility and performance across the platform. This is a distributed systems role, and you will bring experience and expertise to the team in the areas of load balancing, scheduling, and resource sharing. This is a small team and the ideal candidate is capable of high-level technical contributions as well as team leadership.
This role is based in Austin, Texas and requires at least two days a week in-office.
Examples of desirable skills, knowledge, and experience
Equity
This role is eligible to participate in Cloudflare's equity plan.
Benefits
Cloudflare offers a complete package of benefits and programs to support you and your family. Our benefits programs can help you pay health care expenses, support caregiving, build capital for the future and make life a little easier and fun! The below is a description of our benefits for employees in the United States, and benefits may vary for employees based outside the U.S.
Health & Welfare Benefits
Medical/Rx InsuranceDental InsuranceVision InsuranceFlexible Spending AccountsCommuter Spending AccountsFertility & Family Forming BenefitsOn-demand mental health support and Employee Assistance ProgramGlobal Travel Medical Insurance
Financial Benefits
Short and Long Term Disability InsuranceLife & Accident Insurance401(k) Retirement Savings PlanEmployee Stock Participation Plan
Time Off
Flexible paid time off covering vacation and sick leaveLeave programs, including parental, pregnancy health, medical, and bereavement leave
About the Department
Emerging Technologies & Incubation (ETI) is where new and bold products are built and released within Cloudflare. Rather than being constrained by the structures which make Cloudflare a massively successful business, we are able to leverage them to deliver entirely new tools and products to our customers. Cloudflare's edge and network make it possible to solve problems at massive scale and efficiency which would be impossible for almost any other organization.
About The Team
Workers AI is Cloudflare's AI inference service, enabling customers to use a wide variety of AI models both within Cloudflare's Workers developer platform and via API. The Workers AI team owns the whole stack that powers the product, from front-end development all the way to low-level inference code. Accordingly we're a team with a diverse array of technical skills, but everyone on the team is curious and passionate about the possibilities of generative AI
What You'll Do
The Workers AI platform team is responsible for scheduling models and routing requests to the best model instance to handle it. Our stack is built using Rust and Typescript and takes advantage of Cloudflare's internal container platform. You will lead the team to use quantitative metrics to deliver improved flexibility and performance across the platform. This is a distributed systems role, and you will bring experience and expertise to the team in the areas of load balancing, scheduling, and resource sharing. This is a small team and the ideal candidate is capable of high-level technical contributions as well as team leadership.
This role is based in Austin, Texas and requires at least two days a week in-office.
Examples of desirable skills, knowledge, and experience
- Experience leading high performing teams
- Strong communication skills
- Comfortable with tight deadlines and short release cycles
- Strong systems-level programming skills
- Experience building large-scale distributed systems
- Expert-level knowledge in a modern compiled language like Go, Rust or modern C++
Equity
This role is eligible to participate in Cloudflare's equity plan.
Benefits
Cloudflare offers a complete package of benefits and programs to support you and your family. Our benefits programs can help you pay health care expenses, support caregiving, build capital for the future and make life a little easier and fun! The below is a description of our benefits for employees in the United States, and benefits may vary for employees based outside the U.S.
Health & Welfare Benefits
Medical/Rx InsuranceDental InsuranceVision InsuranceFlexible Spending AccountsCommuter Spending AccountsFertility & Family Forming BenefitsOn-demand mental health support and Employee Assistance ProgramGlobal Travel Medical Insurance
Financial Benefits
Short and Long Term Disability InsuranceLife & Accident Insurance401(k) Retirement Savings PlanEmployee Stock Participation Plan
Time Off
Flexible paid time off covering vacation and sick leaveLeave programs, including parental, pregnancy health, medical, and bereavement leave
Top Skills
Go
Modern C++
Rust
Typescript
Cloudflare Los Angeles, California, USA Office
Los Angeles, CA, United States
Similar Jobs at Cloudflare
Cloud • Information Technology • Security • Software • Cybersecurity
The Office Operations Manager leads daily operations, manages vendor relationships, tracks metrics, supports workplace programs, and ensures safety compliance for a functional workplace.
Top Skills:
Google Workspace
Cloud • Information Technology • Security • Software • Cybersecurity
As a Software Engineer on the Cloudforce One team, you will develop high-performance applications to disrupt cyber threats, collaborating with various teams to meet complex requirements and mentor other developers.
Top Skills:
GoKafkaKubernetesPostgresRedisRustTemporalTerraformTypescript
Cloud • Information Technology • Security • Software • Cybersecurity
Lead engineering efforts for product analytics initiatives, managing data quality and pipeline development while fostering a high-performance team culture.
Top Skills:
Analytics ToolsData PipelinesModern Data StacksWeb Technologies
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
