Runpod Logo

Runpod

Manager, Datacenter Network Engineering

Posted An Hour Ago
Be an Early Applicant
Easy Apply
Remote
Hiring Remotely in USA
150K-240K Annually
Senior level
Easy Apply
Remote
Hiring Remotely in USA
150K-240K Annually
Senior level
Lead the Datacenter Network Engineering team by managing engineers, defining network architecture for GPU-heavy clusters, and ensuring operational excellence across global WAN connectivity.
The summary above was generated by AI

Runpod is pioneering the future of AI and machine learning, offering cutting-edge cloud infrastructure for full‑stack AI applications. Founded in 2022, we are a rapidly growing, well‑funded, remote‑first company with a global team across the US, Canada, and Europe. Our mission is to create a foundational platform that enables developers and companies to build, deploy, and scale custom AI systems with speed and flexibility.

We are looking for an Engineering Manager, Datacenter Network Engineering to lead the team responsible for designing, deploying, and operating Runpod’s global datacenter and backbone network. This role manages engineers working on L2/L3 fabrics, high-performance GPU networking, and global WAN connectivity that underpin our AI platform.

You will lead execution across multiple regions and vendors, while setting technical direction for network architecture that supports massive east-west traffic, low-latency GPU collectives, and secure multi-tenant isolation. This role is hands-on at the architectural level, while focused on team leadership, operational excellence, and scalability.

Responsibilities

  • Lead the Datacenter Networking Team: Manage and grow a team of network engineers responsible for datacenter fabrics, interconnects, and global WAN connectivity. Provide mentorship, technical guidance, and clear ownership boundaries.
  • Own Datacenter Network Architecture: Define and evolve network designs for GPU-heavy clusters, including spine-leaf topologies, ECMP routing, and high-bandwidth east-west traffic patterns.
  • High-Performance GPU Networking: Oversee design and operation of InfiniBand and RoCE-based fabrics supporting distributed training and inference workloads. Ensure performance, loss characteristics, and congestion control meet AI workload requirements.
  • Encapsulation & Overlay Protocols: Guide implementation and operations of encapsulation technologies such as VXLAN, EVPN, Geneve, or similar, enabling scalable multi-tenant isolation and flexible network provisioning.
  • Global WAN & Backbone Connectivity: Lead strategy and execution for global WAN connectivity, including private backbone links, IX connectivity, and hybrid connectivity with cloud providers and partners.
  • Reliability & Operations: Establish operational best practices for monitoring, capacity planning, change management, incident response, and post-mortems across the network stack.
  • Cross-Functional Collaboration: Partner closely with Infrastructure, SRE, Hardware, and Product Engineering teams to ensure network capabilities align with platform and customer requirements.
  • Vendor & Partner Management: Work with hardware vendors, colocation providers, and transit partners on network design, procurement, deployment timelines, and escalations.
  • Security & Segmentation: Ensure network designs support secure isolation, DDoS resilience, and compliance requirements without compromising performance.

Requirements

  • Engineering Leadership Experience: 3+ years managing network or infrastructure engineering teams, with experience scaling teams and systems in production environments.
  • Datacenter Networking Expertise: 8+ years designing and operating large-scale datacenter networks, including spine-leaf architectures, BGP-based routing, and high-throughput fabrics.
  • Encapsulation & Overlays: Strong hands-on experience with VXLAN/EVPN or equivalent encapsulation protocols, including control-plane and data-plane considerations.
  • High-Performance Networking: Proven experience with InfiniBand and/or RoCE, including congestion management, lossless Ethernet concepts, and performance tuning for GPU workloads.
  • Global WAN Experience: Deep familiarity with global WAN technologies, including private backbone design, inter-region connectivity, routing policy, and traffic engineering.
  • Linux & Network OS Fluency: Comfortable working with Linux-based systems, network operating systems, and automation tooling.
  • Operational Excellence: Strong background in network observability, incident management, capacity forecasting, and change control.
  • Communication & Leadership: Clear written and verbal communication skills, with the ability to align stakeholders and lead teams through complex technical challenges.
  • Successful completion of a background check.

Preferred Qualifications

  • Experience operating networks for GPU clusters, HPC environments, or AI/ML platforms.
  • Familiarity with RDMA tuning, NCCL traffic patterns, and distributed training communication models.
  • Experience with automation frameworks and network-as-code (e.g., Terraform, Ansible, internal tooling).
  • Background in multi-region or multi-cloud networking architectures.
  • Experience working in high-growth or hyperscale infrastructure environments.
What You’ll Receive:
  • The competitive base pay for this position ranges from ($150,000 - $240,000). This salary range may be inclusive of several career levels at Runpod and will be narrowed during the interview process based on a number of factors, including the candidate’s experience, qualifications, and location
  • Meaningful equity in a fast-growing company- everyone on the team receives stock options — your impact drives our growth, and you share in the upside.
  • Generous medical, dental & vision plans — we cover 100% for all employees and partial for dependents. 
  • Flexible PTO- take the time you need to recharge
  • Most roles are remote work first with an inclusive, collaborative teams utilizing slack as the main form of internal communication 
  • Join a passionate team on the cutting edge of AI infrastructure — where culture, learning, and ownership are at the heart of how we scale.

Runpod is committed to maintaining a workplace free from discrimination and upholding the principles of equality and respect for all individuals. We believe that diversity in all its forms enhances our team. As an equal opportunity employer, Runpod is committed to creating an inclusive workforce at every level. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, protected veteran status, disability status, or any other characteristic protected by law. We welcome every qualified candidate eligible to work in the United States; however, we are currently unable to sponsor employment visas

Top Skills

Bgp
Evpn
Geneve
Infiniband
L2/L3 Fabrics
Linux
Roce
Vxlan

Similar Jobs at Runpod

An Hour Ago
Easy Apply
Remote
USA
Easy Apply
150K-240K Annually
Senior level
150K-240K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Lead the storage engineering team at Runpod, focusing on distributed storage infrastructure, including SAN and NFS systems for AI workloads. Manage performance, reliability, and scalability while collaborating cross-functionally. Drive innovation in storage technologies and oversee operational excellence.
Top Skills: Gpu Direct StorageLinuxLustreNandNfsNvmePcieRdmaSanVast Data
6 Hours Ago
Easy Apply
Remote
USA
Easy Apply
160K-210K Annually
Mid level
160K-210K Annually
Mid level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
As a Principal Software Engineer, you'll design scalable cloud storage architectures, optimize performance, and collaborate with teams to enhance storage solutions for AI workloads.
Top Skills: 3Par/NimbleBashCCephfsDell EmcGoIbmJavaScriptPure StoragePythonRustTerraformTypescriptVast Data
6 Hours Ago
Easy Apply
Remote
USA
Easy Apply
152K-175K Annually
Senior level
152K-175K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
As a Security Engineer, safeguard Runpod's GPU cloud platform, conduct security assessments, implement fixes, and foster a security-first culture with development teams.
Top Skills: CDockerEdrGoKubernetesLinuxPythonSIEMWaf

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account