Deepgram Logo

Deepgram

Network Engineer, Real-Time Infrastructure

Reposted 7 Days Ago
Remote
Hiring Remotely in USA
160K-220K Annually
Senior level
Remote
Hiring Remotely in USA
160K-220K Annually
Senior level
As a Network Engineer at Deepgram, you'll optimize global network infrastructure for real-time audio streaming, focusing on latency reduction across hybrid cloud and on-premises environments.
The summary above was generated by AI
Company Overview

Deepgram is the leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time APIs for speech-to-text (STT), text-to-speech (TTS), and building production-grade voice agents at scale. More than 200,000 developers and 1,300+ organizations build voice offerings that are ‘Powered by Deepgram’, including Twilio, Cloudflare, Sierra, Decagon, Vapi, Daily, Cresta, Granola, and Jack in the Box. Deepgram’s voice-native foundation models are accessed through cloud APIs or as self-hosted and on-premises software, with unmatched accuracy, low latency, and cost efficiency. Backed by a recent Series C led by leading global investors and strategic partners, Deepgram has processed over 50,000 years of audio and transcribed more than 1 trillion words. There is no organization in the world that understands voice better than Deepgram.

Company Operating Rhythm

At Deepgram, we expect an AI-first mindset—AI use and comfort aren’t optional, they’re core to how we operate, innovate, and measure performance.

Every team member who works at Deepgram is expected to actively use and experiment with advanced AI tools, and even build your own into your everyday work. We measure how effectively AI is applied to deliver results, and consistent, creative use of the latest AI capabilities is key to success here. Candidates should be comfortable adopting new models and modes quickly, integrating AI into their workflows, and continuously pushing the boundaries of what these technologies can do.

Additionally, we move at the pace of AI. Change is rapid, and you can expect your day-to-day work to evolve just as quickly. This may not be the right role if you’re not excited to experiment, adapt, think on your feet, and learn constantly, or if you’re seeking something highly prescriptive with a traditional 9-to-5.

The Opportunity

When a developer calls Deepgram's API to transcribe a phone call in real time or generate speech for a voice agent, every millisecond of network latency matters. As a Network Engineer at Deepgram, you will own the global network infrastructure that makes real-time voice AI possible at scale. You will optimize traffic routing across our hybrid cloud and bare metal footprint, design edge strategies that bring compute closer to users, and ensure that Deepgram's platform delivers the ultra-low-latency experience our customers depend on. This role fills a critical skill gap on our infrastructure team and gives you the opportunity to shape network strategy from the ground up.

What You'll Do
  • Architect and optimize Deepgram's global network for real-time audio streaming, minimizing latency across geographic regions

  • Design and manage CDN and edge computing strategies to bring processing closer to end users

  • Configure and maintain BGP routing, including peering relationships and route optimization for multi-cloud and bare metal environments

  • Implement and tune load balancing solutions that intelligently distribute traffic across heterogeneous infrastructure (cloud, bare metal, GPU clusters)

  • Build and optimize multi-cloud networking architectures spanning AWS, other cloud providers, and on-premises data centers

  • Design and maintain bare metal networking including top-of-rack switching, spine-leaf architectures, and high-bandwidth GPU interconnects

  • Develop latency measurement, monitoring, and optimization tooling to continuously improve network performance

  • Plan and execute network capacity expansions as Deepgram's traffic and infrastructure footprint grow

  • Collaborate with infrastructure and platform teams to ensure network designs support both real-time inference and large-scale training workloads

  • Establish network security best practices including segmentation, DDoS mitigation, and access control policies

You'll Love This Role If You
  • Are passionate about squeezing every millisecond of latency out of a network path

  • Want to design global network infrastructure for a platform that processes real-time audio at massive scale

  • Enjoy the challenge of networking across hybrid environments -- cloud, bare metal, and edge

  • Like working on problems where network performance directly impacts product quality and customer experience

  • Want to build network strategy and architecture from the ground up, not just maintain what already exists

  • Are excited about the unique networking challenges that come with GPU clusters and AI/ML workloads

It's Important To Us That You Have
  • 5+ years of experience in network engineering, including design, implementation, and operations

  • Deep expertise with BGP, OSPF, and other dynamic routing protocols in production environments

  • Hands-on experience designing and operating load balancing solutions at scale

  • Strong understanding of CDN architectures and content delivery optimization

  • Experience with cloud networking, specifically AWS VPC design, transit gateways, peering, and hybrid connectivity

  • Practical experience with bare metal networking -- switch configuration, VLAN design, physical infrastructure

  • Solid understanding of TCP/IP, DNS, TLS, and HTTP/2 / HTTP/3 performance optimization

  • Experience with network monitoring, troubleshooting, and performance analysis tools

It Would Be Great if You Had
  • Experience with real-time streaming protocols (WebSocket, WebRTC, RTP/RTSP) and optimizing networks for media traffic

  • Knowledge of GPU cluster networking including InfiniBand, RoCE (RDMA over Converged Ethernet), and high-bandwidth interconnects

  • Experience with multi-cloud networking spanning AWS, GCP, and/or Azure

  • Familiarity with network automation and Infrastructure as Code (Ansible, Terraform, or similar)

  • Experience with anycast routing and global traffic management

  • Background in network performance optimization for latency-sensitive applications

  • Understanding of DDoS mitigation strategies and network security at scale

Similar Jobs at Deepgram

3 Hours Ago
Remote
USA
153K-210K Annually
Senior level
153K-210K Annually
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Lead corporate communications strategy and execution: own product and model launches, media and executive communications, narratives, social presence, and major company moments. Translate technical research and product advances into compelling stories for developers, enterprise buyers, partners, and analysts. Partner cross-functionally with CEO, CMO, product, brand, and demand gen to build credibility and influence in the voice AI ecosystem.
Top Skills: APIsDeveloper ToolingMachine LearningSpeech-To-Text (Stt)Text-To-Speech (Tts)Voice Ai
3 Hours Ago
Remote
USA
Expert/Leader
Expert/Leader
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Lead and build Deepgram's AI enablement function: prototype and ship reusable agents, MCP servers, paved-road workflows, prompt and retrieval patterns, and an enablement hub. Drive company-wide AI adoption with measurable productivity metrics, embed safe-use guardrails, partner across Platform, Security, Data, and People Ops, and grow a central team and distributed champions network.
Top Skills: Agent Orchestration FrameworksAgentsCloud ApisFoundation ModelsGleanLlmsMcp ServersNotion AiPromptingRetrieval (Rag)Self-Hosted/On-Prem SoftwareSpeech-To-Text (Stt)Text-To-Speech (Tts)
3 Hours Ago
Remote
USA
152K-190K Annually
Senior level
152K-190K Annually
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Lead end-to-end delivery of ML infrastructure and AI tooling programs, defining architecture and rollout strategies for training, serving, and monitoring. Coordinate research, engineering, product, and data teams to optimize inference cost/latency, build internal tools for experiment tracking and model versioning, and resolve bottlenecks to enable faster, scalable ML deployments.
Top Skills: Aws SagemakerAzure MlBatching StrategiesCudaDistillationDvcFeature StoresGcp Vertex AiHugging FaceKv-Cache OptimizationMlflowPyTorchQuantizationTensorrtTorchserveVector DatabasesVllmWeights & Biases

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account