Metal Toad Logo

Metal Toad

Data Infrastructure Engineer

Posted Yesterday
In-Office or Remote
Hiring Remotely in Portland, OR
Senior level
In-Office or Remote
Hiring Remotely in Portland, OR
Senior level
Design, deploy, and operate open-source data infrastructure (Trino, Spark, Pinot, Druid) on Amazon EKS. Build production-ready, scalable platforms using IaC (Terraform, Helm), Docker, and Karpenter. Maintain hands-on infrastructure-as-code, troubleshoot complex customer environments, and deliver novel, high-risk solutions as a subject-matter expert.
The summary above was generated by AI

About Metal Toad

Metal Toad is an Advanced AWS Consulting Partner that empowers organizations to innovate through artificial intelligence, cloud migration, cost optimization, and application modernization. We help our customers with their cloud adoption by providing architecture, migration, optimization, machine learning, and even 24/7 support. We are a professional services firm providing services in software engineering and the cloud. We do Technical consulting, Programming & Quality Assurance, DevOps, Applications, UX, Product management, and Project management.

To apply for this position, please submit your resume in English as a PDF.

Job Description

We are looking for a highly technical, hands-on Data Infrastructure Engineer to join our team. This is not a standard Data Engineering role; instead, you will focus on building robust, scalable Data Infrastructure platforms using Open Source software. Your primary mission is to deploy and manage high-performance data technologies—such as Apache Pinot, Apache Druid, and Trino—within a well-architected Amazon EKS environment.

You will work on pioneering, high-risk technical solutions, navigating complex customer environments to deliver cutting-edge infrastructure that pushes the boundaries of standard implementations.

Responsibilities

Key Responsibilities

  • Infrastructure Implementation: Architect and deploy Open Source Data OSS (Trino, Spark, Pinot, Druid) on Amazon EKS.
  • Hands-on Development: Maintain a 100% hands-on approach, utilizing IDEs, Git, and strict coding best practices to manage infrastructure as code.
  • Problem Solving: Navigate complex customer hierarchies and technical landscapes to identify, propose, and implement bespoke solutions.
  • Pioneering Work: Design and implement novel, high-risk solutions that have not been previously established.
  • Collaboration: Act as a subject-matter expert in Open Source technologies, ensuring all builds are well-architected and production-ready.

QUALIFICATIONS REQUIRED

  • Agree with our
    Corporate Values Statement.
  • Believes in the company's mission: to help people.
  • Believes in the principles of open source.
  • Advanced to fluent English communication skills are essential for this role.
  • Kubernetes/EKS: Deep expertise in Kubernetes and Amazon EKS is a must-have.
  • Core Infrastructure Tooling: Proficiency in Terraform, Helm, Docker, and Karpenter.
  • Data OSS Expertise: Minimum rating of 3 (on a 5-point scale) in deploying and managing Data OSS software, including Trino, Spark, or Pinot.
  • Data Foundations: Strong familiarity with Data Lakes, Spark, and Hive architectures.
  • Versatility: A demonstrated willingness to work with non-AWS and broad Open Source ecosystems.
  • Soft Skills: High comfort level engaging with complex customer environments and an aptitude for high-stakes technical troubleshooting.

NICE TO HAVE

  • Prior hands-on experience working with Fruitstand.
  • Demonstrated history of contributing to or managing complex open-source projects in production environments.

Metal Toad Los Angeles, California, USA Office

1925 Century Park E, Los Angeles, CA, United States, 90067

Similar Jobs

Yesterday
In-Office or Remote
Mid level
Mid level
Cloud • Information Technology
Build and operate scalable open-source data infrastructure on AWS EKS. Deploy and manage technologies like Trino, Spark, Pinot, and Druid using IaC tools, maintain hands-on development practices, design novel solutions, and collaborate with customers to deliver production-ready architectures.
Top Skills: Amazon EksApache DruidApache PinotSparkData LakeDockerGitHelmHiveIdesKarpenterKubernetesTerraformTrino
Yesterday
In-Office or Remote
Mid level
Mid level
Cloud • Information Technology
Design, deploy, and operate open-source data infrastructure (Trino, Spark, Pinot, Druid) on Amazon EKS. Build production-ready platforms using Terraform, Helm, Docker, and Karpenter. Maintain infrastructure-as-code, troubleshoot complex customer environments, and deliver novel, high-risk solutions as an open-source subject-matter expert.
Top Skills: Amazon EksApache DruidApache PinotData LakesDockerFruitstandGitHelmHiveIdesKarpenterKubernetesSparkTerraformTrino
Yesterday
Remote
USA
466K-750K Annually
Senior level
466K-750K Annually
Senior level
News + Entertainment
Build and operate next-generation ML data and feature infrastructure, including near-real-time feature computation engines, feature stores, and embedding retrieval systems. Scale data processing, storage, and serving for high-throughput training and low-latency inference. Collaborate with ML practitioners and AI Platform teams to improve feature discovery, sharing, and practitioner productivity.
Top Skills: AWSCassandraChrononFlinkIcebergJavaJupyterKafkaPolynotePythonSpark

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account