ZipRecruiter Logo

ZipRecruiter

Software Engineer, Big Data

Posted One Month Ago
Remote
Hiring Remotely in USA
130K-175K Annually
Junior
Remote
Hiring Remotely in USA
130K-175K Annually
Junior
Build scalable data processing and exploration pipelines, ML infrastructure, and cloud-based applications. Write, test, instrument, and deploy software in Kubernetes environments while contributing to distributed systems and data-driven products. The role focuses on Python, big data technologies, containerization, and systems supporting marketplace intelligence.
The summary above was generated by AI

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission: 

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary:

Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We’re working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.

Our stack is complex and we’re looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We’re working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people’s lives.

Responsibilities:

  • Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
  • Deploy a range of cloud-based technologies for critical projects
  • Write, test, instrument, and deploy code to our Kubernetes environment
  • Help drive the innovation and evolution of ZipRecruiter

Minimum Qualifications:

  • 2+ years of professional software development experience with a focus on Python and big data technologies
  • Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

  • 4+ years of professional software development experience, with a focus on Python and big data technologies
  • BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
  • Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

As part of our team you’ll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $130,000-$175,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: https://www.ziprecruiter.com/careers/job-applicant-privacy-notice

HQ

ZipRecruiter Santa Monica, California, USA Office

604 Arizona Avenue, Santa Monica, CA, United States, 90401

ZipRecruiter Los Angeles, California, USA Office

Los Angeles, United States

Similar Jobs

One Month Ago
Remote or Hybrid
177K-365K Annually
Senior level
177K-365K Annually
Senior level
Social Media
Lead design and implementation of Pinterest's exabyte-scale data lake storage and metadata systems. Drive architecture and execution for scalable storage features supporting large ML/AI workloads, collaborate across data/ML/infrastructure teams, and contribute to open-source projects (Iceberg, Spark, Flink).
Top Skills: Apache FlinkApache HiveApache IcebergSparkJavaPrestoPythonScalaTrino
2 Months Ago
In-Office or Remote
177K-365K Annually
Senior level
177K-365K Annually
Senior level
AdTech • Marketing Tech
Lead design and implementation of identity resolution and data governance systems. Build batch and streaming pipelines, APIs, and services to ingest, normalize, link, and version identity data. Ensure auditable matching, data lineage, quality checks, schema enforcement, access controls, and privacy-by-design. Collaborate cross-functionally with product, analytics, legal, privacy, and security teams and create documentation, monitoring, and runbooks.
Top Skills: SparkAPIsAWSBatch And Streaming Data PipelinesCloud Data WarehouseData LakeScalaStorage Formats
2 Months Ago
In-Office or Remote
124K-255K Annually
Senior level
124K-255K Annually
Senior level
AdTech • Marketing Tech
Design and implement scalable data infrastructure and pipelines on AWS using Spark and Scala. Build fault-tolerant batch and streaming workflows, optimize storage formats and engines, enforce automated data quality checks, and collaborate with Data Science and Product teams to deliver reliable data assets and APIs.
Top Skills: AWSBatch ProcessingCloud Data WarehousesData LakesScalaSparkSQLStreaming Pipelines

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account