Staff Software Engineer, Spark

Business Area:

Seniority Level:

Job Description: 

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry.  Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we are the preferred data partner for top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

Cloudera Data Engineering is the next-generation cloud-native service that helps our customers run large-scale data engineering workflows made up of industry-standard big data processing frameworks like Apache Spark and Apache Airflow with just a few clicks, across both on-premises and public cloud environments.

We are seeking a Staff Engineer with a strong technical background in Spark to lead the Cloudera Data Engineering Spark experience for all customers using Cloudera Data Services, Machine Learning services, and more. This high-impact IC role offers the opportunity to shape the future of Cloudera’s Spark space across multiple cloud environments, impacting thousands of customers worldwide.

As a Staff Engineer in the Cloudera Data Engineering space, you will:

• Gain deep technical knowledge across the Cloudera Data Engineering Experience stack, with a strong focus on Spark, and apply this expertise in your daily work.

• Build new features and improve Spark scale and performance to deliver a seamless experience for Cloudera’s data engineering customers.

• Work with a team of talented Spark and infrastructure engineers. Help hire and mentor engineers while supporting their career growth.

• Drive architecture and design discussions, providing strong technical direction for the team.

• Collaborate with product, engineering, and cross-functional partners, leading the delivery of several large, critical features in Cloudera’s Spark space.

• Work on large-scale distributed systems, ranging from hundreds to thousands of nodes in production clusters.

• Bring passion for programming, clean coding practices, attention to detail, and a strong focus on quality.

We are excited about you if you have (Required Experience):

• BE, MS, or Ph.D. in Computer Science or equivalent experience.

• 5+ years of experience as a software engineer building infrastructure systems.

• Experience developing Apache Spark or related technologies.

• Experience as a technical lead, from proposing new features to coordinating work across team members through product delivery.

• Ability to drive architecture and design discussions and provide technical direction.

• Strong understanding of at least one of the following languages: Java, Scala, Rust, C++, or Python.

• Excellent collaboration and communication skills.

You might also have…

• Experience with one of the public clouds (AWS, Azure, GCP) and/or private cloud platforms (OpenShift, Rancher).

• Experience with concurrent and distributed systems, especially on the JVM.

• Experience building and maintaining containerized applications on Kubernetes.

• Contributions to open-source projects.

Why this role matters:

This is your opportunity to build cloud-native solutions that are deployable anywhere whether in massive clusters on any cloud provider or in private data centers. You’ll work with cutting-edge technologies like Trino, Spark, Airflow, and advanced AI inferencing systems to shape the future of analytics. Your code will directly influence how data engineers, analysts, and developers worldwide find value in their data.

We believe in the power of open source. You’ll collaborate with project committers, contributing upstream to keep technologies like Apache Hive and Impala evolving. You’ll harden these engines for rock-solid security, optimize them for peak performance, and make them effortlessly run across all environments.  Join us and help build the trusted, cloud-native platform that powers insights for the most data-intensive companies on the planet.

This role is not eligible for immigration sponsorship or relocation.

The anticipated annual base salary range for this position is:

• California: $164,000- $210,000

Individual compensation within the published range is determined by the candidate's skills, experience, qualifications, and primary work location. In addition to base pay, sales roles are eligible for Cloudera's commission plan, while non-sales roles are eligible for the corporate incentive plan. All employees receive a comprehensive benefits package.

What you can expect from us:

• Generous PTO Policy 

• Support work life balance with Unplugged Days

• Flexible WFH Policy 

• Mental & Physical Wellness programs 

• Phone and Internet Reimbursement program 

• Access to Continued Career Development 

• Comprehensive Benefits and Competitive Packages 

• Paid Volunteer Time

• Employee Resource Groups

EEO/VEVRAA

#LI-BV1

#LI-REMOTE