RE Partners Logo

RE Partners

Data Engineer

Posted Yesterday
Remote
Hiring Remotely in United States
100K-250K Annually
Mid level
Remote
Hiring Remotely in United States
100K-250K Annually
Mid level
Design, build, and operate Spark-based ETL pipelines on AWS. Collaborate with stakeholders to deliver reliable data products, ensure data quality and governance, optimize performance, and maintain operational excellence of the data platform.
The summary above was generated by AI
Hello from RE Partners!

Who We Are: We are a fast growing business and technology consultant company co-founded in 2019.  We offer a custom-tailored, white-glove engineering service fit for our clients, because a digital transformation is more than just technology.  With a successful track record of being a preferred vendor for Fortune 500 companies and as a trusted partner for some of the industry’s leading companies, our global talent has helped many clients achieve their goals. 

The 3 G’s of RE:

“Get Shit Done.”

“Get Over Shit.”

“Give a Shit.”



Data Engineer


What You’ll Do

  • Design and build Spark data ETL pipelines on AWS data platform. 
  • Collaborate with cross functional teams such as data scientists, fraud, marketing and other business stakeholders to understand their data needs and deliver reliable solutions.
  • Optimize data infrastructure - Design and maintain robust data infrastructure by using modern data platform architecture. 
  • Ensure data quality and reliability. 
  • Innovate and follow best practices. 
  • Ensure operational excellence of the data platform, including monitoring, incident response, performance optimization, and continuous improvement.

Who We’re Looking For
(“Must Haves”)

  • Professional experience working in data warehousing, data architecture, and/or data engineering environments, especially using spark, hadoop, hive etc with solid understanding of streaming pipelines.
  • Proficiency in at least one high-level programming language (Scala, Java, Python or equivalent)
  • Good understanding of databases
  • You have built large-scale data products and understand the tradeoffs made when building these features
  • You have a deep understanding of system design, data structures, and algorithms
  • You have an excellent knowledge of distributed computing frameworks such as Hadoop MapReduce, Spark
  • You have a strong knowledge of following AWS infrastructure - EMR, S3, Lambda, Redshift etc
  • You have strong understanding of data quality, governance
  • You are a team player, self-driven, highly motivated individual who loves to learn new things

Join Our Global Team: We invite you to apply for the position at RE Partners. Join us in shaping the future of business technology consulting and transforming the way organizations thrive in a digital world. As a diverse, woman-owned global business, we pride ourselves on keeping talent happy – our 7% attrition rate speaks volumes. Bring your talented friends along and earn a referral bonus


Equal Opportunity Employer: We are an equal opportunity employer and welcome applications from all qualified individuals regardless of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, or veteran status.

In accordance with the New York City Salary Transparency Law, the base salary range for this position is $100,000.00 – $250,000.00 annually. This range represents the good-faith minimum and maximum salary the Company believes it would pay for this role at the time of this posting.
Actual compensation will be determined based on factors such as experience, skills, qualifications, geographic location, internal equity, and business needs. This position may also be eligible for additional compensation, including bonuses, commissions, and/or benefits, as applicable.

Top Skills

Spark,Hadoop,Hive,Hadoop Mapreduce,Scala,Java,Python,Aws Emr,S3,Lambda,Amazon Redshift

Similar Jobs

12 Days Ago
Remote or Hybrid
Framingham, MA, USA
69K-129K Annually
Mid level
69K-129K Annually
Mid level
Big Data • Healthtech • Software
Design, build, and maintain scalable ETL/ELT pipelines using Python, Spark, Databricks, Airflow and SSIS. Integrate and cleanse diverse healthcare datasets, implement Unity Catalog for metadata and governance, optimize Spark performance and JVM tuning, support Medallion architecture, and collaborate with cross-functional teams to automate CI/CD, observability, and data quality processes.
Top Skills: Python,Scala,Sql,Apache Spark,Databricks,Aws,Ssis,Apache Airflow,Unity Catalog,Jenkins,Gitlab Ci,Parquet,Delta,Csv,Xml,Nosql,Jvm,Medallion Architecture
21 Hours Ago
Easy Apply
Remote
United States
Easy Apply
Senior level
Senior level
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
Build and maintain data onboarding pipelines and automation to extract, transform, validate, and import retailer data from legacy POS systems. Optimize performance, ensure data quality, and collaborate with onboarding, product, and operations teams to scale retailer onboarding.
Top Skills: Ai ToolsAsync Job ProcessingData PipelinesPostgresRuby On Rails
24 Days Ago
Remote
Pennsylvania, USA
101K-155K Annually
Senior level
101K-155K Annually
Senior level
Healthtech • Logistics • Pharmaceutical
The role involves collaborating with stakeholders to develop scalable data solutions using Databricks, applying AI/ML techniques, ensuring data integrity, and transforming business data into insights.
Top Skills: AgentbricksAIAzureBigQueryDatabricksGenieMlflowPythonScalaSnowflakeSQLUnity CatalogVector Indexes

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account