Arcadia.com Logo

Arcadia.com

Senior Data Engineer

Posted Yesterday
Remote
Hiring Remotely in United States
131K-235K Annually
Senior level
Remote
Hiring Remotely in United States
131K-235K Annually
Senior level
Design, build, and maintain production data pipelines and the unified data model using Snowflake, dbt, and orchestration tools. Optimize, test, document, and monitor ELT workflows, enforce engineering best practices, mentor teammates, and deliver trustworthy data products for analytics and business decisions.
The summary above was generated by AI

Who we are: 

Arcadia is the global utility data and energy solutions platform. With our leading data platform, AI-powered analytics, industry expertise, and expansive partner network, we deliver solutions for every stage of the enterprise energy management lifecycle across carbon, cost, and reliability. 

Arcadia’s Enterprise Energy Management Solutions are built on a foundational data platform that has been developed for over a decade and scaled across millions of customer facilities.  We transform fragmented data and siloed processes into coordinated, enterprise-wide action with comprehensive solutions, including:

  • Utility Bill Management:  Lower utility costs and streamline bill management with automated bill payment, proactive error identification, optimized tariff structures, and budgeting & forecasting.
  • Energy Procurement Advisory: Source clean energy through a comprehensive evaluation of supply options - including traditional retail options and onsite and offsite resources — to effectively manage risks, reduce costs, and achieve corporate sustainability goals.
  • Sustainability Reporting:  Achieve compliance goals and track carbon emissions with standardized energy data and seamless integration with leading sustainability platforms.

Tackling an enterprise client’s most critical energy challenges requires out-of-the-box thinking & diverse perspectives. We’re building a team of individuals from different backgrounds, industries, & educational experiences. If you share our passion for ushering in the era of the clean, cost-effective electrons, we look forward to learning what you would uniquely bring to Arcadia!

What we’re looking for:

We are seeking a Senior Data Engineer to create clean, curated, and organized data sets used across Arcadia. The role will be hands-on and collaborative, building data assets that enable analysis and drive daily business decisions. You’ll bring an engineer’s rigor and a seasoned data modeler’s expertise to our thorniest data modeling problems, helping to lead our efforts to organize, rationalize, and produce enriched data products on our data. Your expertise will also be essential in optimizing data workflows, ensuring data integrity, and scaling our data infrastructure to support our company's growth.

Our core data stack makes heavy use of Snowflake, dbt, and Fivetran for ingestion, all orchestrated within our broader AWS-based ecosystem. You’ll work primarily with SQL in dbt to build our curated data layer–we call it the Unified Data Model–and produce analytics pipelines for our derived data products–our Solutions business. We use dbt Core, orchestrated in Argo or Prefect.


What you’ll do
  • Design, build and maintain the tooling that the wider Data team (and Arcadia as a whole) uses to interact with our data platform, including CI/CD pipelines for our data lakehouse, and unit/integration/validation testing frameworks for our data pipelines.

Optimize and tune data pipelines for improved performance, scalability, and reliability, and proactively monitor pipelines to address any issues or bottlenecks.

  • Collaborate with subject matter experts, engineers, and product managers to identify the most elegant and effective data structures to understand our constantly growing and evolving business
  • Transform, test, deploy, and document data to deliver clean and trustworthy data for analysis to end-users
  • Help bring engineering best practices (reliability, modularity, test coverage, documentation) to our DAG and to our Data team generally
  • Collaborate with data engineers to build robust, tested, scalable and observable ELT pipelines.
  • Identify and implement best practices for data ingestion, transformation, and storage to ensure data integrity and accuracy.
  • On a daily basis, this role will perform:
    • Data modeling: model raw data into clean, tested, and reusable datasets to represent our key business data concepts. Define the rules and requirements for the formats and attributes of data
    • Data transformation: build our data lakehouse by transforming raw data into meaningful, useful data elements through joining, filtering, and aggregating source data
    • Data documentation: create and maintain data documentation including data definitions and understandable data descriptions to enable broad-scale understanding of the use of data
    • Employ software engineering best practices to write code and coach analysts and data scientists to do the same
Must-haves
  • 4+ years as a Senior Data Engineer or Software Engineer building production data infrastructure. dbt experience is highly desirable
  • 6+ years, cumulatively, in the data space (data engineering, data science, analytics, or similar)
  • Expert-level understanding of conceptual data modeling and data mart design
  • Proficiency in SQL and strong Python skills, especially in the context of data orchestration.
  • Deep experience building data pipelines and database management including Snowflake or similar, along with familiarity with data integration patterns and ELT/ETL processes.
  • Experience with orchestration tools like Prefect, Airflow, or Argo.
  • Proven ability to establish and enforce AI-related engineering best practices (e.g., security, responsible code review, and prompt discipline) within data pipelines and codebase contributions, ensuring data integrity, architectural stability, and the safe use of AI-assisted tools.
  • Ability to bring a customer-oriented and empathetic approach to understanding how data is used to drive the business
  • Experience in technical leadership or mentorship
  • Strong communication and collaboration skills
  • The ability to work East Coast business hours to maximize overlap with team members in India
  • Proven ability to solve complex problems in a dynamic and evolving environment
Nice-to-haves
  • Graduate degree in math, statistics, engineering, computer science, or related technical field
  • Experience in predictive modeling and statistical analysis
  • Experience with BI platforms
  • Experience working in global, distributed teams
  • Experience in the energy sector

Benefits:

  • "Remote first" culture - work anywhere in the US as long as you have a reliable internet connection
  • Flexible PTO - no accrued hours and no limit on the number of vacation days exempt employees can take each year
  • 12 annual company-wide holidays
  • 10 days sick leave
  • Up to 4 weeks bereavement leave
  • 2 volunteer days off
  • 2 professional development days off
  • 12 weeks paid parental leave for all parents
  • 75-95% employer cost coverage for medical, dental, and vision benefits for employees and dependents


Eliminating carbon footprints, eliminating carbon copies.


Here at Arcadia, we cultivate diversity, celebrate individuality, and believe unique perspectives are key to our collective success in creating a clean energy future. Arcadia is committed to equal employment opportunities regardless of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, protected veteran status, or any status protected by applicable federal, state, or local law. 


We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation by emailing [email protected] prior to completing your application.


Target Annual Compensation Range for this role will be $131,250 to $235,000. There will also be a competitive benefits and equity (bonus if applicable) component to the package. The exact compensation at which this job is filled will be determined by the skills, experience, and location of the qualified candidate. Please note that we are unable to offer visa sponsorship for this position at this time.

Automated Screening Technology: To ensure a fair and timely review of the high volume of applications we receive, Arcadia may utilize AI-assisted technologies to help our team identify candidates who best meet the qualification criteria for this role (based on skills, experience, and education).

Please Note: Automated tools provide recommendations based on your resume content and application questions. While we may use automated screening for basic eligibility (e.g., visa status, location), employment decisions regarding qualifications are not made solely by AI without human oversight.

Data Privacy & California Residents: You voluntarily provide personal information (such as your resume, contact details, and assessment responses) when submitting an application. We may use this to evaluate your candidacy and derive inferences from this data to match your profile with open roles. For California Residents: This collection is consistent with the CCPA. You have the right to request access to or deletion of your data by contacting [email protected]

Thank you

Top Skills

Snowflake,Dbt,Dbt Core,Fivetran,Aws,Sql,Python,Argo,Prefect,Airflow,Elt/Etl

Similar Jobs

Yesterday
In-Office or Remote
Minnetonka, MN, USA
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and maintain scalable batch and streaming data pipelines using Python/PySpark on Databricks or Snowflake. Implement data models (OLTP/OLAP), develop advanced SQL, orchestrate workflows with Airflow, enforce governance via Microsoft Purview, build data quality frameworks, support cloud/DevOps practices, monitor production pipelines, and lead technical design and code reviews.
Top Skills: Python,Pyspark,Databricks,Snowflake,Sql,Apache Airflow,Microsoft Purview,Azure,Aws,Gcp
2 Days Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
130K-165K Annually
Senior level
130K-165K Annually
Senior level
Artificial Intelligence • Insurance • Machine Learning • Software • Analytics
Lead design and implementation of scalable, HIPAA-compliant data pipelines and platforms for healthcare ML. Build ETL, orchestration, and tooling for processing EHR, claims, pharmacy, and bioinformatics data; collaborate with data scientists to produce modeling-ready datasets and ensure data quality, reliability, and operational excellence.
Top Skills: Python,Sql,Apache Spark (Pyspark),Databricks,Snowflake,Airflow,Dagster,Prefect,Terraform,Docker,Kubernetes,Aws,Dbt,Ci/Cd
3 Days Ago
In-Office or Remote
Raleigh, NC, USA
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design and build enterprise data models, ETL/ELT pipelines and high-performance PySpark jobs on Azure/Databricks. Enable ML/AI with MLflow and model serving, secure restricted-data environments using Unity Catalog and access controls, deploy AI agents, and evaluate emerging data and AI trends.
Top Skills: Azure,Databricks,Databricks Workflows,Azure Data Factory,Python,Pyspark,Sql,Databricks Sql,Delta Lake,Unity Catalog,Mlflow,Model Serving,Github Copilot,Databricks Genai,Mlops

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account