Responsible for designing, developing, and maintaining scalable data pipelines and infrastructure, implementing data governance, and collaborating with teams to meet data needs.
About the Role
We are seeking an experienced Senior Data Engineer to join our growing Data & Analytics team. This role will be responsible for designing, developing and maintaining scalable data pipelines and infrastructure to support our organization’s data needs.
Specific Responsibilities:
- Design, develop, and maintain robust data pipelines and infrastructure to support data integration, processing, and storage
- Collaborate with analysts and other stakeholders to understand data requirements and translate them into technical solutions
- Implement best practices for data governance, security, and quality assurance to ensure the reliability and accuracy of data
- Explore and evaluate new technologies and tools to enhance our data infrastructure and capabilities
- Design and implement complex data models on Azure Synapse Analytics to support data warehousing Utilize Azure DevOps for continuous integration, continuous delivery, and agile project management.
- Manage and optimize Apache Spark pools for high-performance data processing tasks.
- Develop and maintain ETL processes and data pipelines using Python scripting.
- Ensure data quality and integrity across all platforms and systems.
- Collaborate with cross-functional teams to translate business needs into technical specifications.
- Stay current with industry trends and advancements in Azure data services.
What you'll need:
- Bachelor’s degree in Computer Science, Engineering, or related field
- Minimum of 5+ years experience in data engineering roles, with a strong focus on building and maintaining data pipelines and infrastructure
- Strong proficiency in Azure Synapse Analytics, Azure DevOps, and Apache Spark pools.
- Expertise in Python scripting and other programming languages such as SQL and Java
- Senior level knowledge of data modeling, processes, and data warehouse concepts
- Strong communication skills and ability to effectively communicate technical concepts to non-technical stakeholders
- Experience with data modeling, warehousing, and building ETL pipelines
- Familiarity with Azure Data Factory, Azure Data Lake Storage, and other Azure data services
Note for Current Employees:
Please use the internal job board in Greenhouse to apply. Applications submitted through this external link will not be tagged as internal.
Compensation, Benefits, & Additional Details:
Health-E Commerce's compensation philosophy is grounded in market data and internal equity to ensure fairness and consistency across the team. Individuals new to the company should generally expect offers to fall between the entry point and midpoint of the salary range. Our goal is to provide an offer that supports growth potential within the role and allows for future salary progression.
- Compensation: $130,000 - 165,000
- Discretionary Annual Bonus Eligibility: Up to 10%
- Medical, Dental, Vision, and 401K with a company match
- Dependent Care, FSA & HSA accounts
- Paid Parental & Bonding Leave
- Flexible PTO & office closure on all major holidays
- Monthly wellness & internet reimbursements
- Professional development including certification support & leadership coaching
- Mental Health resources
- 100% remote within the United States
- Must be able to work EST hours
Candidate Privacy Notice
Similar Jobs
AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech • SEO
Build and support scalable data platforms and pipelines, leading migrations such as Snowflake to BigQuery and transitioning reporting to Looker. Responsibilities include data architecture, ETL/ELT, API and marketing integrations, data quality, production troubleshooting, warehousing, performance optimization, and platform modernization. The role partners with analytics and business teams, owns projects through production, documents solutions, and provides technical guidance.
Top Skills:
AWSAzureBigQueryConfluenceDraw.IoGCPGitJIRAKafkaLookerLucidchartMiroModeNotionPower BIPythonSnowflakeSparkSQLTableauTalend
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Design and scale lakehouse architecture, including Bronze, Silver, and Gold data layers. Build reliable streaming and batch pipelines with Kafka, Spark, and Airflow; manage Iceberg, Delta, and Hudi table formats; optimize Trino, Starburst, and Databricks queries; and improve platform reliability, data quality, and performance. Collaborate with data scientists, analysts, and product teams to deliver scalable data platform solutions.
Top Skills:
Apache AirflowApache HudiApache IcebergApache KafkaSparkDatabricksDelta LakeLakehouse ArchitectureMedallion ArchitecturePythonSQLStarburstTrino
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Design and scale lakehouse architecture, streaming and batch pipelines, and reliable data platforms using Kafka, Spark, Airflow, Iceberg, Databricks, and related technologies. Build Medallion-layer data systems, manage open table formats, optimize distributed queries, monitor platform reliability, resolve data quality issues, and collaborate with analysts, data scientists, and product teams.
Top Skills:
Apache AirflowApache HudiApache IcebergApache KafkaSparkDatabricksDelta LakePythonSQLStarburstTrino
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
