C the Signs Logo

C the Signs

Lead Data Engineer

Posted 2 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
The Lead Data Engineer will architect and develop a healthcare data platform on GCP, guiding teams in pipeline development, data modeling, and ensuring compliance with HIPAA. They will collaborate across functions, set technical directions, and mentor junior engineers.
The summary above was generated by AI

We are seeking a Lead Data Engineer to architect, build, and scale our next-generation healthcare data platform. In this role, you will lead the effort to design robust pipelines, modernize data architecture, and ensure high-quality ingestion and transformation of clinical and operational data. You’ll collaborate closely with product, analytics, clinical informatics, machine learning, and engineering teams to deliver trusted, timely, and compliant insights.

This is a hands-on leadership role ideal for someone who enjoys setting technical direction while still contributing code and guiding stakeholders through complex healthcare data challenges.

ResponsibilitiesArchitecture & Strategy
  • Lead design and evolution of our cloud-native data platform built primarily on Google Cloud Platform, including BigQuery, Cloud Storage, Pub/Sub, Cloud Run, Airflow (Cloud Composer), and Healthcare API.
  • Inform strategic decisions around multi-cloud or AWS interoperability when needed.
  • Establish data engineering best practices, coding standards, and architectural patterns.
Pipeline Development
  • Build scalable ETL/ELT pipelines using dbt for transformations and Airflow for orchestration.
  • Develop ingestion pipelines for clinical and administrative data in HL7, FHIR, DICOM, and custom formats.
  • Develop ingestion and transformation pipelines to be used for AI/ML development and model training.
  • Implement streaming and batch dataflows using Pub/Sub, Dataflow, and serverless compute.
  • Support or guide integrations with AWS-based partner systems or AWS-hosted data sources when applicable.
Data Modeling & Warehousing
  • Design and maintain BigQuery datasets, semantic layers, and warehouse structures.
  • Leverage industry standards such as FHIR resources for canonical healthcare models.
  • Provide guidance on data modeling and warehouse best practices across both GCP and AWS ecosystems.
Data Quality, Observability & Governance
  • Implement data quality frameworks, automated testing, and monitoring.
  • Ensure HIPAA compliance and proper handling of PHI/PII across all pipelines and cloud environments.
  • Drive lineage, documentation, metadata governance, and dbt docs adoption.
Leadership & Collaboration
  • Partner with analytics, product, clinical informatics, and security teams to deliver high-quality, trustworthy data products.
  • Provide oversight and technical direction for multi-cloud data integrations with AWS-based systems or partners.
  • Assist in the recruitment and development of junior data engineers

Requirements
  • 7+ years of data engineering experience; 2–3+ years in a lead or senior technical role.
  • Deep, hands-on expertise in GCP, particularly:
    • BigQuery
    • GCP Healthcare API (FHIR and DICOM stores)
    • Cloud Storage, Pub/Sub, Cloud Run/Functions
  • Strong proficiency with:
    • dbt (Core or Cloud)
    • Airflow (Cloud Composer or self-managed)
    • Python and advanced SQL (BigQuery preferred)
  • Hands-on experience with healthcare standards:
    • FHIR (R4/US Core), HL7 v2/v3, DICOM, C-CDA, X12
  • Strong understanding of PHI handling, HIPAA compliance, and healthcare interoperability.
Preferred
  • AWS experience, especially with:
    • Redshift, Lambda, S3, Glue, Kinesis, Athena, API Gateway, Step Functions
  • Experience building or maintaining multi-cloud pipelines bridging GCP and AWS.
  • Background with Dataflow/Beam or other stream processing frameworks.
  • Experience working with EHR integrations, claims processing, HIEs, or clinical data networks.
  • Familiarity with ML-enabled data pipelines or feature engineering in healthcare contexts.

Benefits

Why Join Us?

Joining C the Signs is not just about building AI; it’s about shaping the future of healthcare. If you are a technical leader with an unshakable belief in the power of AI to save lives and the ability to make it happen at scale, this is your opportunity to create a tangible, global impact.

Benefits:

  • Competitive salary and benefits package.
  • Flexible working arrangements (remote or hybrid options available).
  • The opportunity to work on life-changing AI technology that directly impacts patient outcomes.
  • Join a team that combines cutting-edge innovation with a mission to save lives and improve health equity.
  • Continuous learning opportunities with access to the latest tools and advancements in AI and healthcare.

Top Skills

Airflow
Api Gateway
Athena
AWS
BigQuery
Cloud Run
Cloud Storage
Dataflow
Dbt
Dicom
Fhir
Glue
Google Cloud Platform
Hl7
Kinesis
Lambda
Pub/Sub
Python
Redshift
S3
SQL
Step Functions

Similar Jobs

5 Hours Ago
Remote
United States
87K-102K Annually
Senior level
87K-102K Annually
Senior level
Real Estate
The Lead Data Engineer drives enterprise-scale data solutions, oversees project scoping, and leads a team, ensuring best practices in data engineering.
Top Skills: Azure DevopsAzure SqlDatabricksDelta LakeGitInfrastructure As CodePysparkPythonRScalaSpark Structured StreamingT-SqlUnity Catalog
11 Days Ago
Remote
United States
165K-175K Annually
Senior level
165K-175K Annually
Senior level
Mobile
Lead the reliability of the data platform, ensuring accuracy in data pipelines from ingestion to reporting, while mentoring junior data engineers.
Top Skills: DbtPythonSQL
16 Days Ago
Remote
United States
100K-250K Annually
Senior level
100K-250K Annually
Senior level
Information Technology • Business Intelligence • Consulting
Design and build Spark ETL pipelines on an AWS data platform, collaborate with stakeholders to deliver reliable large-scale data products, optimize and maintain data infrastructure, ensure data quality/governance, and manage platform operations and incident response.
Top Skills: Spark,Hadoop,Hive,Streaming Pipelines,Scala,Java,Python,Hadoop Mapreduce,Aws Emr,Amazon S3,Aws Lambda,Amazon Redshift,Etl,Data Warehousing

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account