Northwell Health Logo

Northwell Health

Lead Data Engineer - Data Platform Engineering (Hybrid)

Posted 9 Days Ago
In-Office
Melville, NY
Senior level
In-Office
Melville, NY
Senior level
Lead Data Engineer needed to architect data pipelines and infrastructure, oversee projects for user requirements, and ensure compliance with regulations. Role includes developing systems for data tracking and mentoring the team to solve complex data challenges.
The summary above was generated by AI

Job Description

We're looking for a hands-on Lead Data Engineer to architect and build the data pipelines and infrastructure that power our analytics, ML, and business intelligence capabilities. You'll design greenfield data solutions while modernizing our existing systems to create a scalable, reliable, and performant data platform. Leads the implementation of information systems to manage financial functions for Patient Financial Services/Accounts. Oversees projects and initiatives to meet user requirements. Serves as a liaison between department (user) and vendors. Ensures systems compliance to applicable laws, regulatory standards and policies. This is a unique opportunity to own critical data infrastructure from the ground up. You'll spend your time building robust ETL/ELT pipelines, optimizing data models, building reusable and extensible frameworks, and mentoring the team all while solving complex challenges around data ingestion, transformation, and orchestration at scale. 

 

Job Responsibility


  • Coordinates implementation of information system initiatives to meet user requirements. 
  • Communicates with user departments and project teams regarding implementation activities and system changes to ensure feasibility. 
  • Develops system specifications that appropriately meet department requirements. 
  • Develops systems to track data in comprehensive and innovative ways. 
  • Collaborates with hospital departments and outside vendors to facilitate managed care contract implementation. 
  • Coordinates and maintains communication between the hospital and vendor(s) regarding system applications. 
  • Performs periodic post-installation reviews of system initiatives. 
  • Conducts system-wide in-services with managers and staff, as necessary. 
  • Ensures systems compliance to applicable laws, regulatory standards and policies. 
  • Uses knowledge and skills to contribute to the development of functional objectives and principles to achieve goals in innovative ways. Problems addressed are of diverse scope and complexity ranging from moderate to substantial.
  • Performs related duties as required. All responsibilities noted here are considered essential functions of the job under the Americans with Disabilities Act. Duties not mentioned here, but considered related are not essential functions.

Job Qualification

  • Bachelor's Degree required, or equivalent combination of education and related experience.
  • 5-7 years of relevant experience including technical experience with Apache Hadoop, NoSQL, setting up cloud clusters, Apache Spark, and other advanced data science and big data technologies, required.

HIGHLY PREFERRED

  • Extensive Google Cloud Platform (GCP) experience
  • Previous experience as a Data Platform Engineer/ Data Engineer/ Analytics Engineer for a large organization
  • Experience in/ with Python (FastAPI, Pandas, Polars, etc.)
  • Experience with infrastructure as code, specifically Terraform
  • Extensive experience with Airflow, DBT, and/ or Dataform
  • Experience with OpenLineage, OpenMetadata and data contracts
  • Extensive experience with BigQuery, CloudSQL, Pub/ Sub, Dataflow, Cloud Storage, etc.
  • Experience with the Cloud Healthcare API/ FHIR/ HL7

*Additional Salary Detail 
The salary range and/or hourly rate listed is a good faith determination of potential base compensation that may be offered to a successful applicant for this position at the time of this job advertisement and may be modified in the future.When determining a team member's base salary and/or rate, several factors may be considered as applicable (e.g., location, specialty, service line, years of relevant experience, education, credentials, negotiated contracts, budget and internal equity).

Top Skills

Airflow
Apache Hadoop
Spark
BigQuery
Cloud Healthcare Api
Cloud Storage
Cloudsql
Dataflow
Dataform
Dbt
Fastapi
Fhir
Google Cloud Platform
Hl7
NoSQL
Pandas
Pub/Sub
Python
Terraform

Similar Jobs

4 Minutes Ago
In-Office or Remote
140K-185K Annually
Senior level
140K-185K Annually
Senior level
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
The Senior HR Business Partner will drive organizational effectiveness and talent outcomes, using data-driven insights to shape people strategies and improve team performance in a global, fast-paced environment.
Top Skills: Ai ToolsData AnalyticsGoogle SuiteSlackWorkforce Planning Systems
18 Minutes Ago
Remote or Hybrid
United States
104K-130K Annually
Junior
104K-130K Annually
Junior
Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
As a Software Engineer in the Games Studio, you'll develop and maintain casino games, optimize performance, debug issues, and collaborate with teams to deliver quality gameplay experiences.
Top Skills: C#ThreejsTypescriptUnity
2 Hours Ago
Hybrid
164K-272K Annually
Senior level
164K-272K Annually
Senior level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
The Outbound Sales Manager will lead the Account Executives team, driving revenue growth while creating a culture of accountability and success, and coaching team members to improve performance and sales strategies.

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account