Top Senior Data Engineer Jobs in Los Angeles, CA

Build and configure a government Databricks workspace, develop ingestion and integration pipelines from enterprise and legacy systems, and prepare data for reporting. Implement Unity Catalog governance, metadata management, auditing, and lineage; configure MLflow workflows; assess security controls for sensitive data; and create architecture documentation, data dictionaries, and SOPs to support long-term sustainment.

Lead the design and optimization of healthcare data pipelines integrating EHR, payer, HIE, and vendor data. Build AWS-based ETL/ELT infrastructure, reusable integration tooling, data quality monitoring, and ML enablement foundations. Ensure HIPAA-compliant handling of clinical data, including security controls, audit logging, encryption, and de-identification. Provide technical leadership, mentor engineers, influence platform architecture, and lead complex partner integrations involving FHIR, HL7v2, CCDA, and healthcare terminology standards.

Develop and optimize large-scale data systems, ETL pipelines, storage, entity-resolution products, and data automation infrastructure. Build and integrate ingestion and processing pipelines using AWS, Airflow, Spark, PySpark, and EMR. Create testing and monitoring components, develop analytical tools, support data governance and quality, collaborate with data science teams, and document technical solutions.

Designs and implements data models, schemas, and ETL/ELT pipelines supporting analytics, reporting, and machine learning. Optimizes query performance, partitioning, and clustering; establishes data quality, governance, and security standards; integrates data with BI and machine learning tools; documents workflows; and mentors junior engineers. Collaborates with data scientists, analysts, and product owners to architect cloud-based analytical infrastructure and data marts.

Design and lead scalable, secure, highly available database infrastructure for multi-terabyte SQL Server environments. Set technical direction for data architecture, performance, real-time pipelines, security, and growth. Troubleshoot complex production issues, optimize queries and indexes, guide cross-functional projects, mentor engineers, review changes, reduce technical debt, and evaluate emerging technologies. Monitor database health using Splunk, Datadog, and Grafana while influencing engineering and Site Reliability strategy.

Build scalable, secure data pipelines, models, platforms, and governance systems that enable AI applications to access trusted enterprise data. Partner with analytics, marketing, and product teams to translate requirements into technical solutions, independently deliver projects through production, and support sensitive-data security and access controls. Preferred experience includes LLM architectures, cloud data platforms, infrastructure as code, regulated environments, and technical leadership.

Design and scale lakehouse architecture, streaming and batch pipelines, and reliable data platforms using Kafka, Spark, Airflow, Iceberg, Databricks, and related technologies. Build Medallion-layer data systems, manage open table formats, optimize distributed queries, monitor platform reliability, resolve data quality issues, and collaborate with analysts, data scientists, and product teams.

Lead the architecture, implementation, and operation of DGX Cloud’s shared data platform. Build scalable batch and streaming pipelines, data models, APIs, libraries, and orchestration capabilities for fleet telemetry and operational data. Own cross-team technical initiatives, production investigations, data quality, observability, security, and reliability standards. Provide hands-on coding, architectural leadership, mentorship, and guidance for migrations, distributed systems, cloud infrastructure, and production data products.

Leads architecture and delivery of DGX Cloud’s shared data platform, including batch and streaming pipelines, data products, orchestration, and production infrastructure. Owns scalable data models, reliability, security, observability, and engineering standards across teams. Diagnoses complex production issues, drives migrations and performance improvements, mentors engineers, and personally develops critical software supporting fleet telemetry, capacity, utilization, cost, scheduling, and operational analytics.

Leads data engineering teams in designing, developing, and supporting scalable batch and streaming data solutions. Responsibilities include data pipeline development, architecture, governance, security, platform optimization, production support, technical mentorship, stakeholder collaboration, and delivery leadership. The role requires hands-on engineering with Python or similar languages, modern data technologies, cloud platforms, DevOps practices, and people-management responsibilities.

Designs and maintains ELT pipelines, warehouse integrations, data models, and data quality processes. Collaborates with data scientists, analysts, engineers, and stakeholders to deliver scalable analytical solutions. Responsibilities include data integration, governance, security, performance optimization, exploratory analysis, visualization, and cloud-based API ingestion. Requires strong SQL, DBT, Snowflake, Azure Data Factory, cloud, and scripting experience, plus leadership and communication skills.

Architects, builds, and scales data pipelines, ETL processes, data models, and platforms using dbt, Snowflake, Airflow, and Fivetran. Leads data engineering best practices including CI/CD, data quality, governance, and observability. Collaborates with Data Science, Engineering, Product, and business stakeholders; mentors engineers and data scientists; contributes to architecture and technical decisions; and participates in on-call support.

Designs, builds, and maintains scalable Azure data pipelines and ELT frameworks using Databricks, SQL, Python, and PySpark. Implements Azure DevOps CI/CD, monitoring, security, infrastructure automation, and production support. Collaborates with BI teams on Power BI datasets, documents data solutions, participates in Agile delivery, and mentors junior engineers. The role requires strong data modeling, structured and semi-structured data expertise, performance tuning, and data governance awareness.

Develops scalable data and software systems using Python and Apache Spark. Designs APIs, data models, ETL workflows, orchestration, and data interactions while optimizing performance, scalability, integrity, and security. Builds user interfaces, contributes to automated testing, applies Agile practices, and supports CI/CD delivery. The role requires strong software engineering, distributed computing, analytical, and communication skills, with AWS, R, Databricks, and SAS experience preferred.

Build and maintain a production data platform integrating RMS, Azure SQL, HubSpot, and vendor APIs. Develop pipelines, data models, quality gates, APIs, system-of-record write-backs, performance improvements, and explainable lineage. Build production AI-agent workflows with evaluation, guardrails, and monitoring. Own features end to end, contribute to applications, support incident response, and collaborate with product managers and traders.

Design, build, deploy, and maintain AWS-based data and AI/ML infrastructure for enterprise agentic AI platforms. Develop data lake pipelines, observability systems, agent-enablement tooling, and production MLOps/LLMOps capabilities. Own features end-to-end, contribute to architecture and design decisions, optimize reliability, scalability, security, and cost, and collaborate with AWS Professional Services, client teams, and junior engineers.

Build and operate reliable ETL and ELT pipelines across lakehouse and transactional systems. Develop data models, enforce governance, integrate diverse data sources, and support analytics, APIs, and predictive tools. Monitor performance, data quality, lineage, cost, and uptime while collaborating with data science, AI, product, and innovation teams.

Designs, builds, and operates enterprise data lakes, warehouses, lakehouses, ETL/ELT pipelines, databases, and reporting platforms. Prepares governed, model-ready data for AI and machine learning, supports feature stores and embedding workflows, administers relational databases, optimizes queries and dashboards, and ensures data quality, security, availability, and disaster recovery. Collaborates with technical and business teams, reports to senior management, and mentors data engineers.

Build and maintain automated ETL/ELT data pipelines, improve data quality and monitoring, optimize Postgres and BigQuery schemas and queries, develop internal tooling, support data governance (HIPAA), participate in on-call rotation, and collaborate across engineering teams to scale data systems.

Designs, builds, and maintains enterprise data pipelines, ETL processes, integrations, cloud data infrastructure, and complex data models. Supports analytics partners, develops data warehouse solutions, tunes SQL and database performance, troubleshoots production issues, and delivers end-to-end data engineering projects. The role collaborates with architects, analysts, developers, and business stakeholders, applies big data technologies, supports agile delivery, and mentors team members.

Build and operate a governed Snowflake enterprise data warehouse, including ingestion, orchestration, dbt transformations, infrastructure as code, security controls, reliability checks, and CI/CD. Partner with data owners and BI teams during migration from legacy systems, ensure compliance for sensitive financial data, support reconciliation and incident resolution, and mentor engineers. The role requires hands-on ownership of pipelines and platform components across development and production environments.

As a Data Engineer, you will design, implement, and maintain data systems for Notifications at Whatnot, ensuring data quality and performance while collaborating with cross-functional teams on data architecture and workflows.

Design and build a durable data storage platform that preserves source disagreements, provenance, uncertainty, historical versions, and evidence. Develop result and evidence stores, lineage tracking, versioned rules and configurations, reproducible decision records, and point-in-time entity views. Collaborate with entity-resolution and machine-learning teams to support probabilistic outputs. The role requires production data engineering experience, strong Python and SQL, PostgreSQL expertise, U.S. citizenship, and an active Secret clearance.

Designs and implements scalable software solutions, develops maintainable features, resolves bugs, optimizes performance, and writes automated tests. Participates in architecture discussions, code reviews, Agile planning, CI/CD, observability, and adoption of AI-assisted engineering tools. Collaborates with QA, Product Management, and DevOps to deliver software across web, desktop, cloud, and IoT environments. The role is remote for candidates in the Seattle or Los Angeles metropolitan areas, with quarterly travel to Los Angeles.

Own and evolve end-to-end data pipeline architecture across ingestion, transformation, modeling, and serving. Lead platform improvements for cost efficiency, reliability, access control, observability, orchestration, CI/CD, and developer experience. Drive complex cross-team initiatives, resolve production issues, influence architectural decisions, mentor engineers, and build automation incorporating AI into data engineering workflows.