Top Senior Data Engineer Jobs in Los Angeles, CA

Build and scale resilient ingestion, catalog, and derived data pipelines powering core infrastructure datasets. Own data contracts, schema governance, quality gates, automated testing, observability, and pipeline reliability. Modernize legacy systems into scalable platform architecture, including a graph database layer. Partner with global engineering, data science, ML, intelligence, and trust teams to support matching, confidence scoring, and automated workflows.

Build and operate NVIDIA DGX Cloud’s data platform, including batch and streaming pipelines, distributed data workloads, data products, quality monitoring, security, observability, and self-service consumption. Own systems from architecture through deployment and incident response. Improve platform reliability, scalability, and engineering practices while mentoring teammates. Work primarily with Python and SQL across cloud infrastructure, databases, Spark, telemetry, and operational data.

Leads architecture and hands-on development of scalable data pipelines, governed data models, semantic layers, analytics products, and AI workflows. Writes production SQL and Python, establishes engineering standards, mentors engineers, and drives design reviews. Builds agentic and LLM solutions using retrieval and managed AI services while ensuring data quality, observability, reliability, privacy, and regulatory compliance for PHI and genomic data. Partners with stakeholders, platform teams, and governance forums to deliver trustworthy business solutions.

Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.

Build and maintain production data ingestion, transformation, and pipeline systems for a governed federal data and AI platform. Develop data products, contribute to Terraform infrastructure and CI/CD, monitor quality and reliability, troubleshoot issues, and apply governance and access controls. Support data science and ML teams while operating within FedRAMP, NIST 800-171, and CUI requirements. Collaborate with engineers and document pipelines and processes.

Designs, builds, and operates scalable data pipelines, warehouses, lakes, and integrations supporting analytics, products, and production AI/ML systems. Responsibilities include data modeling, schema design, validation, monitoring, orchestration, real-time processing, governance, and observability. The role contributes to architecture decisions, collaborates across analytics, AI, and product teams, communicates technical tradeoffs, and owns data engineering work end to end.

Designs and maintains scalable Databricks data pipelines on AWS, covering ingestion, transformation, streaming, data quality, and analytics-ready dataset delivery. Builds medallion architecture layers using Spark, Python, SQL, Delta Lake, and AWS services. Responsibilities include source-to-target mapping, unit testing, CI/CD deployment, anomaly analysis, and compliance with FISMA High and multi-tenant governance requirements. Collaborates in Agile teams and uses AI automation tools to accelerate pipeline development and validation.

Designs and operates data infrastructure for a clinical trial platform. Builds pipelines that extract, normalize, validate, and link information from clinical documents and publications into Aurora and GraphDB. Develops embeddings, vector search, RAG workflows, data-serving APIs, lineage tracking, and regulatory audit trails. The role also requires AWS-based orchestration, clinical data quality controls, biomedical knowledge graph modeling, and deployment automation using infrastructure-as-code and containerization.

Designs and maintains scalable data pipelines, warehouse models, and analytics solutions. Builds natural-language data interfaces using GenAI and LLM techniques, optimizes SQL, improves data quality and observability, and supports distributed data platforms on AWS or GCP. Partners with engineering, analytics, business, and product teams, contributes to shared codebases, establishes development standards, and participates in production on-call and incident response.

Manage the health, performance, reliability, and cost of customer Snowflake and Databricks environments. Responsibilities include customer onboarding, account and warehouse setup, permissions, data ingestion, query optimization, cost reporting, incident response, escalation support, and automation using Python and Terraform. The role also advises customers and internal teams on data platform best practices and participates in on-call rotations.

Build and maintain data lakes, data warehouses, and modern data pipelines for a multi-tenant SaaS platform. Design end-to-end data processes, write pipeline and infrastructure code, conduct design reviews, optimize performance, monitor systems, support data governance, and troubleshoot scalability and security issues. Collaborate with technical and business stakeholders, mentor junior engineers, evaluate technologies, document platform architecture, automate testing, and participate in on-call rotation.

Own the architecture, roadmap, and operation of Clarium’s AWS-based data platform. Build reliable batch and near-real-time pipelines, model healthcare supply chain data, optimize Postgres and Snowflake performance, and establish standards for testing, deployment, quality, and governance. Partner cross-functionally to create durable data models, lead multi-quarter initiatives, manage sensitive data controls, and mentor engineers.

Leads and mentors the Data Engineering team while remaining hands-on in designing, building, and maintaining scalable data pipelines, warehouses, integrations, and infrastructure. Establishes architecture, reliability, quality, and performance standards; guides technical delivery; and resolves complex issues. Partners with Finance and business stakeholders to translate data needs into practical solutions, sets technical direction, evaluates technologies, and communicates strategy, risks, and recommendations to leadership.

Leads and delivers complex data engineering projects, designing scalable data infrastructure, pipelines, warehouses, and data quality solutions. Recommends tools and architectures, optimizes data movement and performance, collaborates across technical teams, mentors engineers, and translates technical concepts for clients and nontechnical stakeholders. The role may also involve real-time processing, data modeling, transformation, security, and MLOps.

Build and operate governed production data pipelines in Databricks using medallion architecture, Unity Catalog, data quality controls, lineage, and semantic models. Develop AI agents and retrieval-augmented applications grounded in enterprise data using Mosaic AI and model serving. Integrate enterprise systems through APIs and events, implement security and observability, and own architecture, testing, CI/CD, deployment, and production support.

Build and operate core data infrastructure for edge and hybrid environments, including ingestion, OT/IoT integrations, real-time streaming, data contracts, schemas, validation, lineage, observability, telemetry, and scalable query access. The role requires production ownership, reliability practices, customer integration, and collaboration across engineering and customer-facing teams. Candidates should have 6+ years of experience with production data, streaming, or integration systems and proficiency in Python and/or Go.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Designs and builds scalable batch and real-time data pipelines, ingestion workflows, analytical processes, data products, and intelligent APIs. Ensures data quality, reliability, and performance while supporting Azure-based architecture for BI and AI/ML use cases. Collaborates with cross-functional teams, participates in code reviews, and follows DevOps, Agile, and CI/CD practices.

Builds and maintains scalable data pipelines, ETL infrastructure, data warehouses, and analytics tools. The role assembles complex datasets, automates processes, optimizes data delivery architecture, and supports cross-functional data initiatives. Collaborates with executive, product, data, and design stakeholders to resolve technical issues and improve analytics systems. Requires proficiency in SAS, Python, Java, MATLAB, SQL, NoSQL, Hadoop, MapReduce, Hive, Presto, UNIX, and Linux, with JavaScript, R, and basic machine learning preferred.

Lead the architecture, development, and optimization of Snowflake and enterprise data platforms. Design scalable ETL/ELT pipelines, dimensional data models, and medallion architectures while establishing engineering standards for testing, deployment, monitoring, security, and data quality. Partner with stakeholders on technical roadmaps, mentor engineers and analysts, conduct design and code reviews, modernize legacy pipelines, and deliver reliable, reusable data solutions.

Design and build PerfectServe’s unified cloud data platform, including ingestion pipelines, integrations, data models, metrics, and consumer-facing data layers. Establish architecture, engineering, quality, and testing standards; enable safe extraction from production systems; partner with data users; and mentor data engineers. The role requires substantial cloud data platform experience, deep SQL, warehouse expertise, ELT, change-data-capture, AWS, modeling, orchestration, and data quality skills.

Build and manage scalable ETL/ELT pipelines using Microsoft Fabric and Azure Databricks, implement medallion architecture, support data migrations and legacy SSRS decommissioning, develop Power BI data models, and maintain governance, security, and CI/CD practices. The role also supports migration events and modernizes data infrastructure for advanced analytics and reporting.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.