Leads a data engineering team and oversees the design, development, reliability, security, and scalability of data pipelines, warehouses, platforms, and integrations. Translates business needs into technical solutions, establishes data quality and governance standards, reviews architecture and code, manages projects and resources, resolves infrastructure issues, mentors engineers, and communicates progress and risks to leadership.
The Data Engineering Manager leads the design, development, and maintenance of data infrastructure and pipelines that support analytics, reporting, machine learning, and business operations. This role combines technical leadership with people management, ensuring that data systems are reliable, scalable, secure, and aligned with business requirements.
Key Responsibilities
- Lead and manage a team of data engineers.
- Design and oversee scalable data pipelines, data warehouses, and data platforms.
- Establish standards for data quality, reliability, security, and governance.
- Collaborate with data scientists, analysts, software engineers, and business stakeholders.
- Translate business requirements into effective data engineering solutions.
- Monitor data infrastructure and resolve performance or reliability issues.
- Oversee data integrations from internal and external sources.
- Review technical designs and code to maintain engineering quality.
- Plan projects, prioritize workloads, and manage engineering resources.
- Mentor team members and support their professional development.
- Evaluate and introduce appropriate data technologies and tools.
- Ensure data systems comply with organizational security and privacy requirements.
- Monitor project timelines, budgets, and deliverables.
- Communicate technical progress, risks, and recommendations to senior leadership.
Qualifications
- Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field.
- 5+ years of experience in data engineering or a related technical field.
- Previous experience leading or managing data engineering teams.
- Strong knowledge of SQL and programming languages such as Python or Java.
- Experience with data warehouses, databases, ETL/ELT processes, and data pipelines.
- Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud.
- Strong understanding of data architecture and data modeling.
- Excellent leadership, communication, and problem-solving skills.
Preferred Skills
- Experience with platforms such as Snowflake, Databricks, BigQuery, or Redshift.
- Familiarity with Apache Spark, Kafka, Airflow, or similar data technologies.
- Experience implementing CI/CD and automated testing for data pipelines.
- Knowledge of data governance, security, and compliance practices.
- Experience working in Agile/Scrum environments.
- Strong project management and stakeholder-management skills.
Similar Jobs
Retail • Sports
Leads customer data engineering strategy, delivery, team development, and roadmapping. Oversees data-driven product improvements, digital programs, quality initiatives, budgets, cybersecurity remediation, and portfolio management. Manages, mentors, and grows data engineering teams, including contractor teams, while guiding customer data platforms, omnichannel identity resolution, complex data modeling, and personalization-focused data science capabilities. Partners across the organization to execute strategic initiatives and build team capability.
Top Skills:
DatabricksGoogle BigquerySnowflake
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead Atlassian’s TDP SQL engineering team, owning people leadership, platform strategy, roadmap execution, reliability, security, compliance, incident response, technical direction, cross-functional dependencies, infrastructure economics, and operational outcomes. Build a high-performing organization and evolve a scalable managed relational database platform across multiple cloud environments while supporting enterprise requirements such as data residency, encryption, disaster recovery, and tenant isolation.
Top Skills:
Backup And RecoveryCloud InfrastructureDisaster RecoveryDistributed Relational DatabasesEncryptionMulti-Cloud InfrastructureSQLTenant Isolation
Fintech • Financial Services
Lead and mentor data engineering and DBA teams while driving GCP-based streaming and batch data platform initiatives. Oversee BigQuery, dbt, Apache Flink or Dataflow, data quality, testing, observability, governance, reliability, and cloud cost optimization. Remain hands-on with coding, code reviews, architecture, and complex system problems while aligning data infrastructure with business and product goals. Champion AI-assisted engineering and automation across the platform.
Top Skills:
Apache FlinkBigQueryDataflowDbtGoogle Cloud PlatformMySQLPostgres
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
