Leads the architecture, design, and implementation of scalable GCP and Databricks data lakehouse platforms. Designs real-time and batch pipelines, data models, governance, cataloging, security, and performance optimization. Advises clients, translates business requirements into technical solutions, leads project teams, mentors engineers, reviews architectures, and balances strategic planning with hands-on proof-of-concept and troubleshooting work.
About Egen:
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
Meet Egen
Life at Egen
Culture and Values at Egen
Career Development at Egen
Benefits at Egen
Responsibilities:
- Lead the end-to-end architecture, design, and implementation of scalable Data Lakehouse solutions on Google Cloud Platform (GCP) using BigQuery, GCS, BigLake, and Dataplex
- Collaborate directly with customers to understand business goals, data challenges, and technical requirements; translate them into robust architectural blueprints and actionable plans
- Design and implement data pipelines supporting both real-time and batch ingestion using modern orchestration and streaming frameworks
- Establish and enforce best practices for data cataloging, metadata management, lineage, and data quality across multiple systems
- Define and implement data security, access control, and governance models in compliance with enterprise and regulatory standards
- Serve as the technical lead for project teams - mentoring engineers, reviewing solutions, and ensuring architectural consistency across deliverables
- Balance strategic architecture discussions with hands-on solutioning, POCs, and deep dives into data pipelines or performance tuning
- Partner with stakeholders, cloud architects, and delivery leads to drive solution adoption, scalability, and long-term maintainability
- Represent the company as a trusted technical advisor in client engagements - clearly articulating trade-offs, best practices, and recommendations
Qualifications:
- 8–10 years of progressive experience in Software Engineering and Data Platform development, with 5+ years architecting data platforms on GCP and/or Databricks
- Proven hands-on experience designing and deploying Data Lakehouse platforms with data products and medallion architectures
- Strong understanding of data ingestion patterns (real-time and batch), ETL/ELT pipeline design, and data orchestration using tools such as Airflow, Pub/Sub, or similar frameworks
- Expertise in data modeling, storage optimization, partitioning, and performance tuning for large-scale analytical workloads
- Experience implementing data governance, security, and cataloging solutions (Dataplex, Data Catalog, IAM, or equivalent)
- Excellent communication and presentation skills - able to confidently engage with technical and non-technical stakeholders and guide clients through solution decisions
- Demonstrated ability to lead by example in mixed teams of engineers, analysts, and architects, balancing architectural vision with hands-on delivery
- Nice to have: Experience with Databricks (Delta Lake, Unity Catalog) and hybrid GCP-Databricks data architectures
- Strong problem-solving mindset, curiosity to explore new technologies, and ability to “zoom out” for architecture discussions and “zoom in” for code-level troubleshooting
Compensation & Benefits:
This role is eligible for our competitive salary and comprehensive benefits package to support your well-being:
- Comprehensive Health Insurance
- Paid Leave (Vacation/PTO)
- Paid Holidays
- Sick Leave
- Parental Leave
- Bereavement Leave
- 401 (k) Employer Match
- Employee Referral Bonuses
Check out our complete list of benefits here - >https://egen.ai/people/#benefits
Important: All roles are subject to standard hiring verification practices, which may include background checks, employment verification, and other relevant checks.
EEO and Accommodations:
Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.
Similar Jobs
Other
Leads enterprise data architecture strategy, including data warehouses, lakehouses, Data Mesh, integration patterns, streaming, AI readiness, data governance, and Master Data Management. Establishes standards for pipelines, transformations, lineage, data contracts, and data products while advising business units and mentoring data engineering, BI, and MDM teams. The remote U.S. role requires occasional travel to Nashville and extensive experience with cloud data platforms and modern data engineering technologies.
Top Skills:
AirflowData CatalogingData LakehouseData MeshData ObservabilityData WarehousingDbtEltETLGoogle BigqueryJavaKafkaMaster Data ManagementMetadata ManagementMicrosoft FabricPythonScalaSnowflakeSQL
Logistics • Transportation
Lead the architecture and implementation of enterprise-scale GCP data ecosystems, including PB-scale platforms and AWS-to-GCP migrations. Establish data platform roadmaps, self-service architectures, governance, security, quality, and Infrastructure as Code standards. Architect solutions using GCP data, analytics, AI, streaming, and containerization technologies. Lead cross-functional engineering teams, mentor staff, advise executives, manage technical risks, and communicate the business value of data initiatives.
Top Skills:
AgileApache AirflowApache BeamApache KafkaSparkBiglakeBigQueryBigquery MlBigquery OmniCloud ComposerConfluentDataflowDataplexDataprocDbtDevOpsGkeGoogle Cloud Platform (Gcp)Google Cloud StorageHadoopIamInfrastructure As Code (Iac)KubernetesLookerPub/SubPulumiTerraformVertex AiVpc Service Controls
Cloud • Software
Lead the architecture and implementation of complex cloud-based data solutions for customers. Define strategic data roadmaps, support pre-sales engagements as a data engineering subject matter expert, interview and mentor architects and engineers, and oversee data standards and operating procedures. The role requires extensive AWS data architecture experience across traditional and modern data platforms, including big data, machine learning, generative AI, DataOps, infrastructure as code, CI/CD, and Python automation.
Top Skills:
Amazon BedrockAmazon SagemakerSparkAWSBusiness Intelligence DashboardsCi/CdData GovernanceData TestingData VersioningDatabricksDataopsInfrastructure As CodeMaster Data ManagementMatplotlibNoSQLNumpyPandasPythonRelational Databases
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
