Consumer Edge Logo

Consumer Edge

VP Data Engineering

Posted 2 Days Ago
Easy Apply
In-Office or Remote
Hiring Remotely in New York, NY
270K-300K Annually
Expert/Leader
Easy Apply
In-Office or Remote
Hiring Remotely in New York, NY
270K-300K Annually
Expert/Leader
The VP of Data Engineering will lead a team of data engineers, oversee GCP data platform architecture, and ensure high-quality data pipelines while collaborating with other departments.
The summary above was generated by AI

This role is remote (US-based; east coast preferred)

Company Overview

Join a dynamic team that's redefining consumer data analytics. We empower top investment firms and global consumer and corporate brands with cutting-edge insights into consumer spending, leveraging privacy-compliant data across geographies. Our real-time intelligence and merchant-level benchmarks give clients a competitive edge—and you'll be at the forefront of it all.

Role Summary

We're looking for a seasoned VP of Data Engineering to lead our data engineering team and take ownership of the infrastructure that powers everything we do. Because data is our business, this role carries significant weight: the reliability, scalability, and quality of our data pipelines directly impacts our customers and our revenue.

You'll manage ~15 engineers across 3 data engineering teams, set technical direction across our GCP-based data platform, and work closely with data operations, product, and commercial teams to ensure we can continuously ingest, process, and deliver alternative datasets at scale — with the rigour that financial services clients demand.

Your Main Responsibilities

Team Leadership

  • Lead, mentor, and grow a team of data engineers, building a culture of ownership, craft, and continuous improvement
  • Own hiring, onboarding, and performance management for the data engineering function
  • Act as a technical role model — setting high standards while remaining approachable and supportive

Data Platform & Infrastructure

  • Own the architecture, reliability, and evolution of our GCP data platform — including BigQuery, Cloud Composer/Airflow, Dataflow, Pub/Sub, and GCS
  • Design and maintain robust, scalable pipelines for ingesting, transforming, and serving diverse alternative datasets (web, CPG, transaction data, etc.)
  • Drive infrastructure best practices: cost optimisation, observability, incident response, and disaster recovery
  • Ensure data security, access controls, and compliance standards appropriate for regulated financial services clients

Strategic & Cross-functional

  • Translate business priorities and client requirements into a clear, deliverable technical roadmap
  • Partner with data operations, data science, and product teams to accelerate dataset onboarding and expand platform capabilities
  • Represent data engineering at the leadership level — contributing to company strategy and advocating for data quality as a core business value

We’re looking for someone with

Experience

  • 10+ years in data engineering, with at least 3 years in a leadership or management role (managing managers and teams)
  • Proven experience building and operating large-scale data pipelines on Google Cloud Platform
  • Experience in fintech, alternative data, financial data, or another data-as-a-product environment strongly preferred
  • Track record of delivering high-quality data infrastructure in a fast-moving, commercially sensitive context

Technical Skills

  • Deep expertise across the GCP data stack: BigQuery, Dataflow, Pub/Sub, GCS, Cloud Composer, and related services
  • Hands-on experience with dbt (Core or Cloud) for scalable transformation layer design, including modeling patterns, testing frameworks, and documentation standards
  • Strong understanding of data pipeline design, ELT/ETL patterns, data modelling, and workflow orchestration
  • Solid grasp of data governance, quality frameworks, and security best practices
  • Familiarity with the unique challenges of alternative data — diverse formats, inconsistent schemas, high ingestion volumes, and strict data provenance requirements
  • Practical experience with infrastructure-as-code tooling (Terraform and/or Pulumi) for provisioning and managing cloud resources; able to set IaC standards and review infrastructure changes with the same rigour applied to application code
  • Strong proficiency in Python and SQL; comfortable reviewing code and setting engineering standards across the team.

Leadership & Soft Skills

  • Excellent communicator with the ability to engage engineers, data scientists, and commercial stakeholders alike
  • Strong hiring instincts and a genuine passion for developing people
  • Pragmatic and decisive — able to balance technical rigour with commercial urgency
  • High ownership mindset; comfortable operating with autonomy in a high-stakes environment

 Nice to Have

  • Experience supporting data science or ML teams with feature engineering infrastructure
  • Familiarity with data licensing, provenance tracking, or data vendor management
  • Experience with data mesh or data-as-a-product organisational models
  • Open source contributions or published technical work

Why Join Consumer Edge

At Consumer Edge, the data engineering team isn't a support function - it's a core part of how we deliver value to clients. You'll be joining at a critical stage of growth, with the opportunity to shape the platform, the team, and the standards that the entire business depends on.

We offer a competitive salary, an extensive benefits package including 401(k) match, paid parental leave, flexible and generous time off, work-from-home flexibility, and a vibrant work environment conducive to professional growth and innovation. Join our team and play a significant role in driving data-driven decision-making, shaping the future of global consumer insights.

Compensation and Benefits

The annual base salary for this role is between $270,000– $300,000  based on experience, with the opportunity for a performance-based bonus, company equity, 401(k) matching, work-from-home flexibility, and subsidized health benefits.


Note Consumer Edge is currently hiring employees who reside in the following states or in Washington, DC:  CA, CO, CT, FL, ID, IL, LA, MA, MD, NC, NJ, NY, PA, RI, TN, TX, UT, VA, WA, WI 

#LI-Remote

#LI-DN

Top Skills

BigQuery
Cloud Composer
Dataflow
Dbt
Gcs
Google Cloud Platform
Pub/Sub
Pulumi
Python
SQL
Terraform

Similar Jobs

11 Hours Ago
Easy Apply
Remote
United States
Easy Apply
170K-195K Annually
Senior level
170K-195K Annually
Senior level
Cloud • Information Technology • Security • Software
The Sr. Solutions Engineer will present customized solutions, conduct product demonstrations, lead client workshops, and support customer success through seamless transitions post-sale.
Top Skills: Grc Saas PlatformsNo-Code Platform
11 Hours Ago
Easy Apply
Remote or Hybrid
Los Angeles, CA, USA
Easy Apply
190K-250K Annually
Expert/Leader
190K-250K Annually
Expert/Leader
Fintech • HR Tech
Responsible for enhancing local development environments, troubleshooting issues, collaborating with teams, and leveraging AI for productivity. Requires extensive software development experience.
Top Skills: Ai TechnologiesKafkaRuby on RailsRubySidekiq
11 Hours Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
Senior level
Senior level
Fintech • Mobile • Software • Financial Services
Design, build, deploy, and optimize scalable full-stack applications integrating databases, APIs, and AI/LLM workflows. Lead architecture, CI/CD (ArgoCD, GitLab), Airflow pipelines, and collaborate cross-functionally to deliver production-grade fintech solutions.
Top Skills: Apache AirflowArgocdAWSGitlab Ci/CdLlmsNode.jsReactRetrieval-Augmented Generation (Rag)SnowflakeSnowflake Cortex

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account