DISQO Logo

DISQO

Lead Data Platform Engineer

Posted Yesterday
Be an Early Applicant
Easy Apply
Hybrid
Los Angeles, CA
70K-120K
Senior level
Easy Apply
Hybrid
Los Angeles, CA
70K-120K
Senior level
Lead the development of scalable data platforms and pipelines for AI workloads, ensuring data quality and infrastructure optimization through collaboration and best practices.
The summary above was generated by AI
DISQO’s mission is to build the world’s most trusted ad measurement platform that fuels brand growth. The world’s largest brands, agencies, and media companies trust DISQO for expert insight and AI-driven intelligence about their advertising performance across all platforms. We capture people’s sentiments and journeys,  connecting them with the brands they value and the media they consume. With this identity-based approach, brands gain more accurate and authentic insight so they can create more meaningful interactions.

When you join DISQO Nation, you join a community that values trust, transparency and innovation. We invest in our employees and apply a bottom-up management approach, rooted in the concept of servant leadership. We approach each day eager to learn, grow, and make a lasting impact. Best of all, we have fun while doing it!

We use a modern tech stack and cloud infrastructure. We are not only looking for work experience, but rather the willingness to step up to challenges and the ability to learn quickly.

We believe the best software is written and managed by small teams that know how to make the impossible possible. We use agile software development techniques and modern tools to focus our efforts on solving our business goals. We use OKRs to track everything we do. We deliver early and often. We obsess over our code, architecture and infrastructure and we believe that these practices lead to higher quality products.

What you get to do:

  • Lead the design, development, and optimization of high-performance, scalable data pipelines and platforms that power Data Products and AI/ML workloads across structured/unstructured data.
  • Architect and deliver robust data infrastructure solutions that support large-scale data processing, AI/ML model training pipelines, and observability systems.
  • Collaborate cross-functionally with product managers, software engineers, and platform teams to deliver secure, scalable, and efficient data solutions.
  • Own and drive key projects that enhance data capabilities, including database design, pipeline orchestration, system integration, and process automation.
  • Spearhead infrastructure modernization initiatives, including re-architecting observability stacks and automating workflows using Infrastructure as Code (Terraform).
  • Implement and enhance LLM-based AI pipelines, including prompt engineering, output evaluation, and performance tuning in production environments.
  • Evaluate, monitor, and improve the reliability, latency, and throughput of mission-critical systems using tools like Prometheus and Grafana.
  • Ensure best practices in data governance, quality assurance, and performance optimization are followed across teams and platforms.
  • Translate business requirements into scalable technical specifications and maintain detailed, auditable documentation of design decisions and system architecture.
  • Champion Agile and DevOps methodologies, participate in sprint planning, and promote continuous improvement across the engineering lifecycle.
  • Lead code reviews, define coding standards, and mentor junior engineers on technical excellence and delivery efficiency.
  • Participate in an on-call rotation to provide operational support for critical data platform services and data pipeline jobs.

What you bring to the role:

  • 7+ years of experience in SRE, DevOps, or Data Platform Engineering roles with a strong foundation in infrastructure, observability, and automation.
  • 7+ years of hands-on expertise in enterprise data engineering, managing data architecture, and delivering platform capabilities at scale.
  • Advanced proficiency in AWS cloud services—especially EKS, EMR, Glue, Athena, IAM, VPC, and infrastructure automation tools.
  • Deep experience in Spark (Scala/Python), Hadoop, and real-time data streaming platforms such as Kinesis/Kafka.
  • Proven ability to build, tune, and manage data solutions across RDBMS, NoSQL, and vector databases.
  • Practical knowledge of GenAI and LLM pipelines, including prompt engineering, model monitoring, and embedding vector storage.
  • Strong command of SQL, data modeling, performance tuning, and ELT/ETL frameworks and tools.
  • Experience with Airflow or equivalent orchestration tools (e.g., Luigi, Azkaban, Oozie).
  • Familiarity with Linux environments and scripting for automation and system maintenance.
  • Passion for mentoring and developing talent within a dynamic, agile engineering environment.
  • Ability to thrive in a fast-paced, start-up culture with a problem-solving mindset and a strong sense of ownership.

#LI-MV1 #LI-Hybrid

At DISQO, we pride ourselves on having a positive, performance-oriented workplace that includes a flexible hybrid approach, competitive medical benefits, and an amazing vacation policy. Read more about our culture on Glassdoor.

You can learn more about what’s happening at DISQO by visiting the DISQO Developer Blog or the DISQO Company Blog.

Perks & Benefits:

·100% covered Medical/Dental/Vision for employee, competitive dependent coverage
·Equity
·401K
·Generous PTO policy
·Flexible workplace policy
·Team offsites, social events & happy hours
·Life Insurance
·Health FSA
·Commuter FSA (for hybrid employees)
·Catered lunch and fully stocked kitchen
·Paid Maternity/Paternity leave
·Disability Insurance
·Travel Assistance Program
·24/7 Counseling Services offered to Employees

Note: The benefits noted above are for full time US based employees only.

DISQO is an equal opportunity employer. Discovery, innovation, and growth are possible when we open ourselves to new possibilities, perspectives, and approaches. That’s why, at DISQO, we welcome, support, and empower individuals from diverse backgrounds. Exceptional teams are rooted in extraordinary people, each with a unique story and a compelling set of skills. DISQO does not discriminate against employees based on race, color, religion, sex, national origin, gender identity or expression, age, disability, pregnancy (including childbirth, breastfeeding, or related medical condition), genetic information, protected military or veteran status, sexual orientation, or any other characteristic protected by applicable federal, state or local laws.

*Recruiting firms that submit resumes to DISQO without first entering into a written contract will not be entitled to any compensation on candidates referred by that firm.

Top Skills

Airflow
AWS
Genai
Hadoop
Kafka
Kinesis
Linux
Llm
NoSQL
Python
Rdbms
Scala
Spark
SQL
Terraform
HQ

DISQO Glendale, California, USA Office

Located in the heart of downtown Glendale’s thriving tech community, DISQO is conveniently near a myriad of great eateries & entertainment options.

Similar Jobs at DISQO

24 Days Ago
Easy Apply
Remote
Hybrid
2 Locations
Easy Apply
50K-80K
Senior level
50K-80K
Senior level
Big Data • Cloud • Marketing Tech • Software • Analytics
The Insights Manager will lead customer advocacy and ensure high satisfaction by managing ad measurement projects, optimizing delivery processes, and leveraging data visualization tools to enhance insights and performance for clients.
Top Skills: DmpsDspsLookerMetabaseTableau
7 Days Ago
Easy Apply
Hybrid
Los Angeles, CA, USA
Easy Apply
50K-100K
Senior level
50K-100K
Senior level
Big Data • Cloud • Marketing Tech • Software • Analytics
The Technology Chief of Staff will support the CTO by managing initiatives, driving strategic planning, overseeing operations, and facilitating communication within the technology department.
Top Skills: AgileAha!AIJIRA
16 Days Ago
Easy Apply
Hybrid
Los Angeles, CA, USA
Easy Apply
Junior
Junior
Big Data • Cloud • Marketing Tech • Software • Analytics
As an Account Development Representative at DISQO, you will engage with leads to explain solutions, identify opportunities, and book meetings. You will utilize a consultative approach, manage objections, collaborate with sales and marketing teams, and maintain accurate lead data in the CRM.

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account