Data Engineering Manager
DISQO is a next generation consumer insights platform. We provide the highest quality consumer data to the world's largest brands, market research agencies and, analytics companies. We operate one of the world's largest true first-party consumer insights panels. This data helps our clients understand user behavior, build better experiences, and make better decisions. We utilize cutting-edge technology and innovative, out-of-the-box strategies to collect and analyze insights which help shape the products and services of tomorrow.
This is a great opportunity to join a fun, exciting & highly motivated team and upgrade your skills while creating real impact. We use a modern tech stack and cloud infrastructure. We are not only looking for work experience, but rather the willingness to step up to challenges and the ability to learn quickly.
We believe the best software is written and managed by small teams that know how to make the impossible possible. We use agile software development techniques and modern tools to focus our efforts on solving our business goals. We use OKRs to focus on what matters. We deliver early and often. We obsess over our code, architecture and infrastructure and we believe that these practices lead to higher quality products for our customers.
Check out the DISQO Developer Blog for the latest from our DISQOTECH team.
The Role:
As a member of the Engineering Management team at DISQO, you will be responsible for leading, mentoring and growing Data & ML engineers, and building a highly-effective Data & ML Engineering team within an Agile environment. Your primary goal will be to drive your team to turn a concept into reality and ensure consistent delivery of high-quality, scalable and innovative software, data pipelines and machine learning models. Data is at the heart of everything we do at DISQO and you’ll have a real direct impact on the architecture and philosophy of our data systems.
As an Engineering Manager, you are a dynamic leader who drives an engineering team to new heights each and every day. You will work closely with Product Management, Software Engineering, Platform Engineering, Data Science and other technical leaders to stay ahead of the curve with our products and architecture. You will be responsible for engineering craftsmanship and best practices on your team, drive improvements as-necessary and most importantly mentor engineers on your team to be just as awesome as you are.
What You Will Do:
- Build a world class data and ML engineering team
- Manage an Agile process that consistently delivers a quality product to customers.
- Collaborate with Data Science and Platform Engineering teams to design and build modern data and ML pipelines
- Rally your team to make and keep commitments to customers, the business, and themselves.
- Partner up with your team’s Product Manager in planning and preparing your team’s backlog.
- Mentor, coach, and assist team members to be productive and efficient contributors.
- Meet with your team to ensure their path for success is clear and we’re instilling and exhibiting the right behaviors to ensure consistent, high-quality delivery.
- Create proposals for the creation and modification of our processes and technology roadmaps in your designated area.
- Work with our Technical Program Managers to navigate inter-team dependencies, identify critical paths and plan release trains.
- Lead interviews to find the next great engineer or leader.
What you bring to the table:
- 10+ years experience in software engineering with focus on data
- 3+ years of experience managing engineering teams and designing & delivering large scale, 24/7, mission-critical data & ML pipelines and features using modern big data architectures
- 3+ years of Scala
- 3+ years of Python
- 3+ years of Spark
- 2+ years of experience with AWS data ecosystem (Redshift, SparkEMR, Glue, Athena, SageMaker, etc.)
- Deep knowledge in various ETL/ELT tools and concepts, data modeling, SQL, query performance optimization
- Experience with building stream processing applications using Kinesis or Kafka
- Experience with workflow management tools (Airflow, Oozie, Azkaban, Luigi, etc.)
- Experience with containerization, Docker and Kubernetes
- Comfortable working in Linux environment
- Ability to thrive in an agile, entrepreneurial start-up environment
Benefits & Perks:
- 100% covered Medical/Dental/Vision for employee
- Equity
- Unlimited Vacation
- Flexible work hours
- Catered lunches 3x a week
- Stocked pantry
- Happy Hours
- Onsite Fitness Program
- Discounted Gym Membership
- Quarterly Offsites
- 401K
- Life Insurance
- FSA
- Paid Maternity/Paternity leave
- Employee Assistance Program
- Travel Assistance Program
DISQO is an Equal Opportunity Employer
*Recruiting firms that submit resumes to DISQO without first entering into a written contract will not be entitled to any compensation on candidates referred by that firm.
DISQO Developer