Senior Data Engineer - Platform
We are looking for a Senior Data Engineer who is passionate about all things data. As a member of our Platform team you will be using best practices in quality, performance, and maintainability to support innovation at our fast-moving organization.
Your responsibilities will include developing and testing new data solutions, working with your team and others on common tools and frameworks, and identifying opportunities for system-wide improvements. The successful candidate is a leader that proactively solves problems and maintains a high bar for themselves and others.
TECHNOLOGIES THAT WE USE:
- Python, Spark, Scala, Golang, Typescript
- Snowflake, Hive, Postgres, Jupyter
- AWS Ecosystem
- Kubernetes, Docker
- Airflow
RESPONSIBILITIES:
- Build and enhance current data warehousing architecture
- Productionalize data science projects
- Design and develop stream and batch processing data pipelines
- Use advanced data modeling to shape data between various layers
- Implement data quality tests and improve related frameworks
- Review existing solutions and identify cost-effective enhancements
- Implement monitoring and alerting integrations
- Mentor engineers for development best practices and leadership
QUALIFICATIONS:
- 5+ years - Modeling, measuring, and analyzing complex data
- 5+ years - Working with Python or similar programming languages like Java, Scala
- 5+ years - Building and optimizing workflows on Snowflake, Hadoop, or other big data platforms
- Experience with testing methodologies for ensuring data quality
- Experience with data privacy and secure architectures
- Understanding of ad-tech terms and methodologies preferred
- Degree in computer science or related field preferred