Senior Data Engineer

Overview:
Corporate Tools is hiring a Senior Data Engineer for up to $150,000/year. You will be a traditional company employee. This is a full time 40 hour M-F remote position with company benefits.
As a Senior Data Engineer at Two Barrels, you will work closely with our Software and Analyst teams to manage everything that has to do with data. This role will help get large datasets into the hands of people that need it while also making sure it doesn't adversely impact other things we have going on in our software ecosystem. There will be a heavy focus on infrastructure, data pipelines and scalable database design - we want someone who can help us improve our current databases and infrastructure and maintain it in a cost-effective manner. This is more than just building and maintaining ETL pipelines. We need innovation, creativity, and solutions that will have a significant impact on how our data is handled and created.
Wage:
$150,000/year
Benefits:

• 100% employer-paid medical, dental and vision for employees
• Annual review with raise option
• 22 days Paid Time Off accrued annually, and 4 holidays
  • After 3 years, PTO increases to 29 days. Employees transition to flexible time off after 5 years with the company-not accrued, not capped, take time off when you want
  • The 4 holidays are: New Year's Day, Fourth of July, Thanksgiving, and Christmas Day
• Paid Maternity and Paternity Leave
• Up to 5% company matching 401(k) with no vesting period
• Quarterly allowance
  • Use to make your remote work set up more comfortable, for continuing education classes, a plant for your desk, coffee for your coworker, a massage for yourself... really, whatever
• Open concept office with friendly coworkers
• Creative environment where you can make a difference
• No dumb benefits like free dog walking on the weekends that snobby hipster places have to make you feel cool, but mathematically won't cost the company much money because you won't use it
• Trail Mix Bar --- oh yeah

Responsibilities:

• Focus on data infrastructure. Lead and build out data services/platforms from scratch (using OpenSource tech).
• Creating and maintaining transparent, bulletproof ETL (extract, transform, and load) pipelines that cleans, transforms, and aggregates unorganized and messy data into databases or data sources.
• Consume data from roughly 40 different sources
• Collaborate closely with our Data Analysts to get them the data they need.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Improve existing data models while implementing new business capabilities and integration points.
• Creating proactive monitoring so we learn about data breakages or inconsistencies right away.
• Maintaining internal documentation of how the data is housed and transformed.
• Improve existing data models, and design new ones to meet the needs of data consumers across Two Barrels.
• Stay current with latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to fellow engineers, data analysts, and stakeholders.

Requirements:

• Bachelor's (BA or BS) in computer science, or related field.
• 2+ years in a full stack development role
• 4+ years of experience working in a data engineer role, or related position.
• 2+ years of experience standing up and maintaining a Redshift warehouse
• 4+ years of experience with Postgres, specifically with RDS.
• 4+ years of AWS experience, specifically S3, Glue, IAM, EC2, DDB, and other related data solutions.
• Experience working with Redshift, DBT, Snowflake, Apache Airflow, Azure Data Warehouse, or other industry standard big data or ETL related technologies.
• Experience working with both analytical and transactional databases.
• Advanced working SQL (Preferably PostgreSQL) knowledge and experience working with relational databases.
• Experience with Grafana or other monitoring/charting systems.
• Proven knowledge of data platforms and tangible examples of designing and developing complex data pipelines to support better decision making in the business.
• Experience hosting and operating data platforms in cost efficient manner.
• Ability to translate business requirements into non-technical, lay terms.
• Proven expertise with data architecture design and deployment, data modeling, and database development.
• Professional experience with Kafka