How you will impact the organization…

The Lead Data Engineer, you will be responsible for designing, implementing, and maintaining robust data infrastructure and pipelines to support our data acquisition, management and reporting initiatives. This role will also collaborate with cross-functional teams to develop and deploy scalable data pipelines. They will lead efforts to not only provide traditional EDW reporting and analytics but also key decision making insights that will drive the organization decision making.

The value you will deliver…

• Design and implement scalable and efficient data infrastructure, including data ingestion, data storage, and processing data pipelines, for all company data, including but not limited to customer data, product data, financial data, and operational data.
• Develop and maintain data governance policies, ensuring data quality, security, and compliance with relevant regulations. Implement master data management to create a uniform and a standard set of attributes for core entities across the organization.
• Collaborate with cross-functional teams to identify and address data-related challenges, provide actionable business and analytical insights, and contribute to data-driven decision-making processes.
• Responsible for overall technical architecture of Enterprise BI and EDW
• Monitor and alert on Data Quality into and within the EDW. 
• Collaborate with business stakeholders, and software engineers to understand business requirements and translate them into technical solutions.
• Lead and mentor a team of data engineers, providing technical guidance and promoting best practices for data engineering.
• Design and implement ETL processes to load data from a variety of sources into the data warehouse.
• Evaluate and select appropriate technologies, tools, and frameworks for real-time and batch data processing, storage, and analysis, ensuring scalability and performance.
• Stay up-to-date with the latest advancements in data engineering and assess their potential impact on our systems and processes, and recommend ways to improve the company’s data infrastructure and efficiency
• Drive continuous improvement initiatives, identify bottlenecks, and implement optimizations to enhance the efficiency and reliability of data pipelines and machine learning models and workflows. 
• Participate in code reviews and provide feedback on design and implementation and help troubleshoot production issues when they arise. Perform other duties as assigned
• Back up the department manager related to team tasks, reviewing team time in Jira, project status updates. Assigning tasks and attending meetings related to new projects
• Clearly articulate technical concepts to non-technical stakeholders, such as business executives, and be able to translate business requirements into technical solutions for your team
• Delegate tasks and ensure that tasks are completed efficiently and effectively.
• Other responsibilities as assigned by your leaders
• Partner with the department manager in building and executing data engineering roadmap and budgeting. 
• Perform other duties and responsibilities as required, assigned, or requested. Consensus reserves the right to add or change duties at any time.

What you will bring to the table…

• 7+ years professional experience as a data engineer or similar role designing and implementing large-scale data infrastructure and data pipelines utilizing ETL and ELT techniques. 
• 7+ years of proficiency in programming languages such as Python and experience with related frameworks and libraries (e.g., Apache Spark, Pandas, Apache Airflow)
• 7+ years of solid understanding and experience with data warehousing, data and dimensional modeling.
• Ability to clearly demonstrate effective business communication skills verbally and in writing to both internal and (external) stakeholders. 
• 7+ years proficiency in SQL and experience in optimizing and tuning queries on data warehouse and relational databases, including Postgres and Oracle.
• 2+ years of proven experience leading a team 
• 2+ years of experience with cloud platforms and expertise with their data services and tools
• Extensive experience in data engineering, including designing and implementing large-scale data infrastructure and Extract, Load, and Transform (ELT)  pipelines.
• Ability to clearly demonstrate effective business communication skills verbally and in writing to both internal and (external) stakeholders.

You will stand out if you also have…

• Experience with AWS data services and tools.
• Experience having modeled and implemented data sciences practice.
• Experience with CI/CD pipelines as applied to Data Engineering.
• Experience solving problems across multiple business domains like finance, marketing and sales etc for several businesses.
• Experience with revenue forecasting.
• Demonstrated leadership in large scale implementations.

Additional details…

• Location requirements: Remote
• Travel requirements: Up to 5% domestic travel 
• Physical requirements: Must be able to sit for long periods, as well as, handle long periods of screen time.
• Technology requirements: Reliable, high speed internet
• Work Authorization: This position is not eligible for sponsorship

The salary range for this role is $157,000 - $167,000 USD. The total compensation package for this position is negotiable and may also include [annual performance bonus, ESPP, enhanced time off packages and benefits.]