Senior Data Quality Engineer

About the Role & Team
People Insights enables data-driven insights and decisions that improve business performance and enhance the employee experience. From advanced analytics and data engineering to external research and survey findings, we use our combined expertise to transform organizational, HR, and talent acquisition data into a unified BI portfolio for HR clients around the world!
As a Senior Data Quality Engineer, you will bring your natural passion for working with data that will allow you to be part of a team that enables insights to drive the enterprise HR strategy of The Walt Disney Company! In this role, you will have the chance to tap into your expertise and knowledge to champion data quality by crafting and deploying testing at scale of HR Workforce/ Talent Acquisition data in service of data warehousing and advanced analytics needs. You will bring skills and experience to increase data reliability and consistency across complex datasets and to communicate the health of the data pipeline to varying levels of analysts and partners in the organization.
What You Will Do
Expect to use your knowledge of development and testability to effect better design, promote accurate engineering outcomes, and implement proactive data quality strategies which are both scalable and maintainable. Key responsibilities to this end include:
Collaboration

• Collect data quality requirements from key partners, seeking to understand the subjective "quality" measures that are important to data consumers to build and maintain trust in our data & products
• Collaborate with Data Engineers, Business Intelligence Developers, Data Analysts, and business leaders to understand data quality challenges within data workflows and BI tools
• Collaborate across teams as a data quality advocate, guiding on the need to balance which data/sources require high accuracy versus directionally accurate data

Data Testing and Monitoring

• Develop and implement manual and automated test cases to ensure reliability of data pipelines, data migration processes and data transformations
• Design and implement intuitive metrics that show key partners and end users the health of their data in an actionable format
• Use your skills in SQL, Snowflake/AWS, and Python/R to build models that measure and evaluate the quality, consistency, resilience, accuracy, and availability of our data
• Analyze and clearly communicate impacts of data updates, changes, additions/removals to technical and non-technical partners
• Conduct initial root cause analysis for data issues, collaborating with partners to clearly identify the issue, scope of the issue, and path for research/solutioning

Automation and Optimization

• Automate processes, procedures, and workflows to ease data validation processes across complex, interdependent data systems (source systems to data warehouse environments to BI environments)
• Identify areas of improvement in data quality processes, connecting dots from data input to output, and propose solutions that improve data accuracy and reliability

Documentation

• Create and maintain documentation of test plans, cases and results

Required Qualifications & Skills

• 3+ years experience in data engineering, data quality or similar role/relevant experience
• 3+ years experience with SQL and Python or other scripting languages and experience working with Snowflake or similar cloud data warehouse platforms
• Experience with data processing concepts like mapping documents and complex data relationships
• Excellent problem-solving skills and ability to address complex data issues and investigate systemic defects
• Familiarity with statistical methods for assessing and evaluating data
• Outstanding written and oral communication skills that translate across technical and business domains
• Strong collaboration skills and ability to work effectively in a cross-functional, interdependent team environment
• You are passionate about the benefits of accurate and actionable data, you drive consistency and enjoy partnering with others to accomplish the task
• Perseverance and resilience in working with ambiguous requirements that characterize innovation projects

Preferred Qualifications

• MS in Computer Science, Engineering, Mathematics, Information Systems or related field
• Experience with reporting and visualization tools such as Tableau, Power BI or Cognos
• Proficiency in git or similar version control tools
• Experience in machine learning model development and ELT/ETL design experience
• Experience working in big data environments (Hadoop, S3, HBase)

Education

• BS in Computer Science, Engineering, Mathematics, Information Systems or related field

The hiring range for this position in California is $111,900-$136,700 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.