Abacus Insights is a mission-driven, start-up technology company focused on transforming the healthcare payer industry, ultimately creating a more personalized patient experience, improving health outcomes, and lowering the overall cost of healthcare. Abacus Insights provides a flexible, efficient, and secure platform that organizes and exchanges healthcare data from various sources and formats, allowing our customers to uncover differentiated insights that address their clients' needs. Our employees know that they play an active role in keeping our customers' data safe and are responsible for ensuring that our comprehensive policies and practices are met.
With our deep expertise in cloud-enabled technologies and knowledge of the healthcare industry, we have built an innovative data integration and management platform that allows healthcare payers access to data that has been historically siloed and inaccessible. Through our platform, these health insurance payers can ingest and manage all the data they need to transform their business by supporting their analytical, operational, and financial needs.
Since our founding in 2017, Abacus has built a highly successful SaaS business, raising $100 Million by leading VC firms who have deep expertise in the healthcare and technology industries. We are solving problems of massive scale and complexity in an industry that is not only ready for disruption. We're growing quickly and would love for you to be a part of it!
About the Role:
We are looking for a Senior Data Governance and Quality Engineer to play a critical role in maintaining the integrity, accuracy, and reliability of data throughout our enterprise data ecosystem. This role involves designing and implementing scalable data quality frameworks, driving governance initiatives, and collaborating with cross-functional teams to operationalize high standards of data quality.
The ideal candidate will possess a strong understanding of data governance principles, data lifecycle management, and end-to-end data transformation processes, along with hands-on experience in deploying enterprise-level data quality solutions. As a member of our engineering team, you will be responsible for coaching, mentoring, managing, and leading team members within an agile environment.
You should expect to:
- Data Quality Framework Development: Develop, implement, and sustain a comprehensive data quality framework to systematically monitor, validate, and enhance data accuracy and consistency throughout all systems. Develop and maintain scalable data quality solutions utilizing Databricks and Apache Spark, primarily leveraging PySpark.
- Governance & Compliance: Operationalize the enterprise data governance framework, aligning with stakeholder needs related to data quality, access controls, compliance, privacy, and security.
- Data Monitoring & Auditing: Identify and address data anomalies, inconsistencies, duplicates, and missing values. Conduct periodic audits to ensure ongoing data integrity.
- Cross-Functional Collaboration: Partner with data engineers, architects, product teams, and analysts to define data quality requirements and ensure alignment with business objectives.
- Insight Generation: Develop clear and actionable dashboards and reports (e.g., Power BI, Salesforce) to visualize data quality trends, KPIs, and issue resolution progress.
- Root Cause Analysis: Collaborate with data stewards and product owners to investigate and resolve data quality issues, establishing sustainable remediation processes.
- Technical Expertise: Apply strong understanding of data models (e.g., star schema, snowflake, data marts, data lakes) to evaluate and improve data structures and flows.
- Process Ownership: Take ownership of assigned initiatives, break complex challenges into manageable components, and execute plans effectively with minimal supervision.
What we’re looking for:
- Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
- Experience: Minimum 5+ years of experience in Data Quality, Data Governance, or Data Engineering roles.Strong hands-on experience with Databricks, PySpark, Python, and SQL
- Technical Skills:o Proficiency in SQL, Python, and modern data pipeline tools.o Familiarity with data governance and quality tools (e.g., Collibra, Informatica, Alation, Great Expectations).o Experience working with cloud platforms (AWS, Azure, or GCP).o Strong understanding of BI and reporting tools such as Power BI, Tableau
- Domain Expertise:o In-depth knowledge of data lifecycle management, data lineage, and metadata management.o Awareness of current and emerging data governance and data management best practices.
- Soft Skills:o Strong analytical and problem-solving mindset.o Excellent communication and stakeholder engagement abilities.o Proven capability to operate independently and deliver results in a dynamic environment.
Equal Opportunity Employer
As a mission-led technology company that is helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. We are dedicated to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment of any type regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Top Skills
Similar Jobs
What you need to know about the Los Angeles Tech Scene
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
