The Senior Data Quality Engineer ensures data accuracy and integrity across platforms by developing automated tests and monitoring data quality metrics.
Cellares is seeking an innovative and highly motivated Senior Data Quality Engineer who will contribute to the development of our advanced cell therapy manufacturing platform.
The primary focus of this position is to ensure the accuracy, reliability, and integrity of data within our data platform. The individual will participate on a cross-functional team, design, build, and maintain automated testing frameworks to ensure data integrity at every stage of our data pipelines. The successful candidate should have extensive experience in quality assurance for data platforms, ideally with significant hands-on experience in the Databricks environment. They should be detail-oriented and possess strong analytical and problem-solving skills.
Candidates should enjoy working in a fast-paced, mission-driven environment, and be prepared to tackle a broad selection of challenges as the company grows. Candidates should be great team players with the ability to work with minimal supervision.
Responsibilities
- Build and maintain automated data validation tests using Databricks notebooks and tools like Pytest
- Test data ingestion, transformation, and loading processes within the Databricks Lakehouse, specifically focusing on the Bronze, Silver, and Gold layers of the Medallion architecture
- Implement tests for data accuracy, completeness, consistency, timeliness, and uniqueness at different points in the pipeline to catch data issues early
- Reconcile data by comparing record counts, schemas, and values between source systems and target tables in Databricks
- Implement automated data quality checks within data pipelines to ensure no data regressions occur with new code deployments
- Implement automated monitoring and alerting for data quality metrics, identifying anomalies in data freshness, schema evolution, and volume
- Work closely with data engineers and product owners to understand data requirements and ensure data quality meets business needs
- Ensure compliance with data governance policies by building quality checks that validate data sensitivity, masking, and lineage, leveraging tools like Unity Catalog
- Communicate project status and new discoveries in a clear and timely manner during daily stand-ups
Requirements
- Bachelor’s or Master’s in Computer Science, Electrical Engineering, or related field and 5+ years of relevant experience
- Experience with data pipeline and data quality testing strategy and execution, with significant hands-on experience in the Databricks environment
- Strong proficiency in Python for developing and executing data validation scripts
- In-depth knowledge of Databricks, Delta Lake, and the Lakehouse architecture
- Proficiency in writing complex SQL queries for data validation, reconciliation, and troubleshooting issues
- Solid understanding of data warehousing concepts, including dimensional modeling (star/snowflake schemas)
- Hands-on experience with Azure, including Azure storage and data services that integrate with Databricks
- Ability to process data, interpret testing results and provide feedback to the team
- Desire to be part of a rapidly evolving organization, with compelling technology, and taking products and processes to the next level
- Self-awareness, integrity, authenticity, and a growth/entrepreneurial mindset
This is Cellares
Cellares is the first Integrated Development and Manufacturing Organization (IDMO) and takes an Industry 4.0 approach to mass manufacturing the living drugs of the 21st century. The company is both developing and operating integrated technologies for cell therapy manufacturing to accelerate access to life-saving cell therapies. The company’s Cell Shuttle integrates all the technologies required for the entire manufacturing process in a flexible and high-throughput platform that delivers true walk-away, end-to-end automation. Cell Shuttles will be deployed in Cellares’ Smart Factories around the world to meet total patient demand for cell therapies at global scale. Partnering with Cellares enables academics, biotechs, and pharma companies to accelerate drug development and scale out manufacturing, lower process failure rates, lower manufacturing costs, and meet global patient demand.
The company is headquartered in South San Francisco, California with its commercial-scale IDMO Smart Factory in Bridgewater, New Jersey. The company is backed by world-class investors and has raised over $355 million in financing.
Leveling will be based on overall experience, education, and demonstration of knowledge throughout the interview process.
Top Skills
Azure
Databricks
Delta Lake
Pytest
Python
SQL
Similar Jobs
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
As a Business Technology Solutions Associate Consultant, you will collaborate with teams to implement technology solutions, manage projects, provide mentorship, and guide deliverables while ensuring high-quality client experiences.
Top Skills:
Big DataCloud PlatformsData AnalyticsData ManagementData WarehousingPythonRdbmsSQL
Financial Services
The IB Technology Group Business Manager will advise on business strategy, manage client agendas, develop performance metrics, support executive requests, and mitigate business risks while ensuring effective communication across teams and stakeholders.
Top Skills:
Data AnalyticsFinancial AnalysisProject Management
Financial Services
As a Treasury Management Officer, you will drive new business, manage client relationships, provide treasury solutions, and enhance profitability.
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
