As a Senior Data Engineer, you will architect and manage data pipelines, ensure data quality, collaborate on analytics, and support operational challenges in healthcare data management.
As a Senior Data Engineer at Regard, you will own the data pipelines and infrastructure that turn raw data into the metrics and insights that drive our product decisions and research. We run an engineering-first stack that prioritizes transparent, code-driven systems over black-box services, and you will be responsible for architecting and evolving these systems.
You will set the technical standards and take full ownership of our data platform's reliability, performance, and data quality, going beyond basic monitoring to tackle real operational challenges. This includes analyzing and tuning Spark workloads and partitioning strategies to control costs, handling breaking upstream changes, and enforcing rigorous data quality standards so our analytics are as dependable as our application code.
About Regard
Our mission is to bring world-class healthcare to everyone. Regard is an AI-powered Proactive Documentation platform that advances how care is delivered by reviewing all patient data in the EHR to recommend diagnoses and surface clinical evidence. Regard drafts a note even before the physician sees the patient, enabling an approach that gets documentation right at the point of care - we call it Proactive Documentation. This improves quality of care, reduces physician burden, and improves hospital finances. We are excited by challenges, mission-oriented work, and meaningful relationships. We work closely with some of the top health systems in the country and are leading the change that healthcare - one of the largest and most inefficient industries in the world - needs. We want you to join us.
Our Tech Stack:
- Data: Apache Iceberg, EMR, PySpark, Dagster, Clickhouse, PostgreSQL, Metabase
- Backend: Python (FastAPI, Flask), Redis, Celery
- Infrastructure & DevOps: Docker, Kubernetes, AWS (SQS, SNS), GitLab CI/CD
- APIs & AI: OpenAPI, OpenAI (GPT models)
Responsibilities:
- Collect, model, and consolidate data into the data platform to support analytics, ML development, and research initiatives
- Design, build, and evolve data models and pipelines that reliably transform and deliver data to downstream consumers
- Own data quality in collaboration with engineering teams, ensuring datasets are trustworthy and production-ready
- Partner closely with product to deliver analytics and actionable insights to internal and external stakeholders
- Own the reliability and day-to-day operation of the data platform and its pipelines through proactive monitoring, alerting, and operational management
Minimum Qualifications:
- Bachelors degree in Computer Science, Mathematics, Statistics, or a related field, or equivalent practical experience
- 5+ years of experience in data engineering roles building and operating production data pipelines
- 3+ years of experience working with public cloud platforms (e.g., AWS services such as Glue, Kinesis, or EMR)
- Strong proficiency in Python and SQL
- Hands-on experience across the full data stack, with particular depth in data modeling and pipeline design
- Willingness to participate in on-call operational support for owned systems
- Ability to travel up to four weeks per year for company co-working and/or retreat weeks
- Strong verbal and written communication skills
Preferred Qualifications:
- Experience working with healthcare data, including HIPAA compliance, data de-identification, and familiarity with open data standards such as OMOP CDM
- Experience building and supporting data pipelines for ML workflows, including model training, validation, deployment, and ongoing performance evaluation
Hybrid Work | Location | Work Authorization
- For this role, Regard is currently only considering candidates who are authorized to work in the US without visa sponsorship, and are within the New York City, Los Angeles, or San Francisco metro areas
- We expect our Engineers to be in the office on Tuesdays and Thursdays. We may request more frequent in-office work during the onboarding period
- We will provide relocation assistance to anyone who does not already reside in the NYC metro area
- We prefer hiring people within commuting distance of our offices because we value getting together in person regularly
- For those who enjoy working from our LA or Manhattan offices on a more regular basis, we offer catered lunches and other fun perks
- Additionally, hybrid employees have the flexibility to work from locations outside of their home office from up to 6 weeks per year
Comp | Perks | Benefits
- Eligible for equity
- 99% employer paid health benefits (Medical, Dental, and Vision) + One Medical subscription
- 18 PTO days/yr + 1 week holiday break
- Monthly health & wellness budget
- Company-sponsored team retreat + social events
- A sabbatical program
Our goal at Regard is to provide and maintain a work environment that fosters mutual respect, professionalism and cooperation. Regard is proud to be an equal opportunity employer that does not discriminate on the basis of actual or perceived race, creed, color, religion, national origin, ancestry, alienage or citizenship status, age, disability or handicap, sex, gender identity, marital status, familial status, veteran status, sexual orientation or any other characteristic protected by applicable federal, state or local laws. We celebrate diversity and are proud of our supportive, inclusive workplace.
All candidates must successfully complete a background check as part of the hiring process.
Top Skills
Apache Iceberg
AWS
Celery
Clickhouse
Dagster
Docker
Emr
Fastapi
Flask
Gitlab Ci/Cd
Kubernetes
Metabase
Openai
Openapi
Postgres
Pyspark
Python
Redis
Regard Los Angeles, California, USA Office
We are a short distance from downtown Culver City, a charming collection of outdoor cafes, unique shops, galleries, and nightlife opening onto tree-lined boulevards. We are 5 miles from Beverly Hills, 8 miles from DTLA and Santa Monica Beach.
Similar Jobs
Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Seeking a Senior Data Engineer to design and optimize data architecture and pipelines, ensuring data quality and enabling advanced analytics through AI and machine learning techniques.
Top Skills:
Apache AirflowAWSAws RedshiftAzureAzure SynapseDbtHadoopJavaKafkaKinesisPytestPythonPyTorchScalaScikit-LearnSeleniumSnowflakeSparkSQLTensorFlow
Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Seeking a Senior Data Engineer to design and optimize data pipelines, ensuring data quality and supporting advanced analytics. Responsibilities include building data architectures, developing automated testing, and collaborating with stakeholders.
Top Skills:
Apache AirflowAWSAzureAzure SynapseDbtHadoopJavaKafkaKinesisPytestPythonPyTorchRedshiftScalaScikit-LearnSeleniumSnowflakeSparkSQLTensorFlow
Agency • Information Technology • Internet of Things • Design • App development
The Senior Data Engineer will design and maintain data pipelines, ensuring scalability and reliability while integrating diverse data sources and optimizing workflows.
Top Skills:
AirflowAndroidAospClaudeDagsterElixir PhoenixFlutterGoogle Cloud PlatformGoogle GeminiJavaKotlinNode ExpressOpenaiPrefectPysparkPythonPython DjangoReact NativeRuby On Rails
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
