Mayo Clinic Logo

Mayo Clinic

Principal Data Engineer - Enterprise Data & Analytics - Remote

Posted One Month Ago
In-Office or Remote
Hiring Remotely in Rochester, MN
Senior level
In-Office or Remote
Hiring Remotely in Rochester, MN
Senior level
Hands-on principal data engineer defining enterprise-scale data architecture, building and optimizing data pipelines/integrations for analytics and ML, deploying production code, mentoring engineers, and partnering with product and ML teams to transform and analyze data for actionable insights.
The summary above was generated by AI

The Principal Data Engineer serves as a hands-on technical authority responsible for defining and implementing enterprise-scale data architecture and engineering strategies while actively contributing to solution design, development, optimization, and technical delivery. As part of an assigned product team, this role develops and deploys data pipelines, integrations, and transformations to support analytics and machine learning applications using open-source programming languages and vendor software. The position requires a strong understanding of the organization’s current solutions, coding languages, tools, and Enterprise Data and Analytics technology framework, as well as the ability to apply independent judgment, provide consultative services to departments, divisions, and leadership committees, and partner with product owners and Analytics and Machine Learning delivery teams to identify and retrieve data, conduct exploratory analysis, transform data, visualize trends, build and validate analytical models, and translate qualitative and quantitative assessments into actionable insights.

Key responsibilities:
These positions are hands-on engineering roles. In this role, employees are expected to actively design, develop, review, and optimize production code and platform capabilities while providing technical leadership and mentorship to engineering teams.
 

Qualifications

A Bachelor's degree in a relevant field such as engineering, mathematics, computer science, information technology, health science, or other analytical/quantitative field and a minimum of seven years of professional or research experience in data visualization, data engineering, analytical modeling techniques; OR an Associate's degree in a relevant field such as engineering, mathematics, computer science, information technology, health science, or other analytical/quantitative field and a minimum of nine years of professional or research experience in data visualization, data engineering, analytical modeling techniques. In-depth business or practice knowledge will also be considered. 

Incumbent must have the ability to manage a varied workload of projects with multiple priorities and stay current on healthcare trends and enterprise changes. Interpersonal skills, time management skills, and demonstrated experience working on cross functional teams are required. Requires strong analytical skills and the ability to identify and recommend solutions and a commitment to customer service. The position requires excellent verbal and written communication skills, attention to detail, and a high capacity for learning and problem resolution. Advanced experience in SQL is required. Advanced Experience in scripting languages such as Python, JavaScript, PHP, C++ or Java & API integration is required. Experience in hybrid data processing methods (batch and streaming) such as Apache Spark, Hive, Pig, Kafka is required. Experience with big data, statistics, and machine learning is required. The ability to navigate linux and windows operating systems is required. Knowledge of workflow scheduling (Apache Airflow Google Composer), Infrastructure as code (Kubernetes, Docker) CI/CD (Jenkins, Github Actions) is required. Experience in DataOps/DevOps and agile methodologies is required. Experience with hybrid data virtualization such as Denodo is preferred. Working knowledge of Tableau, Power BI, SAS, ThoughtSpot, DASH, d3, React, Snowflake, SSIS, and Google Big Query is preferred. 

The preferred candidate will possess:

  • Expert-level proficiency in Python and SQL with extensive experience developing enterprise-scale production systems.
  • Advanced expertise in scalable distributed computing frameworks and modern data processing platforms.
  • Advanced experience implementing and governing open data architectures utilizing Apache Iceberg, Delta Lake, Apache Hudi, and related technologies.
  • Deep understanding of modern analytical storage formats including Parquet, Avro, and ORC.
  • Demonstrated expertise in lakehouse architecture, data platform design, and large-scale data engineering practices.
  • Experience architecting and implementing cloud-agnostic solutions across multiple technology ecosystems.
  • Experience designing highly scalable, fault-tolerant, secure, and observable data platforms supporting analytics, AI, machine learning, and operational workloads.
  • Experience establishing enterprise engineering standards, architecture patterns, and modernization strategies.
About Us
Why Mayo Clinic

Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans – to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic.

Benefits Highlights
  • Medical: Multiple plan options.
  • Dental: Delta Dental or reimbursement account for flexible coverage.
  • Vision: Affordable plan with national network.
  • Pre-Tax Savings: HSA and FSAs for eligible expenses.
  • Retirement: Competitive retirement package to secure your future.
About the Team
Just as our reputation has spread beyond our Minnesota roots, so have our locations. Today, our employees are located at our three major campuses in Phoenix/Scottsdale, Arizona, Jacksonville, Florida, Rochester, Minnesota, and at Mayo Clinic Health System campuses throughout Midwestern communities, and at our international locations. Each Mayo Clinic location is a special place where our employees thrive in both their work and personal lives. Learn more about what each unique Mayo Clinic campus has to offer, and where your best fit is. 

Equal Opportunity

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law".  Mayo Clinic participates in E-Verify and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.

Similar Jobs

8 Minutes Ago
Remote
United States
Expert/Leader
Expert/Leader
Artificial Intelligence • Information Technology • Professional Services • Software • Analytics • Generative AI • Big Data Analytics
Leads UX strategy and experience design for enterprise clients, guiding multidisciplinary teams from research and discovery through implementation. Responsibilities include design leadership, client consulting, user research, interaction design, design systems, accessibility, AI-enabled experiences, stakeholder alignment, and business development. The role manages and mentors designers, presents to executives, supports agile product teams, and contributes to proposals and practice growth.
Top Skills: AIFigjamFigmaGenerative AiWcag
13 Minutes Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
16-16 Hourly
Junior
16-16 Hourly
Junior
eCommerce • Edtech • Insurance • Mobile • Real Estate • Software
Provides empathetic support to students through calls, chats, texts, and emails. Handles Tier II tickets and escalations, resolves issues, uses AI-powered tools, documents feedback and product bugs, and shares insights with stakeholders. The role requires strong communication, multitasking, de-escalation, time management, product learning, and availability for evening or weekend shifts. It is primarily remote and customer-facing, with interactions occupying over 80% of the workday.
Top Skills: Ai-Powered Support ToolsWeb Browsers
14 Minutes Ago
Remote
United States
90K-120K Annually
Senior level
90K-120K Annually
Senior level
Software
Own CX operations roadmap initiatives from concept through delivery, identifying opportunities for automation and AI. Build and optimize Salesforce and Intercom workflows, integrations, reports, dashboards, surveys, and routing logic. Partner with Engineering, Business Systems, BI, Sales, Finance, Marketing, and Enablement to deliver cross-functional solutions, drive adoption, and manage change. Analyze CX metrics including NPS, CSAT, retention, support, and success data to provide leadership recommendations while tracking risks, dependencies, and initiative progress.
Top Skills: Artificial IntelligenceBusiness Intelligence ToolsDelightedIn-App Messaging PlatformsIntercomQualtricsSalesforceSQLWorkflow Automation

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account