CNX Logo

CNX

Senior Databricks Engineer

Posted 5 Days Ago
In-Office or Remote
Hiring Remotely in Country Aire Home Park, IA
106K-152K Annually
Senior level
In-Office or Remote
Hiring Remotely in Country Aire Home Park, IA
106K-152K Annually
Senior level
Owns the end-to-end data lifecycle by designing, building, orchestrating, governing, and optimizing batch and streaming pipelines on Databricks. Develops lakehouse architectures, data models, quality controls, CI/CD practices, and secure Unity Catalog implementations across Azure and other cloud platforms. Leads technical design and code reviews, establishes engineering standards, mentors data engineers, monitors production pipelines, resolves issues, and collaborates with business and IT stakeholders to deliver analytics, reporting, and AI/ML data solutions.
The summary above was generated by AI

Job Title:

Senior Databricks Engineer

Job Description

We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled.
The global technology and services leader that powers the world’s best brands, today and into the future. We’re solution-focused, tech-powered, intelligence-fueled. With unique data and insights, deep industry expertise, and advanced technology solutions, we’re the intelligent transformation partner that powers a world that works, helping companies become refreshingly simple to work, interact, and transact with. We shape new game-changing careers in over 70 countries, attracting the best talent.

The Concentrix Technical Products and Services team is the driving force behind Concentrix’s transformation, data, and technology services. We integrate world-class digital engineering, creativity, and a deep understanding of human behavior to find and unlock value through tech-powered and intelligence-fueled experiences. We combine human-centered design, powerful data, and strong tech to accelerate transformation at scale. You will be surrounded by the best in the world providing market leading technology and insights to modernize and simplify the customer experience. Within our professional services team, you will deliver strategic consulting, design, advisory services, market research, and contact center analytics that deliver insights to improve outcomes and value for our clients. Hence achieving our vision.
Our gamechangers around the world have devoted their careers to ensuring every relationship is exceptional. And we’re proud to be recognized with awards such as "World's Best Workplaces," “Best Companies for Career Growth,” and “Best Company Culture,” year after year.
Join us and be part of this journey towards greater opportunities and brighter futures.

Senior Databricks Engineer - United States | Remote / Work at Home

Position Summary

The Senior Data Engineer — Databricks will own the end-to-end data lifecycle, from analysis and solution design through implementation, orchestration, governance, and optimization. This role will build modern data solutions on the Databricks Data Intelligence Platform across Microsoft Azure, AWS, or GCP, using Databricks, Python, PySpark, and SQL to deliver scalable ingestion, transformation, modeling, and pipeline orchestration.

As a senior engineer, you will lead solution design, establish engineering standards, and guide other data engineers in building reliable, governed, and production-ready data pipelines that support analytics, reporting, and AI/ML use cases.


Responsibilities
  • Design, develop, and maintain robust batch and streaming data pipelines for extracting, transforming, and loading data from multiple sources into the Databricks lakehouse on Azure.
  • Automate and streamline data ingestion using Auto Loader, Lakeflow Connect, and Azure services such as Azure Data Factory and Event Hubs.
  • Build and manage pipelines with Lakeflow Spark Declarative Pipelines, formerly Delta Live Tables, including data quality expectations and change data capture.
  • Perform complex data manipulation and transformation using PySpark and Spark SQL to prepare data for advanced analytics, reporting, and AI/ML use cases.
  • Design and implement workflow orchestration and scheduling using Lakeflow Jobs, formerly Databricks Workflows, to support reliable and efficient data operations.
  • Create scalable lakehouse data models using medallion architecture — bronze, silver, and gold — and dimensional modeling, including SCD Type 1 and Type 2.
  • Implement data governance and security in Unity Catalog, including access controls, lineage, row filters, and column masks for sensitive data.
  • Optimize performance and cost across Delta tables, Spark workloads, serverless and classic compute, and SQL warehouses.
  • Establish CI/CD and testing practices for data pipelines using Git folders, Declarative Automation Bundles, formerly Databricks Asset Bundles, and Azure DevOps or GitHub Actions.
  • Monitor pipeline health and data quality using system tables and data quality monitoring; lead root-cause analysis and resolution of production issues.
  • Lead design and code reviews, define engineering standards, and mentor data engineers across the team.
  • Collaborate with cross-functional teams, including business stakeholders and IT, to ensure data solutions meet business, performance, and project requirements.

Qualifications
  • 10+ years of professional experience in data engineering, data and analytics, or data warehousing.
  • 5+ years of hands-on experience working with Databricks in a data engineering capacity, including production workloads.
  • 5+ years of experience with Python, including manipulating large datasets using PySpark DataFrames, Spark SQL, and/or the pandas API on Spark.
  • 3+ years of data engineering experience on Microsoft Azure, including services such as ADLS Gen2, Azure Data Factory, Key Vault, and Microsoft Entra ID.
  • Strong experience designing and developing ETL/ELT pipelines for batch and streaming data workloads.
  • Experience with Databricks lakehouse architecture, Delta tables, Unity Catalog, Lakeflow Jobs, and Lakeflow Spark Declarative Pipelines.
  • Experience implementing scalable data models using medallion architecture, dimensional modeling, and slowly changing dimensions.
  • Experience with CI/CD and testing practices for data pipelines using Azure DevOps or GitHub Actions.
  • Ability to lead technical design discussions, conduct code reviews, define engineering standards, and mentor other engineers.
  • Strong collaboration skills with the ability to work across business, IT, and technical stakeholder groups.
  • Preferred certification: Databricks Data Engineer Professional.

The base salary for this position is $106,087 – $151,554 plus incentives that align with individual and company performance. Actual salaries will vary based on work location, qualifications, skills, education, experience, and competencies. Benefits available to eligible employees in this role include medical, dental, and vision insurance, comprehensive employee assistance program, 401(k) retirement plan, paid time off and holidays and paid learning days.


The deadline to apply for this position is: 11/02/2026. This position is for an existing, immediate vacancy. We are currently seeking to fill this role with an individual who can start as soon as possible.


#LI-Remote

Location:

USA, IA, Work-at-Home

Language Requirements:

Time Type:

Full time

Physical and Mental Requirements:
 
The employee is regularly required to operate a computer, keyboard, telephone/headset, and/or other office equipment as essential functions of this position. Work is generally sedentary in nature.

 

Equal Employment Opportunity:

Concentrix is an equal opportunity and affirmative action (EEO-AA) employer. We promote equal opportunity to all qualified individuals and do not discriminate in any phase of the employment process based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy or related condition, disability, status as a protected veteran, or any other basis protected by law.


For more information regarding your EEO rights as an applicant, please visit the following websites:

·    English  

·   Spanish

Accommodation:

Concentrix welcomes and encourages applications from candidates with disabilities and is committed to providing an inclusive recruitment process. If you require reasonable accommodation to participate in any stage of the application or interview process, please let us know. Requests may be made by contacting [email protected].  All information will be treated confidentially and used solely to facilitate your participation in the recruitment process.

 

Artificial Intelligence:

As part of our recruitment process, we may use artificial intelligence (AI) tools to assist in the screening and/or assessment of job applicants. These tools could be used to evaluate resumes, applications, and other materials submitted to help us identify the best candidates for the role.

 

Work Authorization:


In accordance with federal law, only applicants who are legally authorized to work in the United States will be considered for this position. Must reside in the United States or have a valid U.S. address for residence.  

 

For further information on available work states and Equal Employment Opportunity as an applicant, please click HERE

Similar Jobs

17 Days Ago
Remote
USA
180K-270K Annually
Senior level
180K-270K Annually
Senior level
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Lead operational reliability and platform enablement for Databricks: build monitoring, CI/CD, deployment standards, compute and job policies, observability, runbooks, and governance to support secure, cost-aware, production data workloads across regulated environments. Mentor engineers and align platform with cloud/infrastructure and compliance requirements.
Top Skills: Ci/CdDatabricksDatabricks Asset BundlesDatabricks WorkflowsDelta LakeInfrastructure-As-CodeService PrincipalsUnity CatalogVersion Control (Git)
5 Hours Ago
Remote
United States
187K-252K Annually
Senior level
187K-252K Annually
Senior level
Aerospace • Information Technology • Professional Services • Security • Software
Design, administer, optimize, and govern an enterprise Databricks Lakehouse Platform. Responsibilities include managing workspaces, Unity Catalog, compute, workflows, data pipelines, security controls, observability, performance, cost optimization, CI/CD, infrastructure automation, disaster recovery, and platform upgrades. The role also supports audits, compliance, troubleshooting, documentation, technical standards, and mentorship while integrating Databricks with enterprise data, business intelligence, and AI/ML environments.
Top Skills: Amazon CloudwatchSparkAWSAzure DevopsBashDatabricks ApisDatabricks Asset BundlesDatabricks LakeflowDatabricks LakehouseDatabricks WorkflowsDatadogDelta LakeDelta Live TablesDockerElasticGithub ActionsGitlab CiGrafanaIamJenkinsKubernetesPrometheusPythonRbacSQLTerraformUnity Catalog
2 Months Ago
Remote
United States
Senior level
Senior level
Information Technology • Analytics
The Sr. Data Engineer - Databricks designs and maintains scalable data solutions using Apache Spark and Databricks, ensuring data quality and performance for analytics and reporting.
Top Skills: SparkAWSAzureDatabricksDelta LakeEltETLGCPUnity Catalog

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account