Resultant Logo

Resultant

Data Engineer - Databricks

Posted Yesterday
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Chicago, IL
Junior
In-Office or Remote
Hiring Remotely in Chicago, IL
Junior
Design and implement Databricks-based Lakehouse pipelines (PySpark, Delta Lake, DLT), ensure data quality and governance (Unity Catalog), enable ML-ready datasets with MLflow, optimize performance, build CI/CD, and collaborate directly with clients and stakeholders.
The summary above was generated by AI
Company Description

Resultant is a modern consulting firm with a radically different approach to solving problems.  

We don’t solve problems for our clients. We solve problems with them. 

Through outcomes driven by data analytics, technology solutions, digital transformation, and beyond, our team works with clients in both the public and private sectors to solve their most complex challenges. We start by learning as much as we can about who they are, how they work, and what they’re striving for so we can feel their problems as our own. Partnering with our clients means their desired outcomes are always top of mind, their challenges and strengths guiding our efforts. We build client-focused relationships before we build unique solutions that blaze past expectations. 

Originally founded in Indianapolis in 2008, Resultant now employs more than 400 team members who operate from offices around the United States including Indianapolis and Fort Wayne, Indiana; Columbus, Ohio; Lansing, Michigan; Denver, Colorado; Dallas, Texas and Atlanta, Georgia. 

We’re Resultant. Clients partner with us to see a difference. People join us to make one. 

Job Description

We're looking for a Data Engineer to join our Databricks practice and help design, build, and optimize Lakehouse-based data platforms for clients across industries — from public sector agencies to healthcare, financial services, and manufacturing. You'll work hands-on with the Databricks Data Intelligence Platform to turn messy, disconnected client data into governed, trustworthy, analytics- and AI-ready assets. 

This is a client-facing consulting role. You'll partner with solution architects, data scientists, and project leads to gather requirements, design pipelines, and deliver production-grade solutions — then explain what you built and why it matters in language business stakeholders actually understand. 

 

What You'll Do 

  • Design, build, and optimize scalable ETL/ELT pipelines on Databricks using PySpark, Spark SQL, and Delta Lake 

  • Implement Medallion (Bronze/Silver/Gold) architecture patterns, applying data quality checks, schema evolution, and enforcement along the way 

  • Build declarative pipelines with Delta Live Tables (DLT) and ingest streaming/incremental data using Auto Loader and Structured Streaming 

  • Orchestrate and monitor production workloads using Databricks Workflows, integrating with tools like Airflow or Azure Data Factory where needed 

  • Configure and maintain Unity Catalog for data governance — catalogs, schemas, access controls, lineage, and PII masking 

  • Partner with data scientists to prepare feature-engineered, ML-ready datasets and support model deployment workflows using MLflow 

  • Tune cluster configuration, job design, and Photon/serverless compute for performance and cost efficiency 

  • Build and maintain CI/CD pipelines for Databricks notebooks, jobs, and asset bundles (Git-based workflows, Azure DevOps, GitHub Actions, or similar) 

  • Query, profile, and assess the quality of large, complex datasets from a wide variety of source systems 

  • Collaborate with solution leads, architects, and project managers on solution design and technical architecture decisions 

  • Participate directly in client-facing work: requirements gathering, solution reviews, and translating technical tradeoffs into plain-language business impact 

  • Document solutions clearly — architecture diagrams, data flow documentation, code comments, and runbooks 

Qualifications

Required 

  • Bachelor's degree in Computer Science, Engineering, Data Science, or a related field (or equivalent practical experience) 

  • 2+ years of hands-on data engineering experience, including production work on the Databricks platform 

  • Strong hands-on experience with PySpark and Spark SQL 

  • Practical experience with Delta Lake fundamentals — ACID transactions, OPTIMIZE/Z-ORDER, partitioning, and schema evolution 

  • Solid SQL skills across relational platforms (SQL Server, Postgres, Oracle, Snowflake, etc.) 

  • Experience with at least one major cloud platform (Azure, AWS, or GCP) and its data services 

  • Working knowledge of data modeling (dimensional modeling, 3NF) and ETL/ELT design principles 

  • Strong communication skills and comfort working directly with clients and non-technical stakeholders 

  • A collaborative, detail-oriented mindset with a bias toward solution quality and follow-through 

 

Preferred / Nice-to-Have 

  • Databricks Certified Data Engineer Associate or Professional 

  • Experience with Unity Catalog, Delta Live Tables, and Auto Loader in production environments 

  • Exposure to MLflow, Feature Store, or Databricks Vector Search for AI/ML-enabled use cases 

  • Experience with Databricks Asset Bundles and CI/CD tooling (GitHub Actions, Azure DevOps, GitLab) 

  • Familiarity with Terraform or other infrastructure-as-code tooling 

  • Experience with dbt, Kafka/Event Hubs, or BI tools (Power BI, Tableau) connected to Databricks 

  • Docker/Kubernetes experience for containerized workloads 

  • Prior consulting experience, or comfort moving across multiple client engagements and industries 

Additional Information

What It's Like to Work Here

At Resultant, we are driven by purpose—partnering with clients to take on their toughest challenges and creating outcomes that make a real difference. Success here means lasting impact, not just delivered projects. We work as collaborative experts, leaning into complexity with confidence and humility, asking smart questions, sharing ideas freely, and combining our diverse expertise to turn challenges into clear, transformative solutions. We make our outcomes visible by sharing results, stories, and lessons learned, because growth happens through shared experience.

Accountability & Ownership

Resultant offers a flexible, high-trust environment, paired with a shared commitment to accountability:

  • Take ownership of your work from start to finish and deliver on your commitments to clients and coworkers
  • Communicate proactively, especially when priorities shift
  • Focus on outcomes, follow-through, and measurable impact
  • Show up where it matters, in person or virtually, when it strengthens relationships or results
  • Do the small things brilliantly: respond timely, stay organized, and follow through to build trust

We trust each other to own our work and deliver exceptional results. Flexibility means autonomy paired with accountability: the freedom to work in ways that fit your life, balanced with the reliability our clients and coworkers count on.

Is Resultant the right spot for you?

You may thrive here if you bring curiosity and a consulting mindset to every challenge, take ownership of your growth, and give and receive feedback with intention. If you're energized by bold ideas, continuous learning, and investing in the people around you, this is your place. At Resultant, we show up for each other, own our outcomes, and build leaders who create lasting impact for our clients, our communities, and each other.

Equal Opportunity Employer 

We embrace AI across everything we do, and that includes how you prepare for this interview. Feel free to use AI tools to research the role, practice your responses, and put your best foot forward. What matters to us is getting to know the real you — how you think, how you communicate, and what you genuinely bring to the table. Our interviews are designed to go deeper than any polished answer, so come curious and come as yourself without the support of an AI tool during our conversation.

Similar Jobs

14 Days Ago
Remote or Hybrid
United States
65K-87K Annually
Senior level
65K-87K Annually
Senior level
Information Technology • Database • Consulting
Design, build, and optimize enterprise-scale data pipelines on Databricks and Azure. Implement batch, streaming, CDC, and incremental ETL/ELT solutions, Delta Lake optimizations, data quality, CI/CD, and secure, production-ready data products for analytics and AI/ML initiatives.
Top Skills: Ab InitioAzure Data Lake Storage Gen2Azure DevopsAzure Key VaultAzure SynapseCi/CdDatabricksDatabricks WorkflowsDelta LakeGitJSONLiquid ClusteringPysparkPythonRest ApisSparkSpark SqlSQLSql WarehousesUnity CatalogXMLZ-Ordering
3 Days Ago
Remote
USA
110K-143K Annually
Expert/Leader
110K-143K Annually
Expert/Leader
Fintech • Payments • Financial Services
Design, develop, test, maintain, and support secure, scalable data solutions using Snowflake and Databricks. Lead technical design, author specifications, review code, mentor engineers, ensure SDLC, audit/security compliance, and drive technical strategy while collaborating with architects and business partners. Participate in Agile ceremonies, be on-call as needed, and travel occasionally.
Top Skills: AzureDatabricksEltETLPysparkPythonSnowflakeSQL
21 Days Ago
Remote
USA
115K-145K Annually
Senior level
115K-145K Annually
Senior level
Other
Design, build, and maintain scalable data pipelines, lakes, and infrastructure using Databricks, Spark, Python, and AWS. Collaborate with ML engineers, data scientists, and analysts to deliver data products, ensure data quality and governance, implement DevOps/SDLC practices, mentor junior engineers, and evaluate new data technologies.
Top Skills: AWSDatabricksDockerGitJenkinsJIRAPostgresPythonSparkSQL

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account