Onebridge Logo

Onebridge

Databricks Architect

Reposted 6 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
Expert/Leader
Remote
Hiring Remotely in United States
Expert/Leader
The Databricks Architect will design and implement scalable data and analytics platforms, optimize data pipelines, and mentor team members while ensuring alignment with business goals.
The summary above was generated by AI

Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly skilled Databricks Architect to join our innovative and dynamic team. 

Databricks Architect | About You 

As a Databricks Architect, you are responsible for designing, implementing, and governing scalable data and analytics platforms that support enterprise reporting, advanced analytics, and data‑driven decision making. You play a hands‑on role in shaping data architecture, setting technical standards, and ensuring Databricks solutions are built for performance, reliability, and long‑term scalability. You work closely with data engineers, analysts, and business stakeholders to guide solution design, review implementations, and ensure alignment with business objectives. You are actively involved in platform optimization, cost management, and the adoption of best practices across data ingestion, transformation, and analytics. As a technical leader, you mentor team members, influence architectural decisions, and help mature the organization’s overall data capabilities.

Databricks Architect | Day-to-Day 

  • Design and architect end‑to‑end data platforms using the Databricks Lakehouse architecture. 
  • Define and implement scalable batch and streaming data pipelines using Apache Spark and Delta Lake. 
  • Partner with engineering, analytics, and business teams to translate functional requirements into technical designs. 
  • Establish and enforce data modeling, performance optimization, and cost‑management best practices within Databricks. 
  • Lead cloud‑based implementations across AWS, Azure, or GCP, including networking, security, and access controls. 
  • Provide technical leadership through architecture reviews, code reviews, and design sessions. 
  • Support production environments by troubleshooting data quality, performance, and reliability issues. 

Databricks Architect | Skills & Experience 

  • 10+ years of overall experience in data engineering, data architecture, or enterprise analytics platforms. 
  • Hands‑on experience designing and implementing solutions on Databricks. 
  • Strong proficiency in Apache Spark, SQL, and Delta Lake for large‑scale data processing. 
  • Experience building and optimizing both batch and real‑time data pipelines. 
  • Proven experience working within at least one major cloud platform, including AWS, Azure, or GCP. 
  • Solid understanding of data governance concepts including security, lineage, access control, and compliance. 
  • Experience with data modeling techniques for analytical and reporting workloads. 
  • Familiarity with CI/CD practices, version control, and infrastructure‑as‑code approaches for data platforms. 
  • Demonstrated ability to mentor engineers and lead technical design discussions in cross‑functional teams. 

Similar Jobs

6 Hours Ago
Remote
United States
102K-133K Annually
Senior level
102K-133K Annually
Senior level
Artificial Intelligence • Information Technology • Professional Services • Software • Analytics • Generative AI • Big Data Analytics
Lead design and implementation of an enterprise Databricks lakehouse, build scalable batch and streaming pipelines, enforce governance and CI/CD standards, optimize Spark workloads, operationalize ML with MLflow, manage cloud infrastructure and IaC, and mentor data engineering teams.
Top Skills: AdlsAWSAzureDatabricksDatabricks Asset BundlesDatabricks WorkflowsDbxDelta LakeDelta Live TablesFeature StoreGCPGcsGitMlflowPhotonPysparkPythonS3ScalaSpark SqlSQLStructured StreamingTerraformUnity Catalog
11 Days Ago
In-Office or Remote
Expert/Leader
Expert/Leader
Information Technology • Consulting
Lead enterprise observability architecture and modernization using Splunk and Databricks. Design telemetry ingestion, data lakehouse, AIOps, security analytics, governance, and high-performance log analytics at petabyte scale while mentoring teams and aligning strategy with business and compliance goals.
Top Skills: AiopsAppdynamicsAws KinesisAzure Event HubsCriblCribl EdgeCribl StreamDatabricks LakehouseDatabricks SqlDatadogDelta LakeDelta Live TablesDynatraceEvent Streaming ArchitecturesGcp Pub/SubGenerative AiGenieHeavy ForwarderIcebergKafkaLakehouse FederationLlmsMosaic AiNew RelicOcsfOpentelemetryPythonRest ApisServicenow ItomSmartstoreSparkSplSplunk CloudSplunk EnterpriseSplunk Enterprise SecuritySplunk ItsiSQLStructured StreamingSyslogUnity CatalogUniversal Forwarder
13 Days Ago
In-Office or Remote
Senior level
Senior level
Information Technology
The role requires a highly experienced Databricks Architect to lead data engineering efforts, focusing on PySpark and ETL/ELT pipeline development, while optimizing data models on cloud platforms such as Azure, AWS, or GCP.
Top Skills: SparkAWSAzureCi/CdDatabricksDelta LakeGCPPysparkPythonScala

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account