Lead design and delivery of end-to-end Databricks Lakehouse architectures, cloud data modernization, ETL/ELT and streaming pipelines, medallion data modeling, governance (Unity Catalog), performance and cost optimization, ML/AI platform enablement, CI/CD and IaC, and mentor technical teams while collaborating with stakeholders.
Techwave, we are always in an exercise to foster a culture of growth, and inclusivity. We ensure whoever is associated with the brand is being challenged at every step and is provided with all the necessary opportunities to excel in life. People are at the core of everything we do.
Who are we?
Techwave is a leading global IT and engineering services and solutions company revolutionizing digital transformations. We believe in enabling clients to maximize the potential and achieve a greater market with a wide array of technology services, including, but not limited to, Enterprise Resource Planning, Application Development, Analytics, Digital, and the Internet of things (IoT).
Founded in 2004, headquartered in Houston, TX, USA, Techwave leverages its expertise in Digital Transformation, Enterprise Applications, and Engineering Services to enable businesses accelerate their growth.
Plus, we're a team of dreamers and doers who are pushing the boundaries of what's possible.
And we want YOU to be a part of it.
Job DescriptionSolution Architecture
- Design end-to-end Lakehouse architectures using Databricks.
- Define enterprise data architecture aligned with business and technology strategies.
- Lead cloud data modernization and migration initiatives.
- Develop scalable, secure, and highly available data platforms.
- Design ETL/ELT frameworks using Apache Spark and Databricks.
- Architect batch and real-time streaming data pipelines.
- Design Medallion Architecture (Bronze, Silver, Gold).
- Define data ingestion strategies for structured, semi-structured, and unstructured data.
- Implement Change Data Capture (CDC) and incremental processing.
- Design enterprise data models using:
- Dimensional Modeling
- Star Schema
- Snowflake Schema
- Data Vault
- Build semantic models for reporting and analytics.
- Design and optimize:
- Delta Lake
- Unity Catalog
- Databricks Workflows
- Delta Live Tables (DLT)
- Databricks SQL
- MLflow
- Lakeflow (where applicable)
- Establish workspace standards and architecture patterns.
- Define notebook, job, and code organization strategies.
- Optimize Spark jobs and SQL workloads.
- Improve partitioning, clustering, and file layouts.
- Reduce cloud infrastructure costs through autoscaling and efficient cluster sizing.
- Implement monitoring for compute utilization and query performance.
- Implement Unity Catalog for centralized governance.
- Design role-based access control (RBAC).
- Configure row-level and column-level security.
- Establish metadata management, lineage, and auditing.
- Ensure compliance with enterprise security and regulatory standards.
- Architect AI/ML platforms using Databricks.
- Enable ML lifecycle management with MLflow.
- Design data pipelines for machine learning workloads.
- Support Generative AI and Retrieval-Augmented Generation (RAG) solutions by integrating Databricks with vector databases and AI services where appropriate.
- Define CI/CD strategies using Azure DevOps or GitHub Actions.
- Implement Infrastructure as Code (Terraform preferred).
- Automate deployment of notebooks, jobs, workflows, and platform configurations.
- Establish version control and branching strategies.
- Lead architecture reviews and design workshops.
- Define technical standards and best practices.
- Mentor Data Engineers and Technical Leads.
- Collaborate with business stakeholders, project managers, and cloud architects.
- Provide technical leadership during project delivery.
- Databricks Lakehouse Platform
- Apache Spark (PySpark and Spark SQL)
- Delta Lake
- Unity Catalog
- Delta Live Tables
- Databricks Workflows
- Databricks SQL
- MLflow
- Structured Streaming
- Microsoft Azure (preferred)
- Azure Data Lake Storage Gen2
- Azure Data Factory
- Azure Synapse Analytics
- Azure Key Vault
- Microsoft Entra ID
- AWS or Google Cloud experience is also valuable.
- ETL/ELT Architecture
- Data Lakes
- Data Warehousing
- Data Modeling
- CDC
- Streaming Architecture
- Metadata Management
- Python
- PySpark
- SQL
- Scala (preferred)
- SQL Server
- Oracle
- PostgreSQL
- Snowflake
- Power BI
- Tableau
- Semantic Modeling
- Git
- Azure DevOps
- GitHub
- Terraform
- CI/CD Pipelines
- 10–15+ years of IT experience.
- 5+ years of hands-on Databricks architecture and implementation experience.
- Experience designing enterprise data platforms on Azure, AWS, or GCP.
- Proven experience in large-scale data migration and cloud modernization projects.
- Experience integrating enterprise systems such as SAP, Oracle, Salesforce, Workday, or other business applications.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Master's degree is preferred.
- Databricks Certified Data Engineer Professional
- Databricks Certified Data Engineer Associate
- Databricks Certified Machine Learning Professional (preferred)
- Microsoft Certified: Azure Data Engineer Associate
- Microsoft Certified: Azure Solutions Architect Expert
- Azure Fundamentals (AZ-900)
- Enterprise architecture and solution design
- Distributed data processing expertise
- Data governance and security
- Performance tuning and optimization
- Cost optimization
- Stakeholder management
- Leadership and mentoring
- Problem-solving and analytical thinking
- Communication and presentation skills
- Strategic planning
- Design enterprise Lakehouse architectures.
- Migrate legacy data warehouses to Databricks.
- Build scalable ETL/ELT pipelines using Spark.
- Implement Delta Lake and Unity Catalog.
- Establish governance, security, and metadata management.
- Optimize performance and cloud costs.
- Deliver curated datasets for BI, AI/ML, and analytics.
- Define DevOps, CI/CD, and operational best practices.
- Lead architecture reviews and guide technical teams throughout the project lifecycle.
A Databricks Architect serves as the technical leader for modern data platforms, ensuring that solutions are scalable, secure, governed, and aligned with business objectives while enabling advanced analytics and AI workloads.
Similar Jobs
.png)
Consumer Web • eCommerce • Marketing Tech • Retail • Software • Analytics • Generative AI
Lead Klaviyo's Finance systems product strategy and roadmap, partner with Finance and engineering to deliver ERP, billing, and P2P/RTC automation, embed AI into finance workflows, ensure controls and integrations for scalable financial reporting, and act as strategic technology partner to finance leadership.
Top Skills:
AIAvalaraCoupaErpIntegrationsNetSuiteOracleSox ItgcZipZuora
Machine Learning • Payments • Security • Software • Financial Services
Manage multiple software development projects and teams for a major business segment. Oversee design, implementation, resource allocation, and client relationships. Provide technical recommendations, ensure delivery quality, drive process improvements, and develop talent while aligning with enterprise risk and customer-focused objectives.
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Provide direct patient care in a clinical setting: collect vitals and histories, assist with injections, EKGs, and procedures, coordinate care, document in EMR, prepare and clean exam rooms, handle calls and administrative tasks.
Top Skills:
Electronic Medical Records (Emr)
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
