Design, build, and optimize cloud-native Databricks Lakehouse data pipelines on AWS. Implement governance (Unity Catalog, lineage, retention), medallion architecture, data quality frameworks, and performance tuning. Enable secure analytics, semantic layers, and self-service reporting. Collaborate with architects, cloud and cybersecurity teams, and produce documentation, operational procedures, and platform modernization deliverables.
Previous experience with a government client is required.
This is a remote position with a federal client who is based in Lanham, MD. Candidates must reside and perform work within the United States.
Position Overview
We are seeking two Senior Databricks Data Engineers to support a large-scale federal Enterprise Data Platform (EDP) modernization initiative. This role will focus on designing, developing, optimizing, and governing cloud-native data solutions utilizing Databricks Lakehouse technologies and Amazon Web Services (AWS).
The ideal candidate possesses extensive experience building enterprise-scale data pipelines, implementing data governance controls, optimizing large-scale data processing workloads, and enabling secure analytics capabilities in cloud environments. This position offers the opportunity to support a mission-critical federal data platform supporting trusted data intake, governed access, and advanced analytics capabilities.
Key Responsibilities
This is a remote position with a federal client who is based in Lanham, MD. Candidates must reside and perform work within the United States.
Position Overview
We are seeking two Senior Databricks Data Engineers to support a large-scale federal Enterprise Data Platform (EDP) modernization initiative. This role will focus on designing, developing, optimizing, and governing cloud-native data solutions utilizing Databricks Lakehouse technologies and Amazon Web Services (AWS).
The ideal candidate possesses extensive experience building enterprise-scale data pipelines, implementing data governance controls, optimizing large-scale data processing workloads, and enabling secure analytics capabilities in cloud environments. This position offers the opportunity to support a mission-critical federal data platform supporting trusted data intake, governed access, and advanced analytics capabilities.
Key Responsibilities
- Design, develop, and maintain scalable data ingestion, transformation, and publishing pipelines utilizing Databricks and AWS services.
- Implement and optimize Databricks Lakehouse capabilities including Unity Catalog, Delta Live Tables, Auto Loader, Databricks SQL, and Delta Sharing.
- Build and maintain governed data products supporting operational, analytical, reporting, and machine learning workloads.
- Develop and support medallion architecture data pipelines and enterprise data quality frameworks.
- Implement data governance controls, metadata management, lineage tracking, and data retention policies.
- Collaborate with cloud engineers, architects, cybersecurity specialists, and business stakeholders to deliver secure, production-ready solutions.
- Optimize platform performance through partitioning, clustering, caching, workload tuning, and query optimization techniques.
- Support analytics enablement through semantic layers, dashboards, reporting solutions, and self-service data access capabilities.
- Participate in architecture reviews, operational readiness activities, platform modernization initiatives, and continuous improvement efforts.
- Create and maintain technical documentation, design artifacts, operational procedures, and engineering standards.
- Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or a related discipline.
- Minimum eight (8) years of experience in cloud-based data engineering, platform development, or data architecture.
- Minimum three (3) years of hands-on Databricks experience in production environments.
- Experience designing, developing, and supporting large-scale ETL/ELT solutions.
- Strong experience with AWS services including S3, IAM, Glue, Athena, Lambda, Redshift, and CloudWatch.
- Experience implementing enterprise data governance and security controls.
- Strong SQL and Python development skills.
- Experience working with data lakes, data warehouses, and cloud-native analytics platforms.
- Strong troubleshooting, performance tuning, and optimization experience.
- Databricks Certified Data Engineer Associate or Professional certification.
- AWS Data Analytics Specialty certification.
- Experience supporting federal government or highly regulated environments.
- Experience with real-time streaming, CDC solutions, and event-driven architectures.
- Familiarity with FedRAMP, FISMA, and NIST security frameworks.
- Experience supporting large-scale enterprise data platforms.
Similar Jobs
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Manage and lead audit, review, and compilation engagements for real estate clients. Oversee staffing, planning, budgeting, risk assessment, fieldwork, reporting, and team performance. Research complex accounting issues, assist clients with GAAP and FASB updates, provide training, and support business development and community activities. Position requires client-facing travel and collaboration with firm leadership.
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Lead and deliver Dynamics 365 Business Central implementations for manufacturing and distribution clients. Drive configurations, integrations, functional and technical design, workshops, training, and ERP deployment using implementation standards. Gather requirements, recommend solutions (ISVs/customizations), develop functional design documents, and support client adoption and ongoing support.
Top Skills:
Dynamics 365ErpMicrosoft Dynamics 365 Business Central
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Deliver and configure Microsoft Dynamics 365 Business Central implementations for manufacturing and distribution clients, including complex configurations, development, integrations, requirement gathering, functional and technical design, solution recommendations, data management, and use of ERP implementation standards. Support R&D and client-facing delivery initiatives, ensuring clear communication and project execution.
Top Skills:
ErpMicrosoft Dynamics 365 Business Central
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
