Designs, deploys, governs, and supports enterprise Databricks platforms across AWS Commercial and GovCloud environments. Responsibilities include Terraform-based workspace deployment, AWS networking, Unity Catalog administration, CI/CD automation, security and governance controls, platform monitoring, cost optimization, incident escalation, and stakeholder guidance. Requires extensive Databricks administration, AWS infrastructure, infrastructure-as-code, Python, Linux, and federal security environment experience.
This is a remote position.
Location: Remote – United States
Security Clearance: Active Secret or higher REQUIRED
Our client, a growing technology services organization supporting federal government programs, is seeking an experienced Senior Databricks Platform Engineer / Administrator to help design, deploy, govern, and support enterprise Databricks environments for a federal client.
Candidates must currently hold an ACTIVE Secret security clearance or higher. Candidates without an active Secret-level clearance cannot be considered.
The ideal candidate will bring deep hands-on experience building and administering Databricks platforms, particularly within AWS environments, with strong expertise in infrastructure automation, networking, governance, security, CI/CD, and platform operations.
- Deploy and configure Databricks workspaces from the ground up using Terraform and Databricks Secure Reference Architecture across development, test, and production environments.
- Support Databricks deployments within AWS Commercial and AWS GovCloud environments.
- Design and implement supporting AWS networking architecture, including VPCs, subnets, PrivateLink, Transit Gateway, security groups, and DNS.
- Manage Databricks control-plane and data-plane connectivity.
- Administer Unity Catalog, including metastores, catalogs, schemas, external locations, permissions, grants, and row- and column-level security.
- Build and maintain CI/CD pipelines supporting infrastructure deployment and Databricks Asset Bundles.
- Establish platform governance standards, architectural guardrails, tagging strategies, naming conventions, and operating best practices.
- Automate provisioning and administration of cluster policies, secrets, service principals, SSO, and SCIM integrations.
- Monitor platform health, utilization, performance, and cost.
- Identify opportunities for rightsizing, cost optimization, and improved platform efficiency.
- Serve as an escalation point for platform incidents, troubleshooting, and root-cause analysis.
- Partner with technical and business stakeholders to provide guidance on platform architecture, governance, security, and operational decisions.
Requirements
- Active Secret security clearance or higher is required.
- U.S. citizenship required.
- 6+ years of experience engineering, administering, or supporting Databricks platforms.
- Strong hands-on experience with Databricks in AWS environments.
- Advanced Terraform experience supporting infrastructure such as networking, IAM, compute, and storage.
- Strong knowledge of Databricks Secure Reference Architecture.
- Hands-on Unity Catalog administration experience.
- Experience with Databricks Asset Bundles or comparable deployment automation frameworks.
- Strong understanding of CI/CD practices and infrastructure-as-code methodologies.
- Python proficiency.
- Linux systems administration experience.
- Hands-on experience with AWS services including:
- VPC
- IAM
- S3
- KMS
- EC2
- CloudWatch
- VPC
- Strong troubleshooting and root-cause analysis capabilities.
- Strong communication skills with the ability to advise stakeholders on technical and platform decisions.
- AWS GovCloud experience.
- Experience working within regulated, security-sensitive, or compliance-heavy environments.
- Experience supporting FISMA High, FedRAMP High, or comparable federal security standards.
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
Similar Jobs
Cloud • Information Technology • Security • Software • Cybersecurity
Provide first-line technical support for complex security and networking issues, including troubleshooting SSL, SAML, HTTP, TCP/IP, connectivity, and performance problems. Partner with Engineering, document resolutions, manage enterprise escalations, contribute product feedback, develop training, and mentor support engineers. The role requires expertise in web security, network infrastructure, security proxies, VPNs, firewalls, DLP, SD-WAN, and related technologies, along with U.S. citizenship.
Top Skills:
Ai/MlAPIsAWSAzureDlpEsxiFirewallsGCPGre TunnelsHar TracesHTTPIp Sla MonitoringIpsIpsec VpnNgfwPac FilesPacket Capture AnalysisSAMLSandboxingScimSd-WanSslSsl VpnSwgTcp/IpZscaler Zero Trust Exchange
Information Technology
Drives strategic growth, product gross profit, and services revenue across state and local public sector accounts. Develops account strategies, leads consultative technology sales engagements, negotiates with stakeholders, identifies expansion opportunities, and serves as a trusted executive advisor. Designs cross-functional solutions for AI-driven transformation initiatives while coordinating internal sales and practice teams. Requires technology industry expertise, strategic planning, forecasting, strong communication, and up to 50% travel.
Top Skills:
AICiscoDellHpeIbmMicrosoft
Information Technology
Coordinates multiple sales enablement projects from planning through execution, maintaining schedules, trackers, rosters, resources, and reporting. Aligns managers, contributors, and subject matter experts; facilitates meetings; communicates milestones, risks, and decisions; resolves routine issues; and escalates obstacles. Supports onboarding and training programs, validates project data, maintains SharePoint or Teams resources, documents repeatable workflows, and recommends process improvements. Provides coordination guidance and workload support across Academy and Residency sales initiatives.
Top Skills:
ExcelMicrosoft OutlookMicrosoft PowerpointMicrosoft SharepointMicrosoft TeamsMicrosoft Word
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
