Designs and maintains scalable data architectures, ETL workflows, batch and real-time pipelines, and SQL/NoSQL storage solutions supporting intelligence operations. Ensures data quality, governance, security, compliance, and performance across structured and unstructured intelligence datasets. Documents schemas and data lineage, collaborates with analysts and data scientists, and participates in technical and mission-planning forums.
Overview
The Data Engineer designs, develops, and maintains scalable data architectures and pipelines that enable advanced intelligence analysis across the Joint Intelligence Operations Center (JIOC). This role is responsible for implementing robust extract, transform, load (ETL) workflows, real-time data processing solutions, and data integration frameworks that support multi-INT datasets and mission-critical intelligence operations.
The Data Engineer ensures that all data systems adhere to Intelligence Community (IC) security, governance, and compliance standards while enabling analysts and mission partners to access reliable, high-quality, and timely intelligence data.
Responsibilities- Design and implement scalable and resilient data architectures capable of supporting complex intelligence missions and growing data volumes.
- Develop automated ETL and data transformation processes to ingest, normalize, and integrate data from diverse and non-standard intelligence sources.
- Build optimized data storage solutions using SQL and NoSQL technologies tailored to JIOC’s analytic requirements.
- Create and maintain batch and real-time data pipelines to provide consistent, timely access to mission-critical datasets.
- Implement data quality validation mechanisms and monitoring systems to ensure the accuracy, completeness, and reliability of intelligence data.
- Optimize database performance and data retrieval patterns to support rapid intelligence production and analyst workflows.
- Apply data governance and security best practices to ensure compliance with IC and DoD data management policies.
- Maintain detailed documentation, including data dictionaries, schema definitions, and data lineage tracking.
- Implement and maintain data security measures aligned with classification guidelines and compartmentation requirements.
- Collaborate closely with intelligence analysts, data scientists, and computer scientists to translate analytic needs into technical data solutions.
- Participate in JIOC planning conferences, technical working groups, capability development meetings, and national-level intelligence coordination forums to align data engineering solutions with mission needs.
Education
- Bachelor’s degree in Computer Science, Information Systems, Data Science, or a related technical field.
Required Skills
- Proficiency in core data engineering programming languages, especially Python.
- Experience with SQL and NoSQL database systems (e.g., PostgreSQL, MySQL, MongoDB, Elasticsearch).
- Solid understanding of ETL/ELT tools, workflow orchestration frameworks, and data pipeline development.
- Hands-on experience with cloud-based data platforms (AWS, Azure, GCP, etc.).
- Understanding of data governance, metadata management, and IC data security requirements.
- Experience optimizing database performance and developing highly efficient queries.
- Ability to integrate structured and unstructured data from multiple intelligence data sources.
- Familiarity with intelligence data types and collection methodologies is preferred.
Experience
- Minimum 1–2 years of experience in data engineering, database development, or related technical roles.
Bluehawk, LLC. is an Equal Opportunity/Affirmative Action Employer/EOE Minority/Female/Disabled/Veteran/Sexual Orientation/Gender Identity
Similar Jobs
Aerospace • Healthtech • Defense • Manufacturing
Supports Azure-based data pipelines, warehouses, ETL/ELT processes, SQL queries, data quality checks, and Power BI datasets and reports. Assists with Azure Data Factory maintenance, troubleshooting pipeline failures, integrating data from databases and business applications, documenting data assets, and responding to reporting support requests. Collaborates with senior engineers and stakeholders while developing foundational data engineering and business intelligence skills in a regulated manufacturing environment.
Top Skills:
Azure Cloud Data ServicesAzure Data FactoryAzure Sql DatabaseAzure Sql Managed InstanceAzure SynapseDbtEtl/EltExcelGitJIRAPower AutomatePower BIPowerappsPythonSQLSQL Server
Cloud • Information Technology
Design and modify data solutions using Databricks and Palantir Foundry; build data models and reports from ERP and legacy-system datasets; define and execute tests; and translate stakeholder reporting needs into technical specifications. The role requires SQL, Python, PySpark, database architecture, cloud architecture, software engineering practices, independent execution, documentation, and collaboration. It supports an Army client in a hybrid Arlington, Virginia environment and requires an active Secret clearance.
Top Skills:
AWSAzureData PipelinesDatabricksEtl PipelinesNon-Relational DatabasesPalantir FoundryPysparkPythonRelational DatabasesSap ErpSQLVersion ControlWorkflow Automation
Information Technology • Consulting
Support building and maintaining ETL pipelines using Python and PySpark. Work with AWS services (Glue, Lambda, Step Functions, S3, Redshift, RDS, EMR) to ingest, transform, and validate data. Write complex SQL, implement basic monitoring/logging, process API/JSON payloads, and collaborate with engineers, analysts, and stakeholders on deployment and documentation.
Top Skills:
APIsAws EmrAws GlueAws LambdaAws RdsAws RedshiftAws S3Aws SnsAws SqsAws Step FunctionsGitlabJSONOraclePysparkPythonSQLTerraform
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
