Capital Technology Group Logo

Capital Technology Group

Senior Data Engineer

Reposted 21 Days Ago
Remote
Hiring Remotely in USA
130K-165K Annually
Senior level
Remote
Hiring Remotely in USA
130K-165K Annually
Senior level
Design, build, and maintain scalable ETL/ELT data pipelines and analytical platforms on AWS and Databricks. Migrate legacy workflows to cloud-native services, implement data lake and catalog solutions, enable AI/RAG/vector search, ensure FedRAMP/NIST compliance, optimize performance, and mentor junior engineers while collaborating in Agile teams.
The summary above was generated by AI

Capital Technology Group provides expert consulting services software development, digital transformation, human-centered design, data analytics and visualization, and cybersecurity. 

Our multidisciplinary teams use agile methodologies to rapidly and incrementally deliver value in close collaboration with our clients. For over a decade, we have been trusted by both federal and commercial clients to solve complex, mission-critical business challenges. The quality of our work has been recognized by our partners and peers through our inclusion in the Digital Services Coalition, a group of forward- thinking firms recognized for excellence in delivering IT services.

Client Requirements: applicants MUST BE US Citizens and be able to obtain Public Trust clearance

The CTG Experience

At Capital Technology Group (CTG), our teams are passionate about modernizing how the federal government delivers software. We partner with federal agencies to build secure, scalable, and mission-driven solutions that make a meaningful impact on millions of people. Recognized by The Washington Post as a Top Workplace in 2025 and 2026. CTG fosters a culture rooted in our core values. Our values guide how we work together and support one another, creating an environment where employees feel trusted, empowered, and encouraged to grow both personally and professionally.

About the Role

CTG is seeking a Senior Data Engineer to design, build, and maintain scalable, efficient data pipelines and systems following modern data engineering best practices. The Senior Data Engineer will partner with other Data Engineers to evaluate and prototype new tools and technologies, assessing their risks and benefits to deliver exceptional value to our clients. 

You Will Get To
  • Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models using Python, Apache Spark (PySpark), dbt, SQL (PostgreSQL), and AWS Glue.
  • Develop and optimize AWS-native data platforms leveraging AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), Lambda, Step Functions, Amazon S3, Redshift, RDS, DMS, and CloudWatch.
  • Build high-performance ingestion, transformation, and orchestration workflows for structured and semi-structured data using Apache Iceberg, Parquet, ORC, and Avro.
  • Design and optimize analytical data platforms using Amazon Athena, Trino, Hive, OpenSearch, and enterprise data catalog technologies.
  • Integrate enterprise and external data sources across relational and NoSQL platforms including PostgreSQL, Oracle, Redshift, GraphDB, and other NoSQL databases.
  • Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies including Amazon S3 Vector and OpenSearch vector indexes.
  • Develop cloud infrastructure using CloudFormation (Infrastructure as Code), GitHub, Harness, and enterprise CI/CD pipelines while leveraging SNS, SQS, and EventBridge for event-driven architectures.
  • Improve the reliability, scalability, performance, and maintainability of enterprise data platforms through monitoring, troubleshooting, automation, and continuous optimization.
  • Support mission-critical analytics and reporting solutions within large-scale AWS-based federal data environments, implementing solutions that comply with FedRAMP and NIST 800-53 security controls.
  • Lead modernization initiatives migrating legacy platforms including IBM DataStage, Hadoop, RunDeck, and shell-based workflows to cloud-native AWS services.
  • Mentor junior engineers through technical guidance, architecture discussions, and code reviews while promoting engineering best practices.
  • Collaborate with cross-functional teams in an Agile environment to define requirements, deliver high-quality data solutions, and communicate technical concepts effectively to technical and non-technical stakeholders.
Who You Are
  • A strategic data engineer who enjoys designing complex systems and solving complex challenges
  • Strong in modern cloud-based solution design
  • Comfortable balancing business needs with technical constraints and long-term strategy
  • A strong communicator 
  • Collaborative, proactive, and comfortable navigating ambiguity
Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related technical field
  • 9+ years of professional experience in data engineering or related domains
  • Strong hands-on experience with:
    • Apache Spark (PySpark), Python, SQL (PostgreSQL), and dbt for large-scale data engineering, ETL/ELT development, data transformation, and data modeling.
    • AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), AWS Lambda, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, AWS DMS, and Amazon CloudWatch.
    • Developing scalable data pipelines, workflow orchestration, and data integration solutions across enterprise environments.
    • Working with modern data lake technologies including Apache Iceberg and data formats such as Parquet, ORC, and Avro.
    • Designing and optimizing solutions using relational and NoSQL databases including PostgreSQL, Redshift, Oracle, GraphDB, and other NoSQL platforms.
    • Building reliable, high-performance data platforms through performance tuning, system optimization, and enterprise-scale ETL/ELT architectures.
    • Java development and modern CI/CD practices using Harness.
  • Strong analytical and problem-solving skills
  • Experience working in agile, iterative software development environments
  • Ability to quickly learn and apply new technologies and domain knowledge
  • Excellent written and verbal communication skills, with the ability to explain complex topics to diverse audiences
Nice to Have
  • Experience supporting analytics, data engineering, or modernization initiatives for financial regulators, capital markets, or other highly regulated environments is a plus. 
  • Experience with Kafka (streaming/data pipelines)
  • Experience with Docker and Kubernetes for containerization and orchestration
  • Proficiency with Splunk for log aggregation and system monitoring
  • Experience using Terraform for infrastructure automation and management
  • Strong SQL skills, including performance tuning and complex query design
Salary

We are committed to offering a competitive salary for this position, with an estimated range of $130k to $165k annually. Please note that this range is intended to provide a general idea of what to expect; however, the final offer may vary based on experience, skills, and other factors. The stated range is not a guarantee and is subject to change. 


Full Time Employee Benefits
  • Remote Work (Hybrid roles will be specified in the job post)
  • Competitive Compensation Package
  • Medical, Dental, and Vision
  • Life Insurance, Short/Long Term Disability
  • Employee Assistance Program
  • 401(k) with 4% matching
  • Liberal PTO vacation policy
  • Generous Annual Continuing Education
  • Annual Wellness Budget
  • Bonus Incentive Programs (Employee referrals and performance-based rewards)

Thanks for your interest in Capital Technology Group!

Capital Technology Group is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.


Similar Jobs

Yesterday
Remote or Hybrid
United States
Senior level
Senior level
AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech • SEO
Build and support scalable data platforms and pipelines, leading migrations such as Snowflake to BigQuery and transitioning reporting to Looker. Responsibilities include data architecture, ETL/ELT, API and marketing integrations, data quality, production troubleshooting, warehousing, performance optimization, and platform modernization. The role partners with analytics and business teams, owns projects through production, documents solutions, and provides technical guidance.
Top Skills: AWSAzureBigQueryConfluenceDraw.IoGCPGitJIRAKafkaLookerLucidchartMiroModeNotionPower BIPythonSnowflakeSparkSQLTableauTalend
3 Days Ago
Remote or Hybrid
16 Locations
110K-200K Annually
Senior level
110K-200K Annually
Senior level
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Design and scale lakehouse architecture, including Bronze, Silver, and Gold data layers. Build reliable streaming and batch pipelines with Kafka, Spark, and Airflow; manage Iceberg, Delta, and Hudi table formats; optimize Trino, Starburst, and Databricks queries; and improve platform reliability, data quality, and performance. Collaborate with data scientists, analysts, and product teams to deliver scalable data platform solutions.
Top Skills: Apache AirflowApache HudiApache IcebergApache KafkaSparkDatabricksDelta LakeLakehouse ArchitectureMedallion ArchitecturePythonSQLStarburstTrino
3 Days Ago
Remote or Hybrid
16 Locations
110K-200K Annually
Senior level
110K-200K Annually
Senior level
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Design and scale lakehouse architecture, streaming and batch pipelines, and reliable data platforms using Kafka, Spark, Airflow, Iceberg, Databricks, and related technologies. Build Medallion-layer data systems, manage open table formats, optimize distributed queries, monitor platform reliability, resolve data quality issues, and collaborate with analysts, data scientists, and product teams.
Top Skills: Apache AirflowApache HudiApache IcebergApache KafkaSparkDatabricksDelta LakePythonSQLStarburstTrino

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account