540 Logo

540

Senior Data Engineer

Posted 19 Days Ago
Easy Apply
Remote
Hiring Remotely in USA
Senior level
Easy Apply
Remote
Hiring Remotely in USA
Senior level
The Senior Data Engineer designs and builds AWS-based data pipelines, collaborates with stakeholders, optimizes performance and mentors junior engineers.
The summary above was generated by AI

540 is seeking a Senior Data Engineer to design, build, and optimize cloud-based data pipelines supporting high-impact federal missions. In this role, you’ll contribute hands-on to the development of scalable data pipelines in AWS while collaborating closely with technical leads and stakeholders to deliver robust solutions that drive meaningful business insights.

This position is ideal for an experienced data engineer who enjoys solving complex data challenges, writing production-quality code, and mentoring junior team members while continuing to grow their own technical impact.

Location: Remote within the continental United States. Core collaboration hours align with Eastern Time, with flexibility. Occasional travel (3-4x annually)
Citizenship & Clearance Requirement: per client requirements, must be a U.S. Citizen with the ability to obtain a DoD Secret clearance
Education Requirement: Bachelor’s Degree in Computer Science or related engineering field (preferred)
540 Internal Thrive Level: Software Engineer III or Senior

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU’LL DRIVE IMPACT

  • Design, develop, and maintain scalable data pipelines and ETL processes using Python and AWS services
  • Build and deploy serverless functions using AWS Lambda for data processing and automation
  • Implement data integration solutions connecting diverse source systems to analytics platforms 
  • Mentor junior data engineers through pair programming, code reviews, and technical coaching
  • Collaborate with data analysts and business stakeholders to understand requirements and deliver solutions
  • Optimize data pipeline performance, reliability, and cost efficiency in AWS environments 
  • Develop and maintain comprehensive documentation for data systems and processes
  • Participate in on-call rotation to support production data infrastructure
  • Contribute to the establishment of team coding standards and engineering best practices 
  • Work with Git for version control and participate in collaborative development workflows

REQUIRED SKILLS & EXPERIENCE

  • 6+ years of experience in data engineering or related technical roles
  • Strong proficiency in Python programming with experience building production data applications
  • Solid understanding of AWS architecture and services (Lambda, S3, Glue, RDS, Redshift, etc.)
  • Experience with Git version control and branching strategies
  • Knowledge of SQL and relational database design principles
  • Familiarity with data modeling techniques and data warehouse concepts
  • Experience with RESTful APIs and data integration patterns
  • Strong problem-solving skills and attention to detail
  • Excellent communication skills and demonstrated ability to mentor others
  • Currently possess or be able to obtain within 30 days of hire:
    • AWS Cloud Practitioner certification (or higher) 
    • CompTIA Security+ certification (or higher) 

NICE TO HAVE

  • Familiarity with X12/MILS processing
  • Experience with Apache Spark, Kafka, or other distributed processing frameworks
  • Knowledge of data orchestration tools (Apache Airflow, AWS Step Functions)
  • Exposure to Infrastructure-as-Code tools (Terraform, CloudFormation)
  • Understanding of DevOps practices and CI/CD pipelines
  • AWS certifications (Solutions Architect, Data Analytics, or similar)

BENEFITS & PERKS

  • Flexible PTO + all Federal holidays off
  • Health, dental and vision insurance plans
  • Flexible Spending Account (FSA)
  • 401k with employer match
  • Company-sponsored life insurance, short- and long-term disability 
  • Professional development (training, certifications, conferences)
  • Paid cloud developer accounts
  • Referral bonuses
  • HQ office perks (parking / metro reimbursement, nitro coffee & lunches) 
  • Annual social events (540 Week, hackathon, charity golf tournament, etc.)
  • Access to 540’s Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Top Skills

Apache Airflow
Spark
AWS
CloudFormation
Git
Kafka
Python
Restful Apis
SQL
Terraform

Similar Jobs

3 Days Ago
Remote or Hybrid
United States
60K-160K Annually
Senior level
60K-160K Annually
Senior level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
The Data Engineer will design and implement data pipelines, manage Looker, automate deployment, and ensure data quality for business reporting needs.
Top Skills: BashBigQueryCi/CdDebeziumGitGoogle Cloud PlatformHelmKafkaKubernetesLookerPub/SubPythonSQLTerraform
24 Days Ago
Remote
United States
Senior level
Senior level
Blockchain • Fintech • Financial Services • Cryptocurrency
The Senior Data Engineer at Unchained will design and implement data pipelines, integrate APIs, ensure data governance, and mentor team members while focusing on accuracy and security.
Top Skills: AWSDagsterDbtDockerKubernetesPostgresPythonSQLTerraform
25 Days Ago
Remote or Hybrid
United States
100K-150K Annually
Senior level
100K-150K Annually
Senior level
Artificial Intelligence • Big Data • Consumer Web • Digital Media • Marketing Tech
The Senior Data Engineer will manage data infrastructure, build data pipelines, develop dashboards for analytics, and ensure data quality while collaborating with various teams.
Top Skills: AirflowBigQueryDbtFivetranLookerPower BIPythonRRedshiftSnowflakeSQLTableau

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account