The Senior Data Engineer designs scalable data pipelines, collaborates with teams to address business needs, and ensures data infrastructure reliability.
Join a pioneering financial services company that is redefining homeownership through innovative, data-driven solutions. As a Senior Data Engineer, you will be instrumental in designing and building scalable data pipelines, transforming complex datasets, and ensuring the reliability of the data infrastructure. Working closely with data scientists and analysts, you will provide critical insights that shape strategic decisions. If you are passionate about data engineering and thrive in a fast-paced, collaborative environment, this role offers you the opportunity to contribute to cutting-edge projects and help shape the future of data architecture
Requirements
- 5+ years of Python development experience.
- Experience with AWS, including services like DynamoDB, S3, EMR, Glue, Athena, and Redshift.
- Knowledge of distributed computing engines, such as Apache Spark.
- Proficiency in both relational and non-relational databases, along with data modeling expertise.
- Experience setting up code pipelines using CloudFormation or Terraform.
- Familiarity with ETL pipeline development in OLAP and Data Warehouse environments.
- Hands-on experience with orchestration tools like Airflow.
- Understanding of serverless architectures and scalable application design principles.
- Proficiency with version control systems, particularly Git.
- Experience with Node.js, DevOps, and CI/CD practices is a plus.
- Background in cloud technologies (AWS or Azure) and fintech or banking is desirable.
Responsibilities
- Design and implement scalable data pipelines in a horizontally scaled environment.
- Collaborate with cross-functional teams to understand business needs and define transactional scenarios across multiple microservices.
- Write high-quality, maintainable code that meets established standards and best practices.
- Build strong relationships with clients by understanding their business model and delivering solutions that align with their goals.
- Influence and communicate effectively at all levels, including management and engineering teams.
- Utilize distributed computing systems to transform and manage large datasets efficiently.
- Work with cloud-based technologies such as AWS to support the company’s data infrastructure.
- Contribute to continuous integration/continuous delivery (CI/CD) pipelines and DevOps practices.
- Collaborate with data scientists to ensure the availability and accessibility of critical insights for decision-making.
Top Skills
Airflow
Spark
Athena
AWS
Ci/Cd
CloudFormation
DevOps
DynamoDB
Emr
ETL
Git
Glue
Node.js
Olap
Python
Redshift
S3
Terraform
Similar Jobs
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
The Sr. Data Engineer will design and maintain CI/CD pipelines, manage serverless solutions, understand data modeling, and collaborate with teams for data processing and reporting.
Top Skills:
APIsAthenaAws CloudformationAws LambdaEmr ServerlessGithub ActionsKafkaLinuxMicrostrategyPandasPythonScalaSnsSparkSQLSqsTableauTerraform
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
As a Senior Data Engineer, you will develop data pipelines, optimize data delivery, and collaborate with various teams to support NBCUniversal's analytics needs.
Top Skills:
AirflowBig QueryComposerGcsGoogle Cloud PlatformPythonSQLVertexai
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
As a Senior Data Engineer, you will build data pipelines and applications for analytics solutions, working closely with business partners to drive decisions.
Top Skills:
AthenaAws EmrAws LambdaIcebergMssql ServerOraclePythonRedshiftScalaSinglestoreSnowflakeSparkSQL
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
