OPENLANE Logo

OPENLANE

Senior Data Engineer

Posted 22 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
The Senior Data Engineer will design, build, and support data products using ADF, SQL, and Python, managing data solutions on Azure or AWS.
The summary above was generated by AI

Senior Data Engineer for OPENLANE, Inc. in Carmel, IN will participate daily in Agile ceremonies to help design, plan, build, test, develop, and support Openlane large enterprise data products and platforms consisting of ADF ETL pipelines and Postgres, DynamoDB, Elastic search, and Snowflake databases; plan and design data schemas; Will work with a team in a shared services delivery model supporting seven lines of business, including front-end customer facing products, B2B portals, mobile applications, business analytics, and data science initiatives. Work with Azure Cloud or AWS, Work with product, data science, analytics, and engineering teams to learn project data needs and define project scope; Conduct Gap Analysis and Data Validation; design and planning of data services solutions on the Data Platform; building and delivery of Azure Data Factory (ADF), Python, Docker, and Kubernetes feed framework data pipeline jobs and services; Manage SQL, Github / Azure DevOps (CI/CD); contribute to the Data Engineering team delivery framework including building of re-usable code, implementing industry best practices, and maintain a common delivery framework; monitoring, maintenance, documentation, and incident resolution of scheduled production data jobs supporting internal and external customers data needs. May work remotely anywhere in the US.

Requirements:

Bachelor’s degree in Computer Science, Software Engineering, Mechanical Engineering, Engineering Management, or related field, and 5 years of progressive experience as a Data Engineer or related occupation in data engineering.

Must possess a minimum of 5 years of experience with the following: SQL and Python development including data warehousing.  Must possess a minimum of 3 years of experience with each of the following: Planning and designing data schemas; Azure Cloud or AWS; Gap Analysis and Data Validation; Github / Azure DevOps (CI/CD); Azure Data Factory (ADF), Docker, and Kubernetes; and working with large enterprise data such as Postgres, DynamoDB, Elastic search, or Snowflake. May work remotely anywhere in the U.S.

#LI-DNI

Top Skills

Adf
AWS
Azure Cloud
Azure Devops
Docker
DynamoDB
Elastic Search
Git
Kubernetes
Postgres
Python
Snowflake
SQL

Similar Jobs

9 Hours Ago
Easy Apply
Remote
Hybrid
United States
Easy Apply
99K-133K Annually
Senior level
99K-133K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
As a Senior Data Engineer/Scientist, you'll design and maintain data pipelines, collaborate with analytics teams, and leverage SQL and Python for data manipulation, building ETL pipelines, and integrating datasets for insightful analytics.
Top Skills: DatabricksPythonSparkSQLTableau
Yesterday
Remote
USA
144K-180K
Senior level
144K-180K
Senior level
Artificial Intelligence • eCommerce • Food
As a Senior Data Engineer, you'll develop and maintain data pipelines that inform analytics, ensuring data quality for decision-making across teams.
Top Skills: DatabricksPythonScalaSpark
2 Days Ago
Remote
Chicago, IL, USA
106K-134K Annually
Senior level
106K-134K Annually
Senior level
Fintech
The Senior Data Engineer will lead the development of scalable data platforms, design ETL workflows, mentor junior engineers, and ensure data quality and governance.
Top Skills: GCPNode.jsPythonSQLTerraformTypescript

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account