Data Engineer - Remote USA
The Company
Metropolis is an AI and computer vision start-up building the technological and real estate infrastructure to facilitate the future of mobility.
Your Opportunity
This is your opportunity to join early and build something remarkable at the intersection of technology, mobility, and real estate. We are reimagining the parking experience today but developing an ecosystem to support all forms of mobility tomorrow; and if you have a passion for transforming the urban landscape to more intelligently facilitate EV charging, last mile transport, autonomous vehicles, and even electric vertical take-off and landing (eVTOL), please consider joining us.
Our Team
The Company is led by an experienced executive team with diverse backgrounds, including a successful LA-based tech founder, a technical leader from eHarmony and DogVacay, and senior professionals from major global financial services firms and the world's leading mobility companies; our first-class engineering talent joins us from Facebook, Palantir, Bird, Factual, Honey, Canoo, and others.
We approach life with wonder and curiosity. We’re inventors, skeptics and, at times, have been called crazy. We challenge one another with passion, from principle and with respect. But above all, we are relentless in our drive to build a collaborative, diverse, and inclusive culture.
Role
The company is seeking a highly motivated Data Engineer to join the data team to help scale data ingestion and processing. This role will be partnering closely with our engineering, analytics, and computer vision stakeholders to define, build, and maintain data pipelines and data lakes. As a member of this team, you will design and build libraries and frameworks to accelerate implementing new data pipelines. You will also actively participate in the technical implementation of our data systems as well as figuring out how best to scale and monitor data for both internal and external customers in a secure and performant fashion. We are on a mission to empower internal users to make data-backed business decisions quickly and intuitively, and you will be essential to us achieving that vision.
Responsibilities
- Develop and maintain libraries and frameworks to support scalable data pipelines and builds out new pipelines to support the ever-increasing data volume and complexity
- Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
- Collaborate with Analytics, BI, ML, and business teams to improve data models that feed business intelligence & computer vision tools, increasing data accessibility and fostering data-driven decision making across the organization
- Write unit/integration tests, contributes to engineering wiki, and documents work
- Keep up with the latest technology trends and strategically evaluates open source and vendor tools
Skills
- Knowledge of best practices in delivering large scale data pipelines in an always-up, always-available service in a cloud environment
- 5 years work experience in technical/programming role
- Required minimum 2 years experience building applications with Scala or Java (Scala preferred)
- Excellent oral and written communication skills with a keen sense of customer service
- Experience using Apache technologies: Airflow, Spark, Hudi, Kafka
- Willingness to learn and teach
Nice to Haves
- PrestoDB
- Apache Ranger or AWS Lake Formation
- Apache Atlas or Amundsen
- Containerization (Docker, Kubernetes, ECS)
- AWS Services (Setup of, alternatives to, etc..)
Benefits
- Attractive compensation and generous benefits package (100% Medical, 50% Vision and 50% Dental)
- Company 401(k) match up to 6% of salary
- Paid company snacks and after-hour meals
- Unlimited Paid Time Off (PTO)
- Gym reimbursement program
- 529 savings plan
- Commuter benefits
When you join Metropolis, you’ll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows.