Easy Apply
Easy Apply
The Senior Data Engineer will architect and develop data pipelines, ensuring optimal data extraction and transformation for the data warehouse platform, with a focus on scalability and maintainability.
We are looking for a Senior Data Engineer to join our Platform Data Engineering team. The hire will be responsible for building platform level data engineering frameworks and tools. In addition, designing and implementing the data pipelines that feed data into the data warehouse platform across clouds (AWS + Azure).
In this role, you will be able to work independently with minimal guidance. The ideal candidate is an experienced data pipeline builder who enjoys optimizing data systems and building them from the ground up and who is also passionate about developing scalable systems. There will also be opportunities to build data oriented solutions like MDM, data catalogs and architecting for resiliency / scalability in the data pipelines
Responsibilities
Responsibilities
- Architect, design and develop data pipeline for scale and maintainability
- Lead in the design, implementation, and deployment of successful systems and services
- Ensure the quality of architecture and design of systems
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Big Data technologies.
- Perform design and code reviews
- Functionally decompose complex problems into simple, straight-forward solutions
- Cross-training peers and mentoring teammates
- Document HLD/LLD for easy knowledge sharing and future scaling
- Create data tools for analytics, data scientist team members that assist them in building and optimizing our product
- Create data apis for application team members that assist them in building and optimizing our product
- 4+ years of experience in one high performance programming language - Java and/or Python preferred
- 3 Normal & Dimensional modeling experience
- ETL/ELT pipelines loading into data warehouses / data lakes
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience designing and developing microservices.
- Good Linux/UNIX systems knowledge
- Experience productionizing Machine Learning models
- Experience with AWS/Azure cloud technologies
About FourKites
FourKites®, the leader in AI-driven supply chain transformation for global enterprises and pioneer of advanced real-time visibility, turns supply chain data into automated action. FourKites’ Intelligent Control Tower™ breaks down enterprise silos by creating a real-time digital twin of orders, shipments, inventory and assets. This comprehensive view, combined with AI-powered digital workers, enables companies to prevent disruptions, automate routine tasks, and optimize performance across their supply chain. FourKites processes over 3.2 million supply chain events daily — from purchase orders to final delivery — helping 1,600+ global brands prevent disruptions, make faster decisions and move from reactive tracking to proactive supply chain orchestration.
Working with us
We provide competitive compensation with stock options, outstanding benefits and a collaborative culture for all employees around the globe, including:
- 5 global recharge days, in addition to standard holidays, and a hybrid, flexible approach to work.
- Parental leave for all parents, an annual wellness stipend and volunteer days also provide you with time and resources for self care and to care for others.
- Opportunities throughout the year to learn and celebrate diversity.
- Access to leading AI tools and foundation models, with the freedom to experiment and find creative ways to be more effective in your role
Top Skills
AWS
Azure
Big Data
Cassandra
Hadoop
Java
Kafka
Postgres
Python
Spark
Spark-Streaming
SQL
Storm
Similar Jobs at FourKites
Artificial Intelligence • Big Data • Logistics • Machine Learning • Software • Transportation
Lead the design and implementation of authentication and authorization systems, optimize performance and scaling for logistics platforms, and mentor engineering teams.
Top Skills:
AWSAzureGoJavaKeycloakMongoDBMySQLPostgres
Artificial Intelligence • Big Data • Logistics • Machine Learning • Software • Transportation
The role involves designing, implementing, and optimizing high-quality software using various technologies. Collaborate with product managers and mentor team members while ensuring code quality and best practices.
Top Skills:
Amazon Web ServicesAngularAzureConfluenceCSSGitGoHTMLJavaJavaScriptJIRAMongoDBMySQLPostgresReactRedisRor
Artificial Intelligence • Big Data • Logistics • Machine Learning • Software • Transportation
Principal Architects at FourKites lead technology initiatives, manage cloud infrastructure, and ensure product architecture quality. They mentor teams and oversee best practices in engineering across supply chain solutions.
Top Skills:
AWSBitbucketCassandraDatadogDockerElastic SearchGitlabGraylogIstioJenkinsKongKubernetesMongoDBNewrelicPostgresPythonRdsTerraform
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
