Build and optimize scalable data pipelines and cloud-based data solutions using Python, PySpark, SQL, and Snowflake. Integrate REST APIs and external data sources, develop ETL/ELT workflows, optimize Snowflake queries, and implement data quality, validation, monitoring, and automation. Collaborate with engineering and analytics teams to deliver reliable data platforms.
Job Description
Data Engineer - Python, PySpark, SQL, Snowflake & API Integration
Job Description:
We are seeking a skilled Data Engineer with strong hands-on experience in Python, PySpark, SQL, Snowflake, and API integrations to build scalable data pipelines and cloud-based data solutions.
Key Responsibilities:
- Design, develop, and optimize data pipelines using Python, PySpark, SQL, and Snowflake.
- Integrate REST APIs and external data sources into Snowflake-based data platforms.
- Build and maintain ETL/ELT workflows for data ingestion, transformation, and processing.
- Develop efficient SQL queries and optimize Snowflake performance.
- Implement data quality, validation, monitoring, and automation.
- Collaborate with engineering and analytics teams to deliver reliable data solutions.
Required Qualifications:
- 3+ years of experience in Data Engineering.
- Strong hands-on expertise in Python, PySpark, SQL, and Snowflake.
- Experience with REST APIs, JSON, and API-based data integration.
- Knowledge of ETL/ELT processes, data modeling, and data warehousing.
- Experience with cloud platforms such as AWS, Azure, or GCP is preferred.
Additional Information
All your information will be kept confidential according to EEO guidelines.
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Build trusted technical relationships with enterprise customers, troubleshoot Samsara hardware, software, APIs, and AI solutions, and optimize implementations. Serve as the primary technical contact, manage incident communications, identify growth opportunities, maintain account records, and collaborate across stakeholders. The role also supports Technical Account Management team development and requires occasional customer travel plus after-hours or weekend coverage when needed.
Top Skills:
APIsArtificial IntelligenceGainsightGeminiHardwareIotJIRAMachine LearningPaasPythonSaaSSalesforceSoftwareTableauZendesk
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Strategic Account Director connects presales and post-sales teams, develops client roadmaps, delivers data-driven marketing insights, and manages campaign optimization. The role builds trusted client relationships, supports first-party data activation, facilitates strategic sessions, monitors deliverables, identifies risks and opportunities, and presents performance reports to senior stakeholders. It is remote from Toronto, Canada, and requires extensive strategic account management, marketing strategy, analytics, and cross-channel media experience.
Top Skills:
Artificial Intelligence (Ai)Cross-Channel MarketingDigital MediaFirst-Party DataZeta Marketing Platform (Zmp)
Big Data • Fintech • Mobile • Payments • Financial Services
Lead Affirm’s Resilience Engineering team, defining strategy and managing engineers who build platforms for safe production load testing and chaos engineering. Own safeguards such as isolation, approval workflows, rollback mechanisms, observability, and auditability. Partner with infrastructure, security, product, and engineering teams to identify systemic weaknesses, improve reliability, establish incident response practices, and promote resilience validation across the software development lifecycle.
Top Skills:
AWSGremlinHarnessJavaKotlinKubernetesPython
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
