The role involves gathering data requirements, writing complex SQL queries, managing data pipelines in Azure, and collaborating in agile environments. Requires strong analytical skills and proficiency in Azure technologies for data engineering.
- Responsibilities: Able to participate in business discussions and assist gathering data requirements. Good analytical and problem-solving skills to help address data challenges.
Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and performance tuning. Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the data. Hands on experience with PySQL/Pyspark etc.
Hands on Experience in creating and managing data pipelines using Azure Data Factory. Understanding of data integration, transformation, and workflow orchestration in Azure environments.
Knowledge of data engineering workflows and best practices in Databricks. Able to understand existing templates and patterns for development. Hands on experience with Unity Catalog and Databricks workflow.
Proficiency in using Git for version control and collaboration in data projects. Ability to work effectively in a team environment, especially in agile or collaborative settings.
Clear and effective communication skills to articulate findings and recommendations for other team members. Ability to document processes, workflows, and data analysis results effectively.
Willingness to learn new tools, technologies, and techniques as the field of data analytics evolves. Being adaptable to changing project requirements and priorities.
Skills
Azure Databricks, Data Lakehouse architectures, and Azure Data Factory.
Expertise in optimizing data workflows and predictive modeling.
Designing and implementing data pipelines using Databricks, Spark,
Expertise in batch and streaming data solutions, automating workflows with CI/CD tools like Jenkins and Azure DevOps, and ensuring data governance with Delta Lake
Spark, PySpark, Delta Lake, Azure DevOps, Python.
Advance SQL expertise
Top Skills
Azure
Azure Data Factory
Azure Devops
Databricks
Delta Lake
Git
Jenkins
Pyspark
Python
SQL
Similar Jobs
Cloud • Hardware • Manufacturing
The Senior ETL Developer will design and implement solutions for enterprise data warehousing, focusing on ETL programs and data reporting. Responsibilities include collaborating with teams to gather requirements, developing ETL workflows, and creating technical documentation while ensuring adherence to development standards.
Top Skills:
Azure Data FactoryAzure Data ToolsAzure Sql Database ServicesBlobData BricksData LakeETLMicrosoft Power BiMs SqlPower AutomateSsisSsrsTableau
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Analyze investment opportunities, conduct due diligence, prepare memos for the investment committee, and monitor existing investments while collaborating with team members.
Top Skills:
ExcelMicrosoft Office SuitePowerPoint
Fintech • Insurance • Financial Services
The Head of Insurance Agency Operations will lead all operational workflows for Flourish Annuities, manage a team, and ensure regulatory compliance while driving process improvements.
Top Skills:
Electronic Order Entry SystemFintech
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
