The Data Engineer builds and maintains scalable data pipelines in Azure, transforming raw data into reliable information for analytics. Responsibilities include designing ETL/ELT pipelines, managing Azure Data Lake, creating dashboards in Power BI, and ensuring data quality and efficiency across platforms.
Position Summary: The Data Engineer designs, builds, and maintains scalable data pipelines and analytics solutions across our Azure cloud environment. This role transforms raw data from multiple source systems into reliable, business-ready information that powers reporting, analytics, and operational decision-making. The Data Engineer works closely with analysts, application developers, and business stakeholders to deliver high-quality data solutions on Snowflake, Azure Data Lake, and Microsoft Power BI.
Essential Tasks:
- Design, develop, and maintain ETL/ELT pipelines in Azure to ingest, transform, and integrate data from multiple source systems
- Build and optimize Snowflake-based data solutions for scalable storage, transformation, and analytics workloads
- Manage and support Azure Data Lake structures for both structured and unstructured data
- Develop interactive dashboards and reports in Microsoft Power BI to support business intelligence and operational reporting
- Implement integration solutions that connect Azure services, Snowflake, and downstream reporting platforms
- Monitor pipeline performance, troubleshoot failures, and implement enhancements to improve efficiency and reliability
- Ensure data quality, integrity, security, and consistency across all cloud data platforms
- Partner with analysts, developers, and business stakeholders to gather and refine data and reporting requirements
Core Competencies:
- Ability to Analyze and Solve Problems: Skill in recognizing challenges, exploring options, and implementing effective solutions in a timely manner
- Attention to Detail: A strong focus on completing tasks and projects accurately and thoroughly
- Communication Skills: Capable of expressing ideas clearly in both verbal and written forms and engaging with various audiences
- Timely Task Completion: Ability to finish tasks and projects efficiently, managing resources and priorities effectively
- Team Collaboration: Willingness to work together with others, promoting teamwork and supporting shared goals
- Client Focus: Dedication to understanding and addressing the needs of clients and stakeholders to ensure their satisfaction
- Dependability: Acknowledgment of the importance of being present and punctual
- Creative Thinking: Openness to suggesting new ideas and methods to improve processes and outcome
- Organizational Skills: Capability to prioritize tasks and manage multiple projects simultaneously
- Adaptability: Willingness to adjust to changing situations and priorities, showing resilience in a dynamic work environment
Experience and Education:
- Minimum 3 years of hands-on experience in data engineering or a closely related field
- Demonstrated experience with Snowflake, including data loading, transformation, and query optimization
- Proficiency in Microsoft Power BI, including dashboard development, report design, and data visualization
- Experience working with Azure Data Lake and large-scale datasets
- Strong SQL skills and working knowledge of data modeling and cloud-based data integration concepts
- Understanding of ETL/ELT processes and data warehousing principles within Azure environments
- Familiarity with Azure data services and techniques for tuning cloud data pipeline performance
Systems:
- Proficient with Microsoft Suite
- Proficient in a scripting or programming language, i.e. – Python
- Azure and Snowflake – Experience with the broader Azure data platform and modern cloud data architecture, working knowledge of data governance and data security best practices within the programs, preferred
- Power BI – Experience supporting business users with self-service reporting and analytics, preferred
Physical Requirements:
- Ability to lift 25 pounds
- Repeated use of sight to read documents and computer screens
- Repeated use of hearing and speech to communicate on telephone and in person
- Repetitive hand movements, such as keyboarding, writing, 10-key
- Walking, bending, sitting, reaching, and stretching in all directions
Notice to Recruiters and Staffing Agencies: To protect the interests of all parties, Higginbotham Insurance Agency, Inc., and our partners, will not accept unsolicited potential placements from any source other than directly from the candidate or a vendor partner under MSA with Higginbotham. Please do not contact or send unsolicited potential placements to our team members.
Equal Opportunity EmployerThis employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.
Similar Jobs
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Design and build data infrastructure, pipelines, and integration solutions using cloud and big-data tools. Develop data lakes/warehouses, ensure data quality and security, apply data modeling and DAGs, use Databricks, Airflow, and Hadoop, and collaborate with clients to deliver actionable insights.
Top Skills:
Apache AirflowApache HadoopAWSAzure Data FactoryDagsData LakeData WarehouseDatabricksDimensional ModelingAzure
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead design and implementation of data infrastructure, pipelines, and integrations using cloud platforms. Manage teams and client accounts, ensure data quality, security, and compliance, deploy scalable solutions (Databricks, Snowflake), mentor junior staff, and identify data-driven business opportunities.
Top Skills:
Amazon Web Services (Aws)Azure Data FactoryDatabricksSnowflake
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, build and maintain scalable data pipelines and automated workflows using Python, Airflow, DBT and cloud warehouses. Partner with Analytics, Sales and Marketing to deliver curated marketing datasets, enforce data quality through validation and CI/CD, and support production deployment and monitoring of Enterprise Data Lake/ODS solutions.
Top Skills:
Apache AirflowDbtGitGitlab Ci/CdJenkinsJinjaPythonRedshiftSnowflakeSQL
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
