Lead the design and development of Azure-based big data solutions, including batch and real-time ETL/ELT pipelines, data architecture, ingestion, curation, warehousing, and storage. Build solutions using Azure Data Factory, Databricks, Synapse, Spark, Python, SQL, and related Azure services. Support Salesforce migration and integration while applying strong RDBMS, data management, and big data design expertise.
Expertise on Azure platforms including Azure Databricks, ADLS, and its various components, • In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure SQL Database, Azure Functions, Logic apps, Spark and Python programming etc. • Expertise on Azure platforms including Azure Databricks and its various components, including Delta Lake. • Strong understanding of data architecture and data management principles. • In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions, Logic apps, Spark Knowledge etc. • In-depth Knowledge on designing of ETL Piplines for Batch and Real time in Azure data factory and Azure datafactory • Hands on experience on Function apps , Event Hubs,, Web apps , API M. • Good have to experience on Migration to Salesforce • Strong experience with designing ETL/ELT Pipelines/Data flows using Azure Data Factory as Primary skill and SSIS/Informatica as additional skills. • Proficiency in programming languages such as Python, SQL, Spark notebooks and Scala. • Must have strong development & design skills in leading RDBMS environments e.g. MS SQL Server and Oracle 10g. • Experience of Big data approach, architectural concepts, data sourcing/ ingestion/ curation and storage mechanisms. • Experience with real-time / near-real-time Data warehousing concepts and Design approaches.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, develop, test, and maintain large-scale healthcare data pipelines and AWS data warehouse solutions. Build Redshift and EMR ETL processes, monitor pipeline performance, resolve data discrepancies, support deployments, conduct code reviews, and document database designs and testing. Collaborate with engineers, analysts, consultants, and cross-functional teams to improve data quality, scalability, and processing efficiency.
Top Skills:
Amazon EmrAmazon RedshiftAmazon S3Automated Testing FrameworksAWSCi/CdETLOraclePythonSQLSQL Server
Financial Services
Build and operate scalable Databricks-on-AWS data pipelines using PySpark, Delta Lake, and lakehouse patterns. Optimize performance, implement data quality, monitoring, alerting, and automated remediation, and deliver curated datasets for BI and analytics partners. Collaborate with stakeholders on architecture and design while applying secure software engineering, CI/CD, agile, and operational stability practices. The role also uses AI-assisted development tools and supports workforce data analytics.
Top Skills:
AlteryxAmazon AthenaAmazon EmrAmazon S3Apache AirflowApache IcebergSparkAutosysAWSAws CloudwatchAws GlueAws LambdaBitbucketClaudeDatabricksDatabricks WorkflowsDelta LakeDelta Live TablesGitGithub CopilotJavaJenkinsOracleParquetPysparkPythonScalaSigmaSpinnakerSQLTableau
Artificial Intelligence • Information Technology • Professional Services • Software • Analytics • Generative AI • Big Data Analytics
Lead enterprise-scale Akeneo PIM implementations, including solution architecture, platform configuration, data architecture, API development, and third-party integrations. Collaborate with developers, architects, clients, and stakeholders to deliver digital transformation projects. Ensure data privacy, security, and lifecycle protection while documenting technical solutions, gathering requirements, managing expectations, and mentoring junior team members.
Top Skills:
Adobe CommerceAkeneo PimAmazon DynamodbAws AppsyncAws LambdaCcpaDamGdprGraphQLMagentoMdmPimRest ApisShopify
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
