The role involves developing data pipelines using Azure Databricks and PySpark, translating banking requirements into technical designs, and ensuring data quality and governance.
Role: Azure Databricks / PySpark Developer with Business Analysis (Banking Domain)
Location: Mount Laurel, NJ
Mode of Work: Onsite
Role Summary
We are seeking a mid‑to‑senior level Data Engineer with strong hands‑on expertise in Azure Databricks, PySpark, Azure Data Factory, and Synapse Analytics, combined with solid Business Analysis skills
This is a hybrid techno‑functional role where you will develop scalable data pipelines and also translate banking business requirements into technical designs.
You will collaborate with business users, data architects, and cross‑functional technology teams to deliver high‑quality data solutions supporting regulatory reporting, risk analytics, fraud detection, customer insights, and core banking operations.
Key Responsibilities
Technical Responsibilities-Data Engineering & Development
- Design, build, and optimize ETL/ELT data pipelines using Azure Databricks (PySpark), ADF, and Synapse.
- Develop scalable data ingestion frameworks for batch and near‑real‑time data.
- Implement Delta Lake for ACID‑compliant, performant data workflows.
- Build data transformation logic using PySpark for cleansing, validation, and enrichment.
- Optimize Spark jobs for performance, reliability, cost, and parallel execution.
- Integrate data across multiple banking systems (CBS, Loans, Cards, Payments, AML, Risk, Regulatory platforms).
- Develop reusable modules, notebooks, parameterized pipelines, and CI/CD‑ready components.
- Ensure data quality, profiling, governance, lineage, and audit requirements are met.
- Work with ADO/Git for version control, branching, and deployment.
Business Analysis Responsibilities
- Interact with business stakeholders: Risk, Finance, Payments, Operations, Compliance, Treasury, etc.
- Gather, analyze, and document business/stakeholder requirements.
- Translate banking use cases into technical specifications and data transformation rules.
- Perform data mapping, source‑to‑target documentation, and business glossary creation.
- Conduct gap analysis, feasibility studies, and propose data solutions.
- Support UAT, perform data validation, and work closely with end‑users for sign‑off.
- Identify data issues, troubleshoot root causes, and propose process improvements.
- Communicate insights and updates to both technical and non‑technical teams.
Top Skills
Azure Data Factory
Azure Databricks
Pyspark
Synapse Analytics
Similar Jobs
Information Technology • Consulting
Lead the development of data pipelines and transformations in Azure Databricks, converting Scala programs to PySpark while leveraging various Azure technologies.
Top Skills:
AdfAzure Data Lake Gen 2Azure DatabricksDelta LakePysparkPythonSparkSynapse Analytics
Information Technology • Consulting
The Senior Azure Data Engineer will manage data ETL processes, mentor junior staff, and work on cloud technologies in Azure. Required experience includes Datawarehouse expertise.
Top Skills:
AdfAzureDatabricksDatawarehousePysparkPython
Information Technology • Consulting
The Big Data Lead will manage database development, ETL/ELT processes, and data warehousing, optimizing performance and ensuring data pipelines work reliably.
Top Skills:
AWSAws GlueAws S3AzureAzure BlobAzure Data FactoryAzure DevopsGitJenkinsOracleSnowflakeSQLTalendTeamcity
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
