Data Solution Architect with Datastage, Databricks

What Working at Hexaware offers: 
Hexaware is a dynamic and innovative IT organization committed to delivering cutting-edge solutions to our clients worldwide. We pride ourselves on fostering a collaborative and inclusive work environment where every team member is valued and empowered to succeed. Hexaware provides access to a vast array of tools that enhance, revolutionize, and advance professional profile. We complete the circle with excellent growth opportunities, chances to collaborate with highly visible customers, chances to work alongside bright brains, and the perfect work-life balance. With an ever-expanding portfolio of capabilities, we delve deep into and identify the source of our motivation. Although technology is at the core of our solutions, it is still the people and their passion that fuel Hexaware s commitment towards creating smiles. At Hexaware we encourage to challenge oneself to achieve full potential and propel growth. We trust and empower to disrupt the status quo and innovate for a better future. We encourage an open and inspiring culture that fosters learning and brings talented, passionate, and caring people together. We are always interested in, and want to support, the professional and personal you. We offer a wide array of programs to help expand skills and supercharge careers. We help discover passion the driving force that makes one smile and innovate, create, and make a difference every day.

What would you do?

Job Description:

Position:             Data Solution Architect with Datastage, Databricks

Location:             Newtown Square, PA 19073 (5 days onsite)

Fulltime role

As a Solution Architect, you will be responsible for:

• Strategic planning and hands-on engineering of Big Data and cloud environments that support our clients’ advanced analytics and data science initiatives.

• Provide support in defining the scope and sizing of work

• Working closely with various enterprise architects Information security teams, Data management team, to ensure the architected solution meets all the needs of a customer, from a functionality perspective and IT solution engineering perspective.

• Translate business requirements into technology solutions

• Lead and own all aspects of our data solution including artifact creation such as diagrams, playbooks and other technical documents

• Mentor and guide Jr. team members to deliver the solutions on-time

• Create various architecture blueprints and work with the development team to deliver the vision.

Domain/Functional Skills:

 Technical Skills:

• Overall 10+ years of experience of experience with Data Management, Big Data, Data Warehousing and Analytics.

• Must have Databricks, DataStage experience and healthcare domain exp.

• Experience with Azure services to create a medallion architecture for greenfield and brownfield implementations.

• Experience in exposing databricks unity catalog based datasets for REST API consumption.

• At least 3 to 4 years of experience in Architecting and migrating Oracle, DataStage based Enterprise warehouse to Azure using Databricks.

• 2-3 years of experience in designing and developing ETL solutions using Data Stage.

• Understanding and reverse engineering of DataStage parallel ,server and sequence ETL jobs to Databricks SparkSQL/PySpark/Spark Declarative pipelines.
• Analysis and converting custom stages, local containers, shared containers, routines and functions to Databricks SparkSQL/PySpark code.
• Analysis of the DataStage Configuration & Batch-job Shell scripts. 

• Deep expertise in reverse engineering of Data Stage code and producing complexity reports.

• 3+ years of hands-on experience in creating an end-to-end lineage of all inbound and outbound file/data delivery including regulatory or operational reporting

• 3+ years of hands-on experience with ADF, Pyspark 

• 1-2 years of experience with Tidal.

• One to two years of experience in Collibra DQ and DG is plus.

• Hands on working experience with scripting languages such as Python, Pyspark, Spark SQL or Shell Scripting, etc.

• Extensive hands-on experience in building and optimizing Databricks notebooks, tuning and optimizing ETL/ELT process developed ADF.

• Experience with implementation of data security, encryption, PII/PSI legislation, identity and access management across sources and environments.

• Experience with data process Orchestration, end-to-end design and build process of Near-Real Time and Batch Data Pipelines

• 3-5 years of experience in healthcare Payer domain experience is a nice to have experience.

• Ability to provide technical leadership and oversight on multiple projects/tracks. 

• Strong client-facing communication and facilitation skills

Equal Opportunities Employer: 
Hexaware Technologies is an equal opportunity employer. We are dedicated to providing a work environment free from discrimination and harassment. All employment decisions at Hexaware are based on business needs, job requirements, and individual qualifications. We do not discriminate based on race including colour, nationality, ethnic or national origin, religion or belief, sex, age, disability, marital status, sexual orientation, parental status, gender reassignment, or any other status protected by law. We encourage candidates of all backgrounds to apply.

Find out more at Hexaware.com.