Data Engineer II

ROLE AND RESPONSIBILITIES

• Design, develop, and maintain optimal data pipelines and workflows.
• Provide technical guidance on architecture design and collaborate with Data Engineers for implementation.
• Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
• Perform data integration, transformation, and cleaning to create insightful and actionable data for the business.
• Translate business requirements into technical specifications and finished products.
• Participate in code reviews and contribute to team knowledge sharing.
• Lead the development and maintenance of documentation for data engineering processes and systems.
• Create ad-hoc reports requested by internal and external partners.
• Work as a team to support and troubleshoot errors for 100+ data pipelines.
• Work closely with the application development team to update data and data structures.
• Provide analysis, recommendations, and feedback to business process owners, leadership team, and the Information Technology department.
• Propose automated solutions to repeated development tasks.

QUALIFICATIONS

• Bachelor’s degree with major coursework in Computer Science or Business Administration/related field required. Equivalent work experience in a similar position may be substituted for educational requirements.
• Experience in data engineering or a related field.
• Strong proficiency in Python, T-SQL, SSMS, Databricks, and Azure Data Factory.
• Experience with data integration, transformation, and data warehousing.
• Strong understanding of data privacy and security regulations.
• Ability to translate business requirements into technical specifications and finished products.
• Proficiency in compiling data, creating reports, and presenting information.
• Proven experience working in a fast-paced environment supporting multiple concurrent projects.
• Strong written, verbal, and customer service skills.

PREFERRED SKILLS

• Ability to manage multiple tasks and projects simultaneously.
• Experience in mentoring junior developers or a desire to take on a mentoring role.
• Knowledge of healthcare data and related privacy and security regulations.
• Experience with cloud-based services like Azure.
• Strong problem-solving skills and attention to detail.
• Experience with healthcare data.
• Experience using agile framework.
• Experience with software development life cycle tools such as Red-Gate, Bitbucket, or JIRA.

MENTAL AND PHYSICAL DEMANDS

• This position will be exposed mainly to an indoor office environment and will be expected to work in or around computers and printers.
• The nature of the work is sedentary, and the employee will be sitting most of the time.
• Essential physical functions of the job include typing and the repetitive motion to utilize computer software and hardware continuously throughout the day.
• Essential mental functions of this position include concentrating on analytical tasks, reading information, and verbal/written communication to others continuously throughout the day.

RELATED DUTIES AS ASSIGNED

• This job description documents the general nature and level of work but is not intended to be a comprehensive list of activities, duties, or responsibilities required for this position. Consequently, employees may be asked to perform other duties as required.
• Employees may also be asked to complete certain compliance requirements set forth by our Business 
• Partners in the performance of their jobs including but not limited to requests for background and drug screenings and disclosures of personal health information or personally identifiable information. 
• Exemptions as provided under the ADA and TITLE VII of the Civil Rights Act will be observed and followed.
• Reasonable accommodations may be made to enable individuals with disabilities to perform the functions outlined above.