AmeriLife Logo

AmeriLife

Lead Data Engineer - Databricks

Posted 2 Days Ago
In-Office or Remote
21 Locations
150K-175K Annually
Mid level
In-Office or Remote
21 Locations
150K-175K Annually
Mid level
The Lead Data Engineer will design and build scalable data pipelines on Databricks, develop ETL/ELT pipelines with PySpark, and mentor engineering teams for data transformation and analytics.
The summary above was generated by AI

Our Company

Explore how you can contribute at AmeriLife.

For over 50 years, AmeriLife has been a leader in the development, marketing and distribution of annuity, life and health insurance solutions for those planning for and living in retirement.

Associates get satisfaction from knowing they provide agents, marketers and carrier partners the support needed to succeed in a rapidly evolving industry.

Job Summary

The Lead Data Engineer will play a key role in engineering the enterprise data platform on Databricks, building scalable pipelines and transformation frameworks that support enterprise analytics and AI initiatives.

Job Description

Key Responsibilities

  • Design and build scalable Databricks data pipelines
  • Develop ETL/ELT pipelines using PySpark
  • Implement data ingestion and transformation frameworks
  • Optimize Spark workloads for performance and scalability
  • Establish engineering standards and mentor engineers
  • Collaborate with architecture and analytics teams to enable data products

Core Technical Skills

  • Strong expertise in Python and SQL
  • Deep experience with Databricks, PySpark, and Spark
  • Experience building large-scale data pipelines
  • Strong understanding of data transformation and distributed processing

Additional Expectations

  • Strong communication and collaboration skills
  • Ability to mentor engineers and influence engineering best practices
  • Passion for building scalable data platforms

Bonus Qualifications

  • Databricks certification
  • AWS or Azure certification

Compensation

  • Salary Range: $150,000 to $175,000
  • This role may be eligible for a discretionary annual bonus.
  • Salary offers will vary commensurate with experience, education, skills, and training 

What AmeriLife Offers

A comprehensive benefits package that includes PTO, medical, dental, vision, retirement savings, disability insurance, and life insurance.

Equal Employment Opportunity Statement

We are an Equal Opportunity Employer and value diversity at all levels of the organization. All employment decisions are made without regard to race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), sexual orientation, gender identity or expression, age, national origin, ancestry, disability, genetic information, marital status, veteran or military status, or any other protected characteristic under applicable federal, state, or local law. We are committed to providing an inclusive, equitable, and respectful workplace where all employees can thrive.


Americans with Disabilities Act (ADA) Statement

We are committed to full compliance with the Americans with Disabilities Act (ADA) and all applicable state and local disability laws. Reasonable accommodations are available to qualified applicants and employees with disabilities throughout the application and employment process. Requests for accommodation will be handled confidentially. If you require assistance or accommodation during the application process, please contact us at [email protected].


Pay Transparency Statement

We are committed to pay transparency and equity, in accordance with applicable federal, state, and local laws. Compensation for this role will be determined based on skills, qualifications, experience, and market factors. Where required by law, the pay range for this position will be disclosed in the job posting or provided upon request. Additional compensation information, such as benefits, bonuses, and commissions, will be provided as required by law. We do not discriminate or retaliate against employees or applicants for inquiring about, discussing, or disclosing their pay or the pay of another employee or applicant, as protected under applicable law. Pay ranges are available upon request.


Background Screening Statement

Employment offers are contingent upon the successful completion of a background screening, which may include employment verification, education verification, criminal history check, and other job-related inquiries, as permitted by law. All screenings are conducted in accordance with applicable federal, state, and local laws, and information collected will be kept confidential. If any adverse decision is made based on the results, applicants will be notified and given an opportunity to respond.


Top Skills

Databricks
Pyspark
Python
SQL

Similar Jobs

Yesterday
In-Office or Remote
5-10 Annually
Senior level
5-10 Annually
Senior level
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
The Compliance Officer will promote compliance culture, advise on ethical practices, manage compliance programs, assess risks, and ensure effective communication across departments.
Top Skills: AmlAntitrustCompliance FrameworksData PrivacyGovernanceRegulatory RequirementsTrade Compliance
Yesterday
Easy Apply
Remote or Hybrid
Easy Apply
420K-420K Annually
Senior level
420K-420K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Sales Director will manage an Enterprise Sales team, develop metrics, coach Account Executives, and foster inclusion within a high-performing team.
Top Skills: SFDC
16 Minutes Ago
Remote
Mid level
Mid level
Other
The Business Analyst will drive digital solution deployment, analyze market performance, provide actionable insights, and enhance customer experience by collaborating with cross-functional teams.
Top Skills: Power BIPythonSparkSQL

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account