Lead Data Engineer - Databricks
External
Amerilife · RemotePrepare for this interview
EliteAI-generated questions, company research, and talking points tailored to this role
Responsibilities
- Design and build scalable Databricks data pipelines
- Develop ETL/ELT pipelines using PySpark
- Implement data ingestion and transformation frameworks
- Optimize Spark workloads for performance and scalability
- Establish engineering standards and mentor engineers
- Collaborate with architecture and analytics teams to enable data products
- Core Technical Skills
- Strong expertise in Python and SQL
- Deep experience with Databricks, PySpark, and Spark
- Experience building large-scale data pipelines
- Strong understanding of data transformation and distributed processing
- Additional Expectations
- Strong communication and collaboration skills
- Ability to mentor engineers and influence engineering best practices
- Passion for building scalable data platforms
- Bonus Qualifications
- Databricks certification
- AWS or Azure certification
Benefits
Additional Information
Our Company Explore how you can contribute at AmeriLife. For over 50 years, AmeriLife has been a leader in the development, marketing and distribution of annuity, life and health insurance solutions for those planning for and living in retirement. Associates get satisfaction from knowing they provide agents, marketers and carrier partners the support needed to succeed in a rapidly evolving industry. Job Summary The Lead Data Engineer will play a key role in engineering the enterprise data platform on Databricks, building scalable pipelines and transformation frameworks that support enterprise analytics and AI initiatives. Job Description
Your Match
How well this role fits your profile.
Company Intel
What employees say
Worked at amerilife? Share your experience