Selecting and integrating any Big Data tools and frameworks required providing requested capabilities
Implement ETL/ELT flows via Big Data Solutions i.e. Spark, Python, Azure Data Factory, Azure Synapse, Azure Databricks, etc.
To be able to monitor the performance and advice necessary infrastructure changes or performance tuning in codes.
Support business users in use of the Enterprise Data Lake (EDL) as part of BAU
Perform POC on new integration patterns and solutions.
Maintain and monitor platform stability and performance of EDL
Attends to Incidents and change requests
Write and maintain technical documentation
Perform unit tests and system integration tests
Executes updates, patches, and other activities required to maintain and enhance the operations of the EDL
Supports the Agile delivery squads when required
Requirements
Proficient understanding of distributed computing principles
Good Knowledge of Hadoop cluster, Azure, with all included services
Ability to solve any ongoing issues with operating the cluster
Experience with Azure ADLS, Data Factory, Databricks, Event Hubs
Experience with data engineering projects i.e. integration of data from multiple data sources to a target system
Good knowledge of data querying tools - Azure Synapse Analytics, Databricks SQL Warehouse
Knowledge in data streaming (e.g. Event Hubs, Spark)
Knowledge in Python and Spark
Knowledge in any Change Data Capture (CDC) solutions (e.g. Debezium)
Experience in working on Agile projects is an advantage.
Experience on Azure Cloud and/or other Cloud platforms
Database development and management (e.g. Azure SQL, Cosmos)
Education and experience
Bachelor's degree preferably in Computer Science or Data/Engineering related courses
Recognized qualification in Service Management helpful
ITIL certification helpful
10+ years in one or more of the following o Data Engineer o Platform Engineer o DevOps Engineer o Software Engineer
Project management experience is an advantage.
Understanding of the insurance and/or financial industry is an asset
Experience with Alibaba Cloud, AI/BI, and/or GenAI is an advantage.
When you join our team:
We'll empower you to learn and grow the career you want.
We'll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
As part of our global team, we'll support you in shaping the future you want to see.
About Manulife and John Hancock
Manulife Financial Corporation is a leading international financial services provider, helping people make their decisions easier and lives better. To learn more about us, visit https://www.manulife.com/en/about/our-story.html .
Manulife is an Equal Opportunity Employer
Working Arrangement
Hybrid
Benefits
Flexible schedule
Additional Information
Manulife is a leading international financial services provider, helping people make decisions easier and lives better. Help shape the future you want to see - and discover that better can take you anywhere you want to go.
The Asia Data Office is looking for an experienced Senior Data Engineer to join our team to support our regional partners. If you have passion for data and a desire to drive quality data solutions within a data driven culture, then read on to learn more about this opportunity!
We are looking for the right individual who would be interested and enjoy the opportunity to support data operations, strong willingness to learn and build data operations skills through team collaboration, desire to drive and execute on our data strategy, willing to help mature our agile practices, and is looking for an opportunity to embrace technical, operational, and informal leadership roles on the team.
Manulife · Chengdu, China