Data Engineer

About the role

As part of Data Engineering team, you will be expected to share your time between supporting cloud platform, engage with internal stakeholders and support the on premise platform up to discontinuation. UK Data engineers are not solely backend developers, you will be expected to develop an understanding of the business, be comfortable about discussing analytics topics with the wider business, being able to lead meetings, represent the team as subject matter expert in large projects and build a contact network in Hiscox. The ideal candidate has a good balance between being an experienced data pipeline builder and data wrangler who enjoys improving the technical infrastructure, keeping in sight what actually delivers value to the business and being a customer manager, being able to able to engage and relate to people across a variety of backgrounds, understand their needs, critically access and negotiate the delivery of products. You will be responsible to represent the team in projects and deliver them end to end, being able to act with autonomy, escalating when appropriate. You will be required to build relationships with external providers on behalf of the team, understand and critically assess their proposals to drive the best output for UK retail. Having previously experience in the cloud data technology stack is a requirement, as you are expected to act as a technical expert, advising on technological decisions and contributing to the definition of best practices. Your key responsibilities will be Maintaining the existing processes in place, monitoring batch failures, acting accordingly in identifying and resolving the root cause and communicate with stakeholders on resolution and timescales; Design and build data pipelines to collect data from different sources for different purposes and types of consumption across the whole data engineering life cycle; Build productive relationships with business stakeholders to understand high value business problems that can be solved through the application of data processing and analytical systems and deliver robust solutions on the back of it; Act as the single point of contact for the team in large projects being able to follow the process end to end - understand requirements, negotiate deadlines, raise with management resources required and risks, maintain status updates and technical delivery of the data requirements; Supporting other teams including data scientists and data operations analysts, by providing technical expertise, understanding and critically assess their requirements, negotiating delivery and deadlines; Understand business requirements and refine into development tasks, estimating their complexity and dependencies, including management of tasks delivered by other technical teams (ie. Devops); Contribute to define the best practices and standards for the development being done, including working with solutions architects to implement sustainable and consistent solutions for Hiscox UK. Review the work and coach junior team members, including embedded peer review process. Required skills: Passion for and experience of building data analytical platforms to deliver business value; Experience working with Microsoft Azure Data Lake Storage, Microsoft Azure Data Factory, Databricks, EventHub, SSIS and relational databases; Good understanding of different types of data (i.e. structured, semi-structured and unstructured data) and the considerations that should be made in how they are stored; Ability to contribute to all aspects of technical solutions to business problems - design, infrastructure, development, testing and maintenance; Track record of taking initiative and delivering projects end-to-end; clear evidence of being self-driven/ motivated, working autonomy; Experience performing root cause analysis on internal and external data and processes to answer specific business questions, identify the source of any data errors or performance issues, identify opportunities for improvement and solve and /or implement them; The ability to communicate with all levels, and be confident enough to lead meetings, negotiate deliveries and deadlines and represent the team in projects; Immense curiosity, high energy and desire to go the extra mile to make a difference; Fluent in English, verbally and written