Senior Data Engineer
ExternalPrepare for this interview
EliteAI-generated questions, company research, and talking points tailored to this role
About the role
We're a passionate team, consisting of a Head of Data, a Data Engineer, an Analytics Engineer and a Senior Data Analyst dedicated to all things data. You'll be at the centre of our expanding Data team. We're enthusiastic about exploring new tools and technologies, and we thrive on brainstorming to solve challenges and apply best practices. Our team is set to grow soon, welcoming Data Engineers, Analytics Engineers, Analysts, and Data Scientists, all playing a pivotal role in Talon.One's development. As a Senior Data Engineer / Data Ops, you will be responsible for all engineering tasks related to the data infrastructure, data ingestion and DWH pipelines. You will own our data ingestion workflows (currently based on a Kafka stream) and will make sure that the data from our PostgresDB instances with a very high amount of data is ingested live into BigQuery. Besides, you will manage our overall data platform infrastructure, recommend improvement and make sure to always follow best practices. Finally, you will also of course be involved in the Data Engineering pipelines, assisting in the modelling of various data sources helping literally all departments within the company making better decisions. ONCE YOU ARE HERE YOU WILL: Own the data ingestion streams for all of our client's DBs, from Postgres to BigQuery Own the overall data infrastructure: set up, maintain and improve our stack with new technologies for more efficiency and best practices. E.g. improve orchestration Write DWH pipelines and improve our overall DWH code to apply best practices and bring more efficiency. Be part of a data team composed of various profiles, be at the center of all infrastructure decisions and work closely with other stakeholders from the R&D department, especially the DevOps team. WHAT WE NEED YOU TO BRING TO THE TABLE: 3 -5 years of experience in the Data Engineering / Data Ops field, ideally working on some big data warehouse projects. You are familiar with the modern data stack and are able to recommend, set up and maintain all different kinds of components from Data ingestion to automation. You have experience with a wide range of tools and technologies within the modern data stack: Kafka, Airflow, Dagster, DBT Core, BigQuery, Lambda functions etc.. You have experience with general infrastructure / DevOps management technologies: ArgoCD, Kubernetes, Docker, Github, Postgres, GCP etc.. You always thrive for applying data engineering best practices: consistency checks, testing data reliability, monitoring on top of ingestion pipelines, no double business logic in the code. ABOUT TECHNOLOGY: Kubernetes running on Google Cloud, ArgoCD, Terraform PostgreSQL Aiven Kafka Connect, Strimzi, Debezium DBT cloud, GCP, BigQuery, Fivetran We use Go for our API, core logic, and internal tooling Cypress for automated end-to-end testing Other odds & ends in JavaScript and shell script
Benefits
Additional Information
ABOUT TALON.ONE: Talon.One is the most powerful incentives engine that unifies loyalty, promotions and gamification into one holistic platform. Backed by enterprise-grade security and scalability, Talon.One empowers companies to build personalized, profitable promotions and loyalty programs using any data. Today, over 250 of the world's most-loved brands including Adidas, Sephora and Carlsberg work with Talon.One to drive deeper engagement and lasting loyalty with their customers.
Your Match
How well this role fits your profile.
Company Intel
What employees say
Worked at linkedinjobs? Share your experience