Data Engineer Consultant

Responsibilities

• Pipeline Development: Create and maintain optimal data pipeline architecture (ETL/ELT) using tools like Airflow, DBT, or Fivetran.
• Data Modeling: Design, build, and manage large, complex data sets that meet functional and non-functional business requirements.
• Infrastructure Management: Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
• Stakeholder Support: Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and GCP 'big data' technologies.
• Data Quality: Work with data and analytics experts to strive for greater functionality in our data systems, ensuring data integrity and security.
• Required Skills & Qualifications
• Advanced SQL Knowledge: Experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Programming: Proficiency in Python , Scala, or Java
• Cloud Platforms: Experience with any cloud services such as AWS (Redshift, S3, Glue), Azure (Data Factory, Synapse), but preference for experience with Google Cloud (BigQuery).
• Big Data Tools: Experience with Spark, Hadoop, Kafka, or similar distributed systems.
• Data Warehousing: Solid understanding of Snowflake, Databricks, or similar modern data stack components.
• Preferred Attributes
• Experience supporting and working with cross-functional teams in a dynamic environment.
• A "DevOps" mindset-experience with Docker, Kubernetes, and CI/CD pipelines.
• Strong analytical skills related to working with unstructured datasets.
• CME Group: Where Futures are Made
• At CME Group, we embrace our employees' unique experiences and skills to ensure that everyone's perspectives are acknowledged and valued. As an equal-opportunity employer, we consider all potential employees without regard to any protected characteristic.

Additional Information

Job Title: Data Engineer We are looking for a Data Engineer to join our team and take ownership of our data infrastructure. You will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at cmegroup? Share your experience