Senior Data Engineer
ExternalPrepare for this interview
EliteAI-generated questions, company research, and talking points tailored to this role
Responsibilities
- Platform Architecture and Data Engineering
- Build and maintain data solutions in Microsoft Fabric across Bronze, Silver, and Gold layers using CAE's data platform framework.
- Support and improve the enterprise data platform, including data warehouses and data lakes.
- Design, build, and maintain data pipelines using SQL and big data tools such as Spark, Kafka, or Hadoop.
- Develop reliable processes to ingest, transform, and deliver data from a variety of sources.
- Integrate data from internal, external, and IoT sources to support business needs.
- Build and maintain backend data solutions that support analysts, data scientists, and other business users.
- Operations, Quality, and Delivery
- Apply DevOps practices to improve the development and deployment of data solutions.
- Identify opportunities to automate manual work and improve data delivery processes.
- Follow data governance, architecture, and security standards.
- Monitor data pipelines and provide support when issues arise.
- Collaboration and Technical Leadership
- Work closely with product teams, data experts, architects, and other stakeholders to solve technical issues and support data platform needs.
- Help guide technical decisions, review code, and share best practices with the team.
- Collaborate with cross-functional teams on data and AI initiatives.
- Stay current with industry trends and recommend improvements to the platform and delivery processes.
Requirements
- Bachelor's degree in Computer Science , Engineering, or a related field. A master's degree is an asset.
- At least 6 years of experience in data engineering with strong hands-on coding in Python, Spark, SQL, and related scripting languages.
- Experience using Visual Studio Code and Git in modern development workflows.
- Required hands-on experience with Microsoft Fabric, including Lakehouse s , OneLake , pipelines, notebooks, and medallion architecture across Bronze, Silver, and Gold layers.
- Strong understanding of computer science fundamentals, including data structures and algorithms.
- Experience with Terraform.
- Experience working with cross-functional teams in a fast-paced environment.
- Experience with relational and NoSQL databases, including SQL Server, PostgreSQL, and Cosmos DB.
- Experience with workflow and orchestration tools such as Azure Data Factory and Airflow.
- Experience with DevOps and Github and infrastructure deployment tools such as ARM.
- Experience with Microsoft cloud and data platforms such as Fabric, Azure, Databricks, and Purview.
- Knowledge of medallion architecture across Bronze, Silver, and Gold layers.
- Experience with stream-processing technologies such as Spark Streaming.
- Familiarity with Kubernetes.
- Proficiency in Power BI for reporting and data visualization.
Benefits
Additional Information
Our engineers are the technical visionaries driving our innovative solutions. Renowned globally for designing, integrating, and delivering state-of-the-art simulation and training systems, you'll tackle complex challenges, collaborate across functions, and lead advancements that shape the future of our industry. Supported by a culture that fosters flexibility, growth, and technological excellence, our engineers are empowered to make a meaningful impact every day. Whether your passion lies in data, mechanical, or aerospace engineering, CAE provides the environment to refine your skills and create a lasting legacy in safety and simulation
Your Match
How well this role fits your profile.
Company Intel
What employees say
Worked at CAE? Share your experience