Senior Data Engineer (AWS Cloud, API Integration)

About the role

Senior Data E ngineer (AWS Cloud, API Integration) We're embarking on an exciting Digital Transformation program and are ready to push the boundaries and deliver engineering best practices to elevate the digital experience of our customers You have knowledge and experience that spans both development and architecture, including data engineering, modelling and cloud architecture Together we will build tomorrow's bank today, using world-leading engineering, technology, and innovation. Do Work That Matters We're driving a major transformation in Marketing & Corporate Affairs (MCA) across Customer Service Channels (voice, chat, email, social, web & mobile). This role focuses on building scalable, secure, and high‑performance data platforms that power real‑time and analytical use cases. You'll also contribute to API services and AI‑enabled features that enhance customer experiences. You'll design and deliver data solutions that enable personalised service, operational insights, and intelligent automation across multiple customer touchpoints. Your work will underpin real‑time decisioning, reporting, and AI‑driven capabilities for MCA. See Yourself in Our Team You'll join the Customer Service Channels domain within MCA, partnering with CDAO and channel teams to deliver data pipelines, orchestration frameworks, and integration patterns that support both batch and streaming use cases. While your core strength is data engineering, you'll also help enable API exposure and AI/ML integration where needed. Roles & Responsibilities Design & Build AWS Data Platforms Architect, implement, and operate data lakes/lakehouse on S3 with Glue/Athena/Redshift, Iceberg/Hudi/Delta; optimise storage layout, partitioning, compaction, and schema evolution. Build batch and streaming pipelines using Glue/EMR/Lambda/Step Functions, Kafka (good to have); design for idempotency, replay, DLQs, and exactly‑once/at‑least‑once semantics. Productionise Airflow orchestration with robust DAG design, SLA management, retry/backoff, and per‑environment configuration. Implement CI/CD pipelines for data workflows and services using AWS native tools (CodePipeline, CodeBuild) or GitHub Actions/Automations; include automated testing and deployment strategies. Ensure data governance, security, and compliance: lineage, cataloguing, DQ checks, PII protection, and privacy‑by‑design. Expose curated data and real‑time context through API services (REST/GraphQL) with proper security, caching, and versioning. Support AI/ML integration for channel use cases (e.g., summarisation, classification, RAG pipelines) by enabling model endpoints and feature pipelines. Collaborate with cross‑functional teams to ensure solutions meet performance, reliability, and operational excellence standards. Mentor engineers on data engineering best practices, orchestration, and automation. We're interested in hearing from people who Are passionate about building next generation data platforms and data pipeline solution across the bank. Constantly thinking outside the box and breaking boundaries to solve complex data problems. Can collaborate, co-create and contribute to existing Data Engineering practices in the team. Skills Required We use a broad range of tools, languages, and frameworks. We don't expect you to know them all but experience or exposure with some of these (or equivalents) will set you up for success in this team; Core Data Engineering & AWS Expertise Strong experience with AWS services: S3, Glue, EMR, Lambda, Step Functions, Redshift, Athena, Lake Formation. Proficiency in data modelling, SQL, and building ETL/ELT pipelines for structured and semi‑structured data. Familiarity with lakehouse technologies (Iceberg/Hudi/Delta) and metadata management. Orchestration & CI/CD Hands‑on experience with Apache Airflow for workflow orchestration. Design and implement CI/CD pipelines using AWS CodePipeline/CodeBuild or GitHub Actions Develop automated testing and deployment strategies Leverage Infrastructure as Code tools such as Terraform and CloudFormation Demonstrate proficiency in Python and SQL for scripting automation and operational tasks Utilise containerisation technologies (e.g., Docker) and understand Kubernetes concepts for scalable deployments Gain exposure to API design and integration (REST/GraphQL) and API gateways Understand AI/ML workflows, including model deployment, monitoring, and basic MLOps practices Snowflake experience is advantageous Working with us Whether you're passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you. Here, you'll thrive. You'll be supported when faced with challenges and empowered to tackle new opportunities. We're hiring engineers from across all of Australia and have opened technology hubs in Melbourne and Perth. We really love working here, and we think you will too. We support our people with the flexibility to balance where work is done with

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at cba? Share your experience