Job Description

Job Description:
n ROLE - Senior Data Engineer

n

Client: CBA

n Responsibilities

n

• Building and maintaining dbt transformation models across multiple pipeline layers — from raw ingestion through to governed, consumer-ready datasets

n

• Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation

n

• Developing and debugging Apache Airflow DAGs on AWS ECS

n

• Contributing to AWS Lambda-based ingestion( Python) — file validation, control file generation, S3 event handling

n

• Maintaining source-to-target mapping documentation and aligning models to business requirements and data specs

n





• Supporting onboarding of downstream consumers via data sharing mechanisms and event-driven notifications

n

• Participating in code reviews, writing YAML-based data quality tests, and owning tickets from design through to production

n

Tech stack required

n

• Robust SQL

n

• Proficiency with dbt Core

n

• Apache Iceberg Table format (Nice to have)

n

• Apache Airflow

n

• AWS - Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge

n

• Experience with fixed-format or structured financial data files

n

• CICD with Github Actions.

n

📌 Senior Data Engineer (Sydney)
🏢 Virtusa APAC
📍 Sydney