Building and maintaining dbt transformation models across multiple pipeline layers — from raw ingestion through to governed, consumer-ready datasetsWriting Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generationDeveloping and debugging Apache Airflow DAGs on AWS ECSContributing to AWS Lambda-based ingestion( Python) — file validation, control file generation, S3 event handlingMaintaining source-to-target mapping documentation and aligning models to business requirements and data specsSupporting onboarding of downstream consumers via data sharing mechanisms and event-driven notificationsParticipating in code reviews, writing YAML-based data quality tests, and owning tickets from design through to productionTech stack required• Robust SQL• Proficiency with dbt Core & Snowflake• Apache Iceberg Table format (Nice to have)• Apache Airflow• AWS - Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge• Experience with fixed-format or structured financial data files• CICD with Github Actions.
📌 Senior Data Engineer (Sydney)
🏢 DWS
📍 Sydney