Senior Data Engineer – dbt, Snowflake, Airflow & AWS

Job Type: Contract - Months

Location: Sydney

Experience: Senior-level data engineering experience

Eligibility: Australian Citizens or candidates with full working rights in Australia only

Job Overview

We are seeking an experienced Senior Data Engineer with strong expertise in SQL, dbt, Snowflake, Apache Airflow, and AWS to support the development and maintenance of scalable data pipelines and transformation models.

The ideal candidate will have hands-on experience building data transformation layers, managing workflow orchestration, developing ingestion processes, and delivering reliable, high-quality datasets for downstream consumers. Experience working with structured financial data files is highly desirable.

Key Responsibilities

- Build and maintain dbt transformation models across multiple pipeline layers, from raw ingestion to governed, consumer-ready datasets.
- Write and optimise Snowflake SQL for complex transformations, including type casting, deduplication, incremental loads, and surrogate key generation.
- Develop, maintain, and troubleshoot Apache Airflow DAGs running on AWS ECS.
- Contribute to Python-based AWS Lambda ingestion processes, including file validation, control file generation, and S3 event handling.
- Maintain source-to-target mapping documentation and ensure data models align with business requirements and data specifications.
- Support downstream consumer onboarding through data-sharing mechanisms and event-driven notifications.




- Participate in code reviews and implement YAML-based data quality tests.
- Own engineering tickets throughout the full lifecycle, from solution design and development to production deployment and support.
- Follow established CI/CD practices and collaborate with cross-functional teams to ensure reliable data delivery.

Required Skills and Experience
- Strong SQL skills, including complex data transformations and query optimisation.
- Hands-on experience with dbt Core and Snowflake.
- Experience developing and maintaining Apache Airflow DAGs.
- Working knowledge of AWS services, including:
- Amazon S3
- AWS Lambda
- Amazon ECS
- Amazon MWAA
- AWS Glue Data Catalog
- AWS Lake Formation
- Amazon SQS
- Amazon EventBridge
- Experience building and maintaining data pipelines and ingestion workflows.
- Experience with GitHub Actions and CI/CD implementation.
- Familiarity with data quality testing, code reviews, documentation, and production support.
- Experience working with fixed-format or structured financial data files.

Nice to Have
- Experience with Apache Iceberg table format.
- Familiarity with data lakehouse architectures and governed data-sharing solutions.
- Experience implementing event-driven data processing and notification workflows.

How to Apply If you have robust experience with dbt, Snowflake, Apache Airflow, and AWS data engineering, please submit your updated resume highlighting your relevant technical skills and project experience.

We look forward to hearing from qualified candidates!

Pay: $600.00 – $650.00 per day

Work Location: In person

📌 Senior Data Engineer – dbt, Snowflake, Airflow & AWS (Sydney)
🏢 Shoolin Consultancy
📍 Sydney