Senior Data Engineer – dbt, Snowflake and AWS – Sydney

Senior Data Engineer – dbt, Snowflake and AWS – Sydney

24 Oct
|
Delivery Centric
|
Sydney

24 Oct

Delivery Centric

Sydney

Senior Data Engineer – dbt, Snowflake and AWS – Sydney

Delivery Centric is seeking an experienced Data Engineer with strong expertise in dbt, Snowflake SQL, and AWS to develop and maintain data transformation pipelines. The role involves building governed, consumer-ready datasets, developingdata workflows, supporting ingestion processes, and ensuring data quality across financial data pipelines.

Key Responsibilities

- Build and maintain dbt transformation models across multiple pipeline layers, from raw ingestion to governed, consumer-ready datasets.
- Write Snowflake SQL for complex transformations, including type casting, deduplication, incremental loads, and surrogate key generation.
- Develop and debug Apache Airflow DAGs running on AWS ECS.
- Support Python-based AWS Lambda ingestion processes, including file validation, control file generation, and S3 event handling.
- Maintain source-to-target mapping documentation and align data models with business requirements and data specifications.
- Support downstream consumer onboarding through data-sharing mechanisms and event-driven notifications.
- Participate in code reviews, develop YAML-based data quality tests, and manage tickets through the full delivery lifecycle, from design to production.

Required Skills & Experience

- Proficiency in dbt Core and Snowflake.
- Experience developing and maintaining Apache Airflow DAGs.
- Working knowledge of AWS services, including S3, Lambda, MWAA, ECS, Glue Data Catalog, Lake Formation, SQS, and EventBridge.
- Experience working with fixed-format or structured financial data files.
- Experience with CI/CD pipelines using GitHub Actions.





Delivery Centric is seeking an experienced Data Engineer with strong expertise in dbt, Snowflake SQL, and AWS to develop and maintain data transformation pipelines. The role involves building governed, consumer-ready datasets, developingdata workflows, supporting ingestion processes, and ensuring data quality across financial data pipelines.

Key Responsibilities

- Build and maintain dbt transformation models across multiple pipeline layers, from raw ingestion to governed, consumer-ready datasets.
- Write Snowflake SQL for complex transformations, including type casting, deduplication, incremental loads, and surrogate key generation.
- Develop and debug Apache Airflow DAGs running on AWS ECS.
- Support Python-based AWS Lambda ingestion processes, including file validation, control file generation, and S3 event handling.
- Maintain source-to-target mapping documentation and align data models with business requirements and data specifications.
- Support downstream consumer onboarding through data-sharing mechanisms and event-driven notifications.
- Participate in code reviews, develop YAML-based data quality tests, and manage tickets through the full delivery lifecycle, from design to production.

Required Skills & Experience

- Robust SQL skills.
- Proficiency in dbt Core and Snowflake.
- Experience developing and maintaining Apache Airflow DAGs.
- Working knowledge of AWS services, including S3, Lambda, MWAA, ECS, Glue Data Catalog, Lake Formation, SQS, and EventBridge.
- Experience working with fixed-format or structured financial data files.
- Experience with CI/CD pipelines using GitHub Actions.

#J-18808-Ljbffr

📌 Senior Data Engineer – dbt, Snowflake and AWS – Sydney
🏢 Delivery Centric
📍 Sydney

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer – dbt, snowflake and aws – sydney / sydney

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer – dbt, snowflake and aws – sydney / sydney