14 Nov
|
NCS Australia
|
Melbourne
14 Nov
NCS Australia
Melbourne
Job Description
We are seeking an experienced Snowflake Data Engineer to design, build, and maintain scalable data pipelines and transformation frameworks. You will own the end-to-end data flow from ingestion through to consumption-ready Gold layer outputs, ensuring data quality, performance, and alignment with business requirements.
As a Snowflake Data Engineer, you will design and build reusable ingestion frameworks supporting batch, incremental, and streaming loads with robust error handling and schema evolution capabilities. You will develop and maintain dbt transformation models across Silver (cleansed, conformed) and Gold (consumption-ready) layers, ensuring alignment with source-to-target mappings and business rules. You will implement comprehensive automated testing frameworks (uniqueness, not-null, referential integrity, and custom business-rule tests) to safeguard data quality, validate Gold layer outputs against agreed models, and perform reconciliation testing across source,
Silver, and Gold layers. You will own defect triage, investigation, and resolution within agreed SLAs, conducting root-cause analysis and implementing preventative fixes. You will produce and maintain interface documentation covering source connections, data contracts, schedules, dependencies, and technical metadata lineage. You will apply CI/CD and version control standards to all pipeline and dbt code, ensuring peer-reviewed, tested deployments across environments. You will monitor and optimise pipeline performance, reliability, and cost through logging, alerting, and observability implementation. Finally, you will collaborate closely with Data Modellers, analysts, and stakeholders to ensure delivered pipelines are fit for purpose, performant, and aligned to business definitions.
📌 Snowflake Data Engineer (Melbourne)
🏢 NCS Australia
📍 Melbourne