20 Oct
|
WattleCore Technologies Pty
|
North Sydney
20 Oct
WattleCore Technologies Pty
North Sydney
The Chance
We are seeking 1–2 experienced Snowflake Designer / Engineers with strong dbt expertise to join an enterprise data platform program for our client. You will design and build secure, well-governed Snowflake data layers and dbt transformation pipelines over large financial datasets, working in an agile scrum team within architecture standards set by the client’s enterprise architects. Experience migrating from legacy SAS or Teradata platforms will be highly regarded.
Key Responsibilities
Snowflake design and build
- Design and implement Snowflake database and schema layering (e.g. raw / staging / integration / curated / consumption) aligned to enterprise data architecture standards.
- Size, configure and monitor virtual warehouses for workload isolation, concurrency and cost efficiency, including auto-suspend, scaling policies and resource monitors.
- Implement role-based access control (RBAC) using functional and access role hierarchies, following least-privilege principles.
- Design and apply dynamic data masking, tag-based masking and row access policies to protect sensitive and regulated financial data.
- Contribute to environment strategy (dev / test / prod), object naming conventions and deployment automation.
dbt development
- Build and maintain dbt (Core or Cloud) projects on Snowflake using clear model layering (sources, staging, intermediate, marts).
- Implement incremental models and patterns (merge, append, delete+insert, snapshots / SCD Type 2) for high-volume data.
- Develop reusable macros, packages and Jinja logic to enforce standards and reduce duplication.
- Define and maintain dbt tests (generic, singular and custom) to enforce data quality and integrity.
- Produce dbt documentation and lineage so models are discoverable and traceable for engineers, analysts and governance teams.
- Integrate dbt into CI/CD pipelines with code review, automated testing and controlled promotion.
SQL, data quality and performance
- Write advanced, performant SQL (window functions, CTEs, semi-structured data handling, set-based logic) over very large financial datasets.
- Design data-quality and reconciliation frameworks – row counts, control totals, balance and sum checks, and source-to-target reconciliation – to evidence completeness and accuracy.
- Analyse query profiles and tune performance using clustering keys, pruning, materialisation choices, result caching and warehouse sizing.
- Investigate and resolve data defects, working with source system owners and testers.
Ways of working
- Work as an active member of a scrum team – sprint planning, estimation, stand-ups, reviews and retrospectives.
- Design within the patterns, guardrails and standards set by enterprise and solution architects, and raise design decisions and risks early.
- Produce clear technical design documentation and contribute to team knowledge sharing and peer review.
Essential Skills and Experience
- Proven hands-on experience designing and building on Snowflake in an enterprise setting, including schema layering, warehouse sizing, RBAC, masking and row-level security policies.
- Strong commercial experience with dbt (Core or Cloud) on Snowflake: model layering, tests, macros, incremental models, documentation and lineage.
- Advanced SQL skills with demonstrated performance tuning on large datasets, ideally in financial services.
- Practical experience implementing data-quality controls and reconciliation patterns.
- Experience with Git-based version control and CI/CD for data pipelines.
- Comfortable working in agile / scrum delivery teams and within enterprise architecture governance.
- Strong communication skills and the ability to explain technical designs to both technical and business stakeholders.
Highly Desirable
- Background in SAS and/or Teradata, particularly migrating legacy workloads to Snowflake.
- Python for data engineering, automation or testing.
- SnowPro Core certification; SnowPro Advanced (Data Engineer or Architect) highly regarded.
- dbt Analytics Engineering certification.
- Experience in banking, insurance or superannuation, including regulatory data obligations (e.g. APRA CPS 234, Privacy Act).
- Familiarity with orchestration tools (e.g. Airflow, Control-M) and cloud platforms (AWS or Azure).
📌 Snowflake Designer / Engineer (dbt) (North Sydney)
🏢 WattleCore Technologies Pty
📍 North Sydney