25 Sep
|
Viable Solutions
|
New South Wales
25 Sep
Viable Solutions
New South Wales
Job Description
n
n
Building and maintaining dbt transformation models across multiple pipeline layers — from raw ingestion through to governed, consumer-ready datasets
n
Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation
n
Developing and debugging Apache Airflow DAGs on AWS ECS
n
Contributing to AWS Lambda-based ingestion( Python) — file validation, control file generation, S3 event handling
n
Maintaining source-to-target mapping documentation and aligning models to business requirements and data specs
n
Supporting onboarding of downstream consumers via data sharing mechanisms and event-driven notifications
n
Participating in code reviews, writing YAML-based data quality tests, and owning tickets from design through to production
n
Proficiency with dbt Core
n
Apache Iceberg Table format (Nice to have)
n
AWS - Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge
n
Experience with fixed-format or structured financial data files
n
n
#J-*****-Ljbffr
📌 Data Engineer (New South Wales)
🏢 Viable Solutions
📍 New South Wales