25 Sep
|
Avance Consulting
|
Melbourne
25 Sep
Avance Consulting
Melbourne
We are looking for an experiencedGCP Data Engineerwith solid hands‐on experience inGoogle BigQuery, dbt, and Google Kubernetes Engine (GKE).
The ideal candidate will be responsible for designing, developing, and maintaining scalable cloud data solutions on Google Cloud Platform.
Key Responsibilities
Design and develop scalable data pipelines and data platforms usingGoogle Cloud Platform (GCP).
Develop and optimize complexBigQuerydatasets, tables, views, and SQL queries.
Build and maintain data transformation workflows usingdbt.
Develop reusable dbt models, macros, tests, and documentation.
Implement data quality, validation, and monitoring frameworks.
Deploy and manage data applications and services usingGoogle Kubernetes Engine (GKE).
Work with cloud‐native services to build scalable and highly available data solutions.
Optimize BigQuery performance and control query/storage costs.
Develop and maintain ETL/ELT pipelines for batch and near‐real‐time data processing.
Integrate data from multiple sources into GCP‐based data platforms.
Implement CI/CD pipelines for data engineering and cloud deployments.
Work closely with Data Architects, Analysts, Developers, and business stakeholders.
Follow security, governance, data quality, and compliance standards.
Mandatory Skills
Solid hands‐on experience withGoogle Cloud Platform (GCP).
Excellent experience withGoogle BigQuery.
Strong experience withdbt (Data Build Tool).
Hands‐on experience withGoogle Kubernetes Engine (GKE).
Robust SQL development and query optimization skills.
Experience with Python or another programming language.
Understanding of cloud data warehouse and data lake concepts.
Experience with Git and CI/CD practices.
Good to Have
Cloud Composer / Apache Airflow
Pub/Sub
Terraform
Docker
Looker
GCP security and IAM
Data governance and data quality frameworks
J-*-Ljbffr
📌 Gcp Data Engineer Melbourne
🏢 Avance Consulting
📍 Melbourne