27 Sep
|
Avance Consulting
|
Melbourne
27 Sep
Avance Consulting
Melbourne
Role Overview
We are looking for an experienced
GCP Data Engineer with strong hands-on experience in
Google BigQuery, dbt, and Google Kubernetes Engine (GKE)
. The ideal candidate will be responsible for designing, developing, and maintaining scalable cloud data solutions on Google Cloud Platform.
Key Responsibilities
Design and develop scalable data pipelines and data platforms using
Google Cloud Platform (GCP)
.
Develop and optimize complex
BigQuery datasets, tables, views, and SQL queries.
Build and maintain data transformation workflows using dbt
.
Develop reusable dbt models, macros, tests, and documentation.
Implement data quality, validation, and monitoring frameworks.
Deploy and manage data applications and services using
Google Kubernetes Engine (GKE)
.
Work with cloud-native services to build scalable and highly available data solutions.
Optimize BigQuery performance and control query/storage costs.
Develop and maintain ETL/ELT pipelines for batch and near-real-time data processing.
Integrate data from multiple sources into GCP-based data platforms.
Implement CI/CD pipelines for data engineering and cloud deployments.
Work closely with Data Architects, Analysts, Developers, and business stakeholders.
Follow security, governance, data quality, and compliance standards.
Mandatory Skills
Strong hands-on experience with
Google Cloud Platform (GCP)
.
Excellent experience with
Google BigQuery
.
Robust experience with dbt (Data Build Tool)
.
Hands-on experience with
Google Kubernetes Engine (GKE)
.
Robust SQL development and query optimization skills.
Experience developing
ETL/ELT data pipelines
.
Experience with Python or another programming language.
Understanding of cloud data warehouse and data lake concepts.
Experience with Git and CI/CD practices.
Positive to Have
Google Cloud Dataflow
Cloud Composer / Apache Airflow
Pub/Sub
Cloud Storage
Dataproc
Terraform
Docker
Kubernetes
Looker
Vertex AI
GCP security and IAM
Data governance and data quality frameworks
📌 Gcp Data Engineer Melbourne
🏢 Avance Consulting
📍 Melbourne