26 Sep
|
Avance Consulting
|
Melbourne
26 Sep
Avance Consulting
Melbourne
Role Overview
We are looking for an experienced
GCP Data Engineer with strong hands-on experience in
Google BigQuery, dbt, and Google Kubernetes Engine (GKE)
. The ideal candidate will be responsible for designing, developing, and maintaining scalable cloud data solutions on Google Cloud Platform.
Key Responsibilities
- Design and develop scalable data pipelines and data platforms using
Google Cloud Platform (GCP)
.
- Develop and optimize complex
BigQuery datasets, tables, views, and SQL queries.
- Build and maintain data transformation workflows using dbt
.
- Develop reusable dbt models, macros, tests, and documentation.
- Implement data quality, validation, and monitoring frameworks.
- Deploy and manage data applications and services using
Google Kubernetes Engine (GKE)
.
- Work with cloud-native services to build scalable and highly available data solutions.
- Optimize BigQuery performance and control query/storage costs.
- Develop and maintain ETL/ELT pipelines for batch and near-real-time data processing.
- Integrate data from multiple sources into GCP-based data platforms.
- Implement CI/CD pipelines for data engineering and cloud deployments.
- Work closely with Data Architects, Analysts, Developers, and business stakeholders.
- Follow security, governance, data quality, and compliance standards.
Mandatory Skills
- Strong hands-on experience with
Google Cloud Platform (GCP)
.
- Excellent experience with
Google BigQuery
.
- Strong experience with dbt (Data Build Tool)
.
- Hands-on experience with
Google Kubernetes Engine (GKE)
.
- Robust SQL development and query optimization skills.
- Experience developing
ETL/ELT data pipelines
.
- Experience with Python or another programming language.
- Understanding of cloud data warehouse and data lake concepts.
- Experience with Git and CI/CD practices.
Good to Have
- Google Cloud Dataflow
- Cloud Composer / Apache Airflow
- Pub/Sub
- Cloud Storage
- Dataproc
- Terraform
- Docker
- Kubernetes
- Looker
- Vertex AI
- GCP security and IAM
- Data governance and data quality frameworks
📌 GCP Data Engineer (Melbourne)
🏢 Avance Consulting
📍 Melbourne