25 Sep
|
Avance Consulting
|
Victoria
25 Sep
Avance Consulting
Victoria
Job Description
n
We are looking for an experienced
GCP Data Engineer
with strong hands‐on experience in
Google BigQuery, dbt, and Google Kubernetes Engine (GKE)
. The ideal candidate will be responsible for designing, developing, and maintaining scalable cloud data solutions on Google Cloud Platform.
n
Key Responsibilities
n
n
Design and develop scalable data pipelines and data platforms using
Google Cloud Platform (GCP)
.
n
Develop and optimize complex
BigQuery
datasets, tables, views, and SQL queries.
n
Build and maintain data transformation workflows using
dbt
.
n
Develop reusable dbt models, macros, tests, and documentation.
n
Implement data quality, validation, and monitoring frameworks.
n
Deploy and manage data applications and services using
Google Kubernetes Engine (GKE)
.
n
Work with cloud‐native services to build scalable and highly available data solutions.
n
Optimize BigQuery performance and control query/storage costs.
n
Develop and maintain ETL/ELT pipelines for batch and near‐real‐time data processing.
n
Integrate data from multiple sources into GCP‐based data platforms.
n
Implement CI/CD pipelines for data engineering and cloud deployments.
n
Work closely with Data Architects, Analysts, Developers, and business stakeholders.
n
Follow security, governance, data quality, and compliance standards.
n
n
Mandatory Skills
n
n
Strong hands‐on experience with
Google Cloud Platform (GCP)
.
n
Excellent experience with
Google BigQuery
.
n
Strong experience with
dbt (Data Build Tool)
.
n
Hands‐on experience with
Google Kubernetes Engine (GKE)
.
n
Solid SQL development and query optimization skills.
n
Experience with Python or another programming language.
n
Understanding of cloud data warehouse and data lake concepts.
n
Experience with Git and CI/CD practices.
n
n
Good to Have
n
n
Cloud Composer / Apache Airflow
n
Pub/Sub
n
Terraform
n
Docker
n
Looker
n
GCP security and IAM
n
Data governance and data quality frameworks
n
n
#J-*****-Ljbffr
📌 Gcp Data Engineer (Victoria)
🏢 Avance Consulting
📍 Victoria