24 Sep
|
Avance Consulting
|
Melbourne
24 Sep
Avance Consulting
Melbourne
We are looking for an experienced GCP Data Engineer with strong hands‑on experience in Google BigQuery, dbt, and Google Kubernetes Engine (GKE) . The ideal candidate will be responsible for designing, developing, and maintaining scalable cloud data solutions on Google Cloud Platform.
Key Responsibilities
- Design and develop scalable data pipelines and data platforms using Google Cloud Platform (GCP) .
- Develop and optimize complex BigQuery datasets, tables, views, and SQL queries.
- Build and maintain data transformation workflows using dbt .
- Develop reusable dbt models, macros, tests, and documentation.
- Implement data quality, validation, and monitoring frameworks.
- Deploy and manage data applications and services using Google Kubernetes Engine (GKE) .
- Work with cloud‑native services to build scalable and highly available data solutions.
- Optimize BigQuery performance and control query/storage costs.
- Develop and maintain ETL/ELT pipelines for batch and near‑real‑time data processing.
- Integrate data from multiple sources into GCP‑based data platforms.
- Implement CI/CD pipelines for data engineering and cloud deployments.
- Work closely with Data Architects, Analysts, Developers, and business stakeholders.
- Follow security, governance, data quality, and compliance standards.
Mandatory Skills
- Solid hands‑on experience with Google Cloud Platform (GCP) .
- Excellent experience with Google BigQuery .
- Strong experience with dbt (Data Build Tool) .
- Hands‑on experience with Google Kubernetes Engine (GKE) .
- Strong SQL development and query optimization skills.
- Experience with Python or another programming language.
- Understanding of cloud data warehouse and data lake concepts.
- Experience with Git and CI/CD practices.
Good to Have
- Cloud Composer / Apache Airflow
- Pub/Sub
- Terraform
- Docker
- Looker
- GCP security and IAM
- Data governance and data quality frameworks
#J-18808-Ljbffr
📌 GCP Data Engineer (Melbourne)
🏢 Avance Consulting
📍 Melbourne