Job Summary

We are seeking a skilled GCP Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions on Google Cloud Platform (GCP). The ideal candidate should have strong experience in data engineering, ETL development, big data technologies, and cloud-native services within GCP.

Key Responsibilities

- Design, build, and maintain scalable ETL/ELT data pipelines using GCP services.
- Develop and manage data ingestion, transformation, and integration processes from multiple data sources.
- Implement and optimize data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and Composer.
- Build and maintain data warehouses, data lakes, and data marts on GCP.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
- Ensure data quality, governance, security, and compliance standards.
- Monitor, troubleshoot, and optimize data pipeline performance and costs.
- Automate deployment processes using CI/CD tools and Infrastructure as Code (Terraform preferred).
- Support real-time and batch data processing requirements.

Required Skills & Qualifications
- Bachelor's degree in Computer Science, Information Technology, or related field.




- 4 years of experience in Data Engineering.
- Robust experience with Google Cloud Platform (GCP) services:
- BigQuery
- Dataflow
- Dataproc
- Pub/Sub
- Cloud Composer (Airflow)
- Cloud Storage
- Cloud Functions
- Strong SQL and Python programming skills.
- Experience building ETL/ELT pipelines.
- Hands-on experience with Apache Spark, Hadoop, or similar big data technologies.
- Knowledge of data modeling, data warehousing, and dimensional modeling.
- Experience with version control systems such as Git.
- Understanding of CI/CD and DevOps practices.

Preferred Qualifications
- GCP Professional Data Engineer Certification.
- Experience with Terraform and Infrastructure as Code (IaC).
- Familiarity with Kafka, Airflow, or distributed data processing frameworks.
- Experience working in Agile/Scrum environments.
- Exposure to machine learning data pipelines is a plus.

Key Technologies
- Cloud: GCP
- Data Warehouse: BigQuery
- Programming: Python, SQL
- Data Processing: Dataflow, Dataproc, Spark
- Orchestration: Cloud Composer (Airflow)
- Streaming: Pub/Sub, Kafka
- Storage: Cloud Storage
- DevOps: Git, CI/CD, Terraform

📌 GCP Data Engineer (Sydney)
🏢 N2S.Global
📍 Sydney