Job Description
We are seeking a skilled GCP Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions on Google Cloud Platform (GCP). The ideal candidate should have strong experience in data engineering, ETL development, big data technologies, and cloud-native services within GCP.
n
Key Responsibilities
n
n
Design, build, and maintain scalable ETL/ELT data pipelines using GCP services.
n
Develop and manage data ingestion, transformation, and integration processes from multiple data sources.
n
Implement and optimize data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and Composer.
n
Build and maintain data warehouses, data lakes, and data marts on GCP.
n
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
n
Ensure data quality, governance, security, and compliance standards.
n
Monitor, troubleshoot, and optimize data pipeline performance and costs.
n
Automate deployment processes using CI/CD tools and Infrastructure as Code (Terraform preferred).
n
Support real-time and batch data processing requirements.
n
n
Required Skills & Qualifications
n
n




Bachelor's degree in Computer Science, Information Technology, or related field.
n
4+ years of experience in Data Engineering.
n
Robust experience with Google Cloud Platform (GCP) services:
n
BigQuery
n
Dataflow
n
Pub/Sub
n
Cloud Composer (Airflow)
n
Cloud Functions
n
Strong SQL and Python programming skills.
n
Experience building ETL/ELT pipelines.
n
Hands-on experience with Apache Spark, Hadoop, or similar big data technologies.
n
Knowledge of data modeling, data warehousing, and dimensional modeling.
n
Experience with version control systems such as Git.
n
Understanding of CI/CD and DevOps practices.
n
n
Preferred Qualifications
n
n
GCP Professional Data Engineer Certification.
n
Experience with Terraform and Infrastructure as Code (IaC).
n
Familiarity with Kafka, Airflow, or distributed data processing frameworks.
n
Experience working in Agile/Scrum environments.
n
Exposure to machine learning data pipelines is a plus.
n
n
Key Technologies
n
n
Cloud: GCP
n
Data Warehouse: BigQuery
n
Programming: Python, SQL
n
#J-*****-Ljbffr

📌 Gcp Data Engineer (New South Wales)
🏢 N2S.Global
📍 New South Wales