Key Responsibilities

- Design, develop, and maintain scalable data pipelines using GCP services.
- Build and optimise ETL/ELT workflows for batch and real-time data processing.
- Work with Google BigQuery for data warehousing, SQL development, and query optimisation.
- Develop data processing solutions using Python, PySpark, and Apache Beam.
- Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub.
- Build and manage data lakes and data warehouses on Google Cloud.
- Implement data quality checks, data validation, and monitoring.
- Optimise pipeline performance, scalability, and cost efficiency.
- Collaborate with data analysts, data scientists, architects, and business teams.
- Ensure data security, governance, and compliance best practices.

Mandatory Technical Skills

1. Robust experience in Google Cloud Platform (GCP).
2. Hands-on experience with BigQuery.
3. Strong programming skills in Python and SQL.
4. Experience developing ETL/ELT data pipelines.
5. Experience with Cloud Dataflow and/or Apache Beam.
6. Knowledge of Cloud Storage (GCS).
7. Experience with data modelling and data warehousing.
8. Experience with batch and real-time data processing.

📌 Data Engineer with GCP (Sydney)
🏢 Xpt Software Australia
📍 Sydney