Role: Lead Data Engineer- GCP

Type: Full time – Perm or Contract

Location: Sydney/Melbourne

Status: AU valid visa with full work rights

Must have:

- GCP Dataflow, Cloud Spanner, BigQuery, Pub/Sub, Cloud Composer, Cloud Workflows, Confluent Kafka, Cloud Run, Cloud Build, Terraform
- Programming knowledge and willingness to be hands-on - Python, Java

Key Responsibilities

- In-depth knowledge and experience of GCP data and analytics technologies
- Designing Large scale Transaction Data Platform architecture for (a) migrating open source or public cloud data platforms to GCP cloud native services (b) designing greenfield data platforms on GCP
- Define solution architecture and detailed design, and perform hands-on implementation for data pipelines for batch and event driven ingestion and processing of data from a variety of sources such as on-prem files, on-prem databases, APIs, etc.




- Real-time data ingestion and event-driven processing pipelines from Confluent Kafka and GCS to Spanner and BigQuery
- Automatic transpilation of legacy code (HIVE, Teradata, python logic etc.) to BQ SQL
- BQ query performance optimisation
- CI/CD pipelines for data workloads using Cloud Build, Artifact Registry, Terraform
- Orchestration setup and Cloud Composer DAG development for data pipeline workflows
- Data governance solutioning using GCP governance tooling (Dataplex, Data Catalog) ○ Experience applying Generative AI technologies and integrations in enterprise environments.
- Tools and languages experience Required

Interested? Please apply, thanks for your interest and time.

📌 GCP Data Engineer (Sydney)
🏢 FR Consultancy
📍 Sydney