Job Description
Status:
n
AU valid visa with full work rights
n
Must have:
n
n
Programming knowledge and willingness to be hands-on - Python, Java
n
n
Key Responsibilities
n
n
In-depth knowledge and experience of GCP data and analytics technologies
n
Designing Large scale Transaction Data Platform architecture for (a) migrating open source or public cloud data platforms to GCP cloud native services (b) designing greenfield data platforms on GCP
n
Define solution architecture and detailed design, and perform hands-on implementation for data pipelines for batch and event driven ingestion and processing of data from a variety of sources such as on-prem files, on-prem databases, APIs, etc.
n




Real-time data ingestion and event-driven processing pipelines from Confluent Kafka and GCS to Spanner and BigQuery
n
Automatic transpilation of legacy code (HIVE, Teradata, python logic etc.) to BQ SQL
n
CI/CD pipelines for data workloads using Cloud Build, Artifact Registry, Terraform
n
Orchestration setup and Cloud Composer DAG development for data pipeline workflows
n
Data governance solutioning using GCP governance tooling (Dataplex, Data Catalog) Experience applying Generative AI technologies and integrations in enterprise environments.
n
Tools and languages experience Required
n

📌 Gcp Data Engineer (New South Wales)
🏢 FR Consultancy
📍 New South Wales