Position- Senior Data Engineer

Exp- 7+yrs

Skill- GCP Dataflow, Cloud Spanner, BigQuery, Pub/Sub, Cloud Composer, Cloud Workflow

Job Type- Contract

Location- Sydney/Melbourne

Mandatory- PR/Citizen/NZ Citizen

JD-

Must have

- GCP Dataflow, Cloud Spanner, BigQuery, Pub/Sub, Cloud Composer, Cloud Workflows, Confluent Kafka, Cloud Run, Cloud Build, Terraform
- Must have: programming knowledge and willingness to be hands-on - Python, Java

Expertise Required In-depth knowledge and experience of GCP data and analytics technologies

- Designing Large scale Transaction Data Platform architecture for (a) migrating open source or public cloud data platforms to GCP cloud native services (b) designing greenfield data platforms on GCP
- Define solution architecture and detailed design, and perform hands-on implementation for –

data pipelines for batch and event driven ingestion and processing of data from a variety of sources such as on-prem files,



on-prem databases, APIs, etc. real-time data ingestion and event-driven processing pipelines from Confluent Kafka and GCS to Spanner and BigQuery
- Automatic transpilation of legacy code (HIVE, Teradata, python logic etc.) to BQ SQL
- BQ query performance optimisation
- CI/CD pipelines for data workloads using Cloud Build, Artifact Registry, Terraform
- Orchestration setup and Cloud Composer DAG development for data pipeline workflows
- Data governance solutioning using GCP governance tooling (Dataplex, Data Catalog)
- Experience applying Generative AI technologies and integrations in enterprise environments.

Interested candidates can share their updated resumes on [email protected] OR reach out to me on +61 2 90559939.

📌 Senior Data Engineer- GCP & Cloud (Melbourne)
🏢 CareCone Group
📍 Melbourne