11 Oct
|
Xpt Software Australia
|
Melbourne
11 Oct
Xpt Software Australia
Melbourne
Must Have Skills: GCP big query , Kubernetes/GKE with SQL Knowledge Nice to Have Skills: GCP Certified Detailed Job Description: Good communication skills with knowledge on SQL, GCP big query , Kubernetes/GKE •Strong understanding of SDLC process.
•Should have Strong understanding and trouble shooting skills Core requirements: Must have solid experience in building, enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near‐real‐time processing.
Must be able to design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
Must have hands-on experience with GCP data services such as BigQuery, Kubernetes/GKE , Cloud Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
Must demonstrate proficiency in ETL/ELT development , SQL-based transformations, and distributed data processing.
Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.
📌 Technology Lead (Melbourne)
🏢 Xpt Software Australia
📍 Melbourne