12 Oct
|
Xpt Software Australia
|
Australia
12 Oct
Xpt Software Australia
Australia
Must Have Skills: GCP big query , Kubernetes/GKE with SQL Knowledge Nice to Have Skills: GCP Certified Detailed Job Description: Good communication skills with knowledge on SQL, GCP big query , Kubernetes/GKE •Robust understanding of SDLC process.
•Should have Robust understanding and trouble shooting skills Core requirements: Must have solid experience in building, enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near‐real‐time processing.
Must be able to design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
Must have hands-on experience with GCP data services such as BigQuery, Kubernetes/GKE , Cloud Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
Must demonstrate proficiency in ETL/ELT development , SQL-based transformations, and distributed data processing.
Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.
📌 Technology Lead Melbourne (Australia)
🏢 Xpt Software Australia
📍 Australia