04 Sep
|
XPT Software Australia Pty
|
Melbourne
04 Sep
XPT Software Australia Pty
Melbourne
Must Have Skills: GCP development Skills with Strong SQL knowledge
Nice to Have Skills:
GCP Certified
Kafka
Detailed Job Description:
Valuable communication skills with knowledge on SQL, GCP and Kafka
•Strong understanding of SDLC process.
•Should have Strong understanding and trouble shooting skills
Core requirements:
- Must have strong experience in building, enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near‑real‑time processing.
- Must be able to design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
- Must have hands-on experience with GCP data services such as BigQuery, Cloud Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
- Must demonstrate proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.
- Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.
Minimum Years of Experience: 6-8 yrs
📌 Technology Lead (Melbourne)
🏢 XPT Software Australia Pty
📍 Melbourne