10 Nov
|
Infosys APAC
|
New South Wales
10 Nov
Infosys APAC
New South Wales
We are looking for an experienced
GCP Data Engineer
with robust hands-on expertise in designing, developing, and supporting scalable data solutions on
Google Cloud Platform (GCP)
.
Key Responsibilities
Design and develop scalable
ETL/ELT data pipelines
on GCP.
Build batch and streaming data solutions using
BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Dataproc
.
Develop data transformation and processing solutions using
Python, SQL, and Apache Spark
.
Design and optimize
BigQuery
datasets, tables, partitioning, clustering, and complex SQL queries.
Build ingestion frameworks to integrate data from databases, APIs, files, SaaS platforms, and event streams.
Implement workflow orchestration using
Cloud Composer / Apache Airflow
.
Develop robust
data quality, reconciliation, logging, monitoring, and exception-handling frameworks
.
Implement incremental data processing, CDC, and high-volume data ingestion patterns.
Work with CI/CD pipelines and infrastructure automation for deploying GCP data solutions.
Implement appropriate
IAM, security, encryption, and data governance controls
.
Troubleshoot performance and production issues across data pipelines.
Collaborate with data architects, analysts, business stakeholders, and downstream reporting teams.
📌 Gcp Data Engineer (New South Wales)
🏢 Infosys APAC
📍 New South Wales