GCP DATA ENGINEER (Sydney)

GCP DATA ENGINEER (Sydney)

23 Aug
|
ALOIS UK
|
Sydney

23 Aug

ALOIS UK

Sydney

Role Description & Requirements Role and Responsibilities

- Key cloud engineer for customer engagements
- Collaborate with lead Data Consultant on customer engagements
- Define solution architecture and detailed design for data platforms on GCP
- Build solutions, i.e., perform hands on coding for the designed solution
- Interact with customer data engineering team to provide sound advice and guidance on solution architecture as well as hands on coding solutions
- Perform pair programming with customer’s data engineers and handover the developed solution to customer engineers.

Minimum Qualifications

- Solution Architecture Knowledge and Expertise Required

○ Designing data platform architecture and design for
- migrating open source or other public cloud based data platforms to Cloud (pref. GCP)
- Designing green field data platforms on cloud

○ Ability to perform research on tools and technology, identify significant considerations for technology selection in the architecture, provide recommendations on tool selection ○ Define solution architecture and detailed design for
- batch ingestion and processing of data from sources such as files, cloud and on-prem databases,
- streaming solutions for real time data ingestion and processing (such as log analytics, click-stream analytics, real time data ingestion from other types of sources)





○ Build data pipelines and CI/CD pipelines ○ In-depth knowledge of at least one public cloud, preferably GCP
- Tools experience Required

○ GCP (GCP preferred, or equivalent in other public clouds acceptable) ○ GCP Dataflow, Pub/Sub, Cloud Composer, BigQuery, Cloud Run, Cloud

○ Functions,Spanner, CloudBuild, Vertex AI, Terraform

- Coding expertise

○ Programming knowledge and willingness to be hands-on as part of day to day work ○ Knowledge of at least one (preferably both): Python, Java Preferred Qualifications
- Solution Architecture Knowledge and Expertise Required

○ Experience with open source ecosystem and distributions such as Hadoop, Spark, Cloudera/Hortonworks ○ Understanding and experience with NoSQL databases such as HBASE, MongoDB
- Tools experience Required

○ Other public clouds ○ Open source ecosystem and frameworks (Hadoop, SPARK, Oozie, Kafka, HBASE) Certification
- At least one of below:

○ GCP Data engineering (preferred) ○ AWS Customer Experience

- Experience in large enterprise environments, navigating architectural review and approval frameworks, lobbying design submissions, engaging cross-functional stakeholders (Preferably one of the Big Four AU Banks)

📌 GCP DATA ENGINEER (Sydney)
🏢 ALOIS UK
📍 Sydney

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: gcp data engineer (sydney) / sydney

Subscribe to this job alert:

Get the latest job offers by email for: gcp data engineer (sydney) / sydney