Job Description

Description – Data Engineer_GCP

n

Key Responsibilities

n

· Design, build, and optimise batch and streaming data pipelines using approved frameworks and tooling.

n

· Ensure pipelines are resilient, performant, and cost optimised.

n

· Implement monitoring, alerting, and automated recovery processes.

n

· Apply data quality checks and reconciliation processes to ensure accuracy and completeness.

n

· Maintain metadata, lineage, and documentation to support governance requirements.

n

· Adhere to role-based access control, data privacy, and security standards.

n

· Contribute to the development and maintenance of ingestion frameworks, transformation layers, and data models.

n

· Implement and maintain CI/CD pipelines for automated testing and deployment.

n

· Optimise data storage and retrieval strategies to meet performance needs.

n

· Work closely with Technical Leads, Data Architects, Analysts, and business stakeholders to deliver fit-for-purpose solutions.

n

· Participate in code reviews and knowledge-sharing sessions to improve team capability.

n

· Explore and adopt recent tools, frameworks, and techniques to enhance engineering capability.

n





· Identify opportunities to automate and streamline workflows.

n

n

Key Skills & Experience

n

n

n

· Proficient in SQL for data wrangling, transformation, and analysis

n

· Strong programming skills

n

· Experience building ETL/ELT pipelines in cloud or distributed environments

n

· Familiarity with cloud platforms and services

n

· Knowledge of data modeling concepts

n

· Experience with data orchestration tools

n

· Familiar with version control and CI/CD pipelines

n

· Understanding of data quality, validation, and observability practices

n

· Works independently with minimal supervision on well-scoped tasks

n

· Collaborates effectively with stakeholders

n

· Communicates clearly and documents work for others to maintain or build upon

n

· Open to code reviews, feedback, and continuous learning

n

· Able to troubleshoot and resolve data pipeline failures or performance issues

n

· 2–4 years in a data engineering or closely related role

n

· Has delivered production-ready pipelines end-to-end

n

· Demonstrated ability to improve code quality, reliability, or performance

n

📌 GCP Data Engineer (Sydney)
🏢 Infosys APAC
📍 Sydney