29 Oct
|
Infosys APAC
|
Sydney
29 Oct
Infosys APAC
Sydney
Job Description
Description – Data Engineer_GCP /n
Key Responsibilities
/n
· Design, build, and optimise batch and streaming data pipelines using approved frameworks and tooling. /n
· Ensure pipelines are resilient, performant, and cost optimised. /n
· Implement monitoring, alerting, and automated recovery processes. /n
· Apply data quality checks and reconciliation processes to ensure accuracy and completeness. /n
· Maintain metadata, lineage, and documentation to support governance requirements. /n
· Adhere to role-based access control, data privacy, and security standards. /n
· Contribute to the development and maintenance of ingestion frameworks, transformation layers, and data models. /n
· Implement and maintain CI/CD pipelines for automated testing and deployment. /n
· Optimise data storage and retrieval strategies to meet performance needs. /n
· Work closely with Technical Leads, Data Architects, Analysts, and business stakeholders to deliver fit-for-purpose solutions. /n
· Participate in code reviews and knowledge-sharing sessions to improve team capability. /n
· Explore and adopt current tools, frameworks, and techniques to enhance engineering capability. /n
· Identify opportunities to automate and streamline workflows. /n /n Key Skills & Experience /n /n /n
· Proficient in SQL for data wrangling, transformation, and analysis /n
· Strong programming skills /n
· Experience building ETL/ELT pipelines in cloud or distributed environments /n
· Familiarity with cloud platforms and services /n
· Knowledge of data modeling concepts /n
· Experience with data orchestration tools /n
· Familiar with version control and CI/CD pipelines /n
· Understanding of data quality, validation, and observability practices /n
· Works independently with minimal supervision on well-scoped tasks /n
· Collaborates effectively with stakeholders /n
· Communicates clearly and documents work for others to maintain or build upon /n
· Open to code reviews, feedback, and continuous learning /n
· Able to troubleshoot and resolve data pipeline failures or performance issues /n
· 2–4 years in a data engineering or closely related role /n
· Has delivered production-ready pipelines end-to-end /n
· Demonstrated ability to improve code quality, reliability, or performance /n
📌 GCP Data Engineer (Sydney)
🏢 Infosys APAC
📍 Sydney