28 Aug
|
Ampstek
|
New South Wales
28 Aug
Ampstek
New South Wales
Location: SydneyRole OverviewWe are looking for a highly experienced Senior Data Engineer with strong expertise in Google Cloud Platform(GCP) to design, build, and optimize scalable data pipelines and architecture.
The role will focus on enabling data-driven decision-making by delivering high-quality, reliable, and efficient data solutions across the organization.Key ResponsibilitiesDesign and implement scalable and robust data pipelines using GCP servicesBuild and maintain data lakes, data warehouses, and ETL/ELT workflowsWork with large-scale structured and unstructured datasetsOptimize data processing pipelines for performance, cost, and reliabilityCollaborate with data scientists, analysts, and business stakeholders to deliver data solutionsDevelop and enforce data quality, governance, and security standardsAutomate data workflows and orchestration using tools like Apache Airflow / Cloud ComposerEnsure high availability and fault tolerance of data platformsMonitor and troubleshoot data pipelines and production issuesMentor junior engineers and contribute to best practicesMust Have Skills & Experience10+ years of experience in data engineering or related rolesStrong hands-on experience with Google Cloud Platform (GCP)
services such as:o BigQueryo Dataflowo Pub/SubExpertise in Python, SQL, and distributed data processing frameworks (e.g., Apache Beam, Spark)Experience designing real-time and batch data pipelinesStrong understanding of data modeling, data warehousing, and ETL/ELT conceptsExperience with CI/CD pipelines and DevOps practicesFamiliarity with data governance, data security, and compliance frameworksProven ability to work with large datasets in a cloud environmentStrong problem-solving and performance optimization skillsNice to HaveExperience with multi-cloud environments (AWS/Azure)Knowledge of containerization (Docker, Kubernetes)Experience with streaming frameworks (Kafka, Pub/Sub streaming)Exposure to Machine Learning pipelines (Vertex AI)Certifications such as:o Google Skilled Data EngineerExperience in domain-specific industries (telecom, finance, healthcare, etc.)Familiarity with data cataloging and governance toolsStrong analytical and problem-solving skillsExcellent communication and stakeholder managementAbility to translate business requirements into technical solutionsLeadership and mentoring capabilitiesFocus on scalability, reliability, and performance
#J-*****-Ljbffr
📌 Senior Data Engineer-Gcp (New South Wales)
🏢 Ampstek
📍 New South Wales