28 Aug
|
Ampstek
|
New South Wales
28 Aug
Ampstek
New South Wales
Job Description
Location: Sydney
n
Role Overview
n
We are looking for a highly experienced Senior Data Engineer with strong expertise in Google Cloud Platform
n
(GCP) to design, build, and optimize scalable data pipelines and architecture. The role will focus on enabling data-
n
driven decision-making by delivering high-quality, reliable, and effective data solutions across the organization.
n
Key Responsibilities
n
n
Design and implement scalable and robust data pipelines using GCP services
n
Build and maintain data lakes, data warehouses, and ETL/ELT workflows
n
Work with large-scale structured and unstructured datasets
n
Optimize data processing pipelines for performance, cost, and reliability
n
Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions
n
Develop and enforce data quality, governance, and security standards
n
Automate data workflows and orchestration using tools like Apache Airflow / Cloud Composer
n
Ensure high availability and fault tolerance of data platforms
n
Monitor and troubleshoot data pipelines and production issues
n
Mentor junior engineers and contribute to best practices
n
n
Must Have Skills & Experience
n
n
10+ years of experience in data engineering or related roles
n
Strong hands-on experience with Google Cloud Platform (GCP) services such as:
n
o BigQuery
n
o Dataflow
n
o Pub/Sub
n
Expertise in Python, SQL, and distributed data processing frameworks (e.g., Apache Beam, Spark)
n
Experience designing real-time and batch data pipelines
n
Strong understanding of data modeling, data warehousing, and ETL/ELT concepts
n
Experience with CI/CD pipelines and DevOps practices
n
Familiarity with data governance, data security, and compliance frameworks
n
Proven ability to work with large datasets in a cloud environment
n
Strong problem-solving and performance optimization skills
n
n
Nice to Have
n
n
Experience with multi-cloud environments (AWS/Azure)
n
Knowledge of containerization (Docker, Kubernetes)
n
Experience with streaming frameworks (Kafka, Pub/Sub streaming)
n
Exposure to Machine Learning pipelines (Vertex AI)
n
Certifications such as:
n
o Google Professional Data Engineer
n
Experience in domain-specific industries (telecom, finance, healthcare, etc.)
n
Familiarity with data cataloging and governance tools
n
Strong analytical and problem-solving skills
n
Excellent communication and stakeholder management
n
Ability to translate business requirements into technical solutions
n
Leadership and mentoring capabilities
n
Focus on scalability, reliability, and performance
n
📌 Senior Data Engineer-Gcp (New South Wales)
🏢 Ampstek
📍 New South Wales