04 Sep
|
Ampstek
|
New South Wales
04 Sep
Ampstek
New South Wales
Job Description
Job Description
n
Location: Sydney
n
Role Overview
n
We are looking for a highly experienced Senior Data Engineer with strong expertise in Google Cloud Platform
n
(GCP) to design, build, and optimize scalable data pipelines and architecture. The role will focus on enabling data-
n
driven decision-making by delivering high-quality, reliable, and efficient data solutions across the organization.
n
Key Responsibilities
n
n
- Design and implement scalable and robust data pipelines using GCP services
n
- Build and maintain data lakes, data warehouses, and ETL/ELT workflows
n
- Work with large-scale structured and unstructured datasets
n
- Optimize data processing pipelines for performance, cost, and reliability
n
- Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions
n
- Develop and enforce data quality, governance, and security standards
n
- Automate data workflows and orchestration using tools like Apache Airflow / Cloud Composer
n
- Ensure high availability and fault tolerance of data platforms
n
- Monitor and troubleshoot data pipelines and production issues
n
- Mentor junior engineers and contribute to best practices
n
n
Must Have Skills & Experience
n
n
- 10+ years of experience in data engineering or related roles
n
- Solid hands-on experience with Google Cloud Platform (GCP) services such as:
n
- o BigQuery
n
- o Dataflow
n
- o Pub/Sub
n
- Expertise in Python, SQL, and distributed data processing frameworks (e.g., Apache Beam, Spark)
n
- Experience designing real-time and batch data pipelines
n
- Strong understanding of data modeling, data warehousing, and ETL/ELT concepts
n
- Experience with CI/CD pipelines and DevOps practices
n
- Familiarity with data governance, data security, and compliance frameworks
n
- Proven ability to work with large datasets in a cloud environment
n
- Strong problem-solving and performance optimization skills
n
n
Nice to Have
n
n
- Experience with multi-cloud environments (AWS/Azure)
n
- Knowledge of containerization (Docker, Kubernetes)
n
- Experience with streaming frameworks (Kafka, Pub/Sub streaming)
n
- Exposure to Machine Learning pipelines (Vertex AI)
n
- Certifications such as:
n
- o Google Professional Data Engineer
n
- Experience in domain-specific industries (telecom, finance, healthcare, etc.)
n
- Familiarity with data cataloging and governance tools
n
- Strong analytical and problem-solving skills
n
- Excellent communication and stakeholder management
n
- Ability to translate business requirements into technical solutions
n
- Leadership and mentoring capabilities
n
- Focus on scalability, reliability, and performance
n
📌 Senior Data Engineer-Gcp (New South Wales)
🏢 Ampstek
📍 New South Wales