02 Aug
|
Avance Consulting
|
City of Sydney
02 Aug
Avance Consulting
City of Sydney
We are seeking an experienced Platform Engineer to join our Networks Data & Analytics team. The ideal candidate will be responsible for designing, building, and supporting a large-scale cloud-native data platform on Google Cloud Platform (GCP). This role requires strong expertise in platform engineering, Infrastructure as Code (IaC), CI/CD automation, cloud security, and observability.
Key Responsibilities
- Design, build, and maintain scalable data lakehouse frameworks using BigQuery and Python.
- Develop and implement CI/CD pipelines from scratch, including:
- Webhook triggers
- Branching strategies
- Build reusable platform frameworks, shared libraries, metadata-driven ingestion frameworks, pipeline templates, and modular infrastructure components.
- Manage cloud infrastructure using Terraform and Infrastructure as Code (IaC) best practices.
- Monitor platform health by implementing dashboards, alerts, and observability using Dynatrace or similar monitoring tools.
- Ensure platform security by implementing and maintaining controls such as MFA, IAM/UAM, PIAM, Prisma, Nessus, encryption, and vulnerability management.
- Support platform onboarding activities, including:
- IAM and access provisioning
- Security scanning setup
- Firewall rule configuration
- Network connectivity
- SFTP key management
Required Skills & Experience
- Robust hands-on experience with Python and building data warehouse/lakehouse solutions using Google Cloud Platform.
- Expertise in designing and implementing CI/CD pipelines from the ground up using GitLab CI, Cloud Build, or similar tools.
- Experience creating reusable platform frameworks, shared tooling, templates, and automation libraries.
- Hands-on experience with Terraform for cloud infrastructure provisioning and management.
- Strong knowledge of GCP services including:
- BigQuery
- Cloud Composer (Airflow)
- Pub/Sub
- Cloud Functions
- Experience with observability platforms such as Dynatrace, including monitoring, alerting, dashboards, and pipeline health checks.
- Experience supporting enterprise platforms with user onboarding, IAM, security compliance, and network connectivity.
Preferred Skills
- Experience with GitLab CI/CD.
- Knowledge of enterprise cloud security tools and governance practices.
- Experience working in large-scale cloud-native data engineering or platform engineering environments.
#J-18808-Ljbffr
📌 Platform Engineer (City of Sydney)
🏢 Avance Consulting
📍 City of Sydney