02 Aug
|
Avance Consulting
|
New South Wales
02 Aug
Avance Consulting
New South Wales
We are seeking an experienced Platform Engineer to join our Networks Data & Analytics team.
The ideal candidate will be responsible for designing, building, and supporting a large-scale cloud-native data platform on Google Cloud Platform (GCP).
This role requires strong expertise in platform engineering, Infrastructure as Code (IaC), CI/CD automation, cloud security, and observability.
Key Responsibilities
Design, build, and maintain scalable data lakehouse frameworks using BigQuery and Python.
Develop and implement CI/CD pipelines from scratch, including:
Webhook triggers
Branching strategies
Build reusable platform frameworks, shared libraries, metadata-driven ingestion frameworks, pipeline templates, and modular infrastructure components.
Manage cloud infrastructure using Terraform and Infrastructure as Code (IaC) best practices.
Monitor platform health by implementing dashboards, alerts, and observability using Dynatrace or similar monitoring tools.
Ensure platform security by implementing and maintaining controls such as MFA, IAM/UAM, PIAM, Prisma, Nessus, encryption, and vulnerability management.
Support platform onboarding activities, including:
IAM and access provisioning
Security scanning setup
Firewall rule configuration
Network connectivity
SFTP key management
Required Skills & Experience
Robust hands-on experience with Python and building data warehouse/lakehouse solutions using Google Cloud Platform.
Expertise in designing and implementing CI/CD pipelines from the ground up using GitLab CI, Cloud Build, or similar tools.
Experience creating reusable platform frameworks, shared tooling, templates, and automation libraries.
Hands-on experience with Terraform for cloud infrastructure provisioning and management.
Strong knowledge of GCP services including:
BigQuery
Cloud Composer (Airflow)
Pub/Sub
Cloud Functions
Experience with observability platforms such as Dynatrace, including monitoring, alerting, dashboards, and pipeline health checks.
Experience supporting enterprise platforms with user onboarding, IAM, security compliance, and network connectivity.
Preferred Skills
Experience with GitLab CI/CD.
Knowledge of enterprise cloud security tools and governance practices.
Experience working in large-scale cloud-native data engineering or platform engineering environments.
#J-*****-Ljbffr
📌 Platform Engineer (New South Wales)
🏢 Avance Consulting
📍 New South Wales