03 Aug
|
Avance Consulting
|
New South Wales
03 Aug
Avance Consulting
New South Wales
We are seeking an experiencedPlatform Engineerto join ourNetworks Data & Analyticsteam.
The ideal candidate will be responsible for designing, building, and supporting a large-scale cloud-native data platform onGoogle Cloud Platform (GCP).
This role requires robust expertise in platform engineering, Infrastructure as Code (IaC), CI/CD automation, cloud security, and observability.
Key Responsibilities
Design, build, and maintain scalabledata lakehouse frameworksusingBigQueryandPython.
Develop and implementCI/CD pipelinesfrom scratch, including:
Webhook triggers
Branching strategies
Build reusable platform frameworks, shared libraries, metadata-driven ingestion frameworks, pipeline templates, and modular infrastructure components.
Manage cloud infrastructure usingTerraformand Infrastructure as Code (IaC) best practices.
Monitor platform health by implementing dashboards, alerts, and observability usingDynatraceor similar monitoring tools.
Ensure platform security by implementing and maintaining controls such asMFA, IAM/UAM, PIAM, Prisma, Nessus, encryption, and vulnerability management.
Support platform onboarding activities, including:
IAM and access provisioning
Security scanning setup
Firewall rule configuration
Network connectivity
SFTP key management
Required Skills & Experience
Strong hands-on experience withPythonand building data warehouse/lakehouse solutions usingGoogle Cloud Platform.
Expertise in designing and implementingCI/CD pipelinesfrom the ground up usingGitLab CI, Cloud Build, or similar tools.
Experience creating reusable platform frameworks, shared tooling, templates, and automation libraries.
Hands-on experience withTerraformfor cloud infrastructure provisioning and management.
Robust knowledge of GCP services including:
BigQuery
Cloud Composer (Airflow)
Pub/Sub
Cloud Functions
Experience with observability platforms such asDynatrace, including monitoring, alerting, dashboards, and pipeline health checks.
Experience supporting enterprise platforms with user onboarding, IAM, security compliance, and network connectivity.
Preferred Skills
Experience withGitLab CI/CD.
Knowledge of enterprise cloud security tools and governance practices.
Experience working in large-scale cloud-native data engineering or platform engineering settings.
J-*-Ljbffr
📌 Platform Engineer New South Wales
🏢 Avance Consulting
📍 New South Wales