Our global IT Services client seeking an experienced Platform Engineer to support, maintain and improve a large-scale enterprise data platform.This is a hands‐on engineering role working across Cloudera, Kafka, Databricks, Spark and cloud technologies.
You will be responsible for platform reliability, cluster maintenance, infrastructure automation, production troubleshooting and performance optimisation.Key responsibilitiesMaintain and administer Cloudera data platform environmentsSupport Kafka clusters, including monitoring, configuration, troubleshooting and maintenanceOperate and support Databricks and Azure Synapse environmentsMonitor platform availability, capacity, reliability and performanceDiagnose complex production issues across Spark and PySpark workloadsSupport Apache Iceberg and lakehouse-based architecturesAutomate infrastructure and platform configuration using Terraform and AnsibleDevelop operational scripts and tooling using Python and BashSupport containerised data workloads running on KubernetesTune Spark workloads and Hive, Impala and Trino queriesContribute to CI/CD pipelines, environment promotion and controlled releasesWork closely with data engineering, cloud, infrastructure and operations teamsOur global IT Services client seeking an experienced Platform Engineer to support, maintain and improve a large-scale enterprise data platform.This is a hands‐on engineering role working across Cloudera, Kafka, Databricks, Spark and cloud technologies.
You will be responsible for platform reliability, cluster maintenance, infrastructure automation, production troubleshooting and performance optimisation.Key responsibilitiesMaintain and administer Cloudera data platform environmentsSupport Kafka clusters,



including monitoring, configuration, troubleshooting and maintenanceOperate and support Databricks and Azure Synapse environmentsMonitor platform availability, capacity, reliability and performanceDiagnose complex production issues across Spark and PySpark workloadsSupport Apache Iceberg and lakehouse-based architecturesAutomate infrastructure and platform configuration using Terraform and AnsibleDevelop operational scripts and tooling using Python and BashSupport containerised data workloads running on KubernetesTune Spark workloads and Hive, Impala and Trino queriesContribute to CI/CD pipelines, environment promotion and controlled releasesWork closely with data engineering, cloud, infrastructure and operations teamsAbout youYou are an experienced platform engineer with strong troubleshooting skills and a practical understanding of how distributed data platforms operate in production.You will bring experience in:Cloudera platform maintenance or administrationKafka cluster support or maintenanceDatabricksApache Iceberg and lakehouse architectureAzure SynapseCloud environmentsTerraform and AnsiblePython and Bash scriptingPySpark and Spark troubleshootingKubernetesSQLHive, Impala or Trino performance tuningDesirable experienceThe following would be advantageous:Informatica Intelligent Data Management Cloud administrationAtaccama data quality, master data management or profilingJenkins, GitHub Actions or similar CI/CD toolingCloud-hosted PostgreSQL administrationThis prospect would suit someone who enjoys taking ownership of production platforms, resolving complex technical issues and improving reliability through monitoring, automation and performance tuning.
#J-*****-Ljbffr

📌 Platform Engineer - Cloudera, Kafka & Databricks (New South Wales)
🏢 Rubix Solutions
📍 New South Wales