Our global IT Services client seeking an experienced Platform Engineer to support, maintain and improve a large-scale enterprise data platform.
This is a hands‐on engineering role working across Cloudera, Kafka, Databricks, Spark and cloud technologies.
You will be responsible for platform reliability, cluster maintenance, infrastructure automation, production troubleshooting and performance optimisation.
Key responsibilities
Maintain and administer Cloudera data platform environments
Support Kafka clusters, including monitoring, configuration, troubleshooting and maintenance
Operate and support Databricks and Azure Synapse environments
Monitor platform availability, capacity, reliability and performance
Diagnose complex production issues across Spark and PySpark workloads
Support Apache Iceberg and lakehouse-based architectures
Automate infrastructure and platform configuration using Terraform and Ansible
Develop operational scripts and tooling using Python and Bash
Support containerised data workloads running on Kubernetes
Tune Spark workloads and Hive, Impala and Trino queries
Contribute to CI/CD pipelines, environment promotion and controlled releases
Work closely with data engineering, cloud, infrastructure and operations teams
Our global IT Services client seeking an experienced Platform Engineer to support, maintain and improve a large-scale enterprise data platform.
This is a hands‐on engineering role working across Cloudera, Kafka, Databricks, Spark and cloud technologies.
You will be responsible for platform reliability, cluster maintenance, infrastructure automation, production troubleshooting and performance optimisation.
Key responsibilities
Maintain and administer Cloudera data platform environments
Support Kafka clusters,



including monitoring, configuration, troubleshooting and maintenance
Operate and support Databricks and Azure Synapse environments
Monitor platform availability, capacity, reliability and performance
Diagnose complex production issues across Spark and PySpark workloads
Support Apache Iceberg and lakehouse-based architectures
Automate infrastructure and platform configuration using Terraform and Ansible
Develop operational scripts and tooling using Python and Bash
Support containerised data workloads running on Kubernetes
Tune Spark workloads and Hive, Impala and Trino queries
Contribute to CI/CD pipelines, environment promotion and controlled releases
Work closely with data engineering, cloud, infrastructure and operations teams
About you
You are an experienced platform engineer with strong troubleshooting skills and a practical understanding of how distributed data platforms operate in production.
You will bring experience in:
Cloudera platform maintenance or administration
Kafka cluster support or maintenance
Databricks
Apache Iceberg and lakehouse architecture
Azure Synapse
Cloud environments
Terraform and Ansible
Python and Bash scripting
PySpark and Spark troubleshooting
Kubernetes
SQL
Hive, Impala or Trino performance tuning
Desirable experience
The following would be advantageous:
Informatica Intelligent Data Management Cloud administration
Ataccama data quality, master data management or profiling
Jenkins, GitHub Actions or similar CI/CD tooling
Cloud-hosted PostgreSQL administration
This chance would suit someone who enjoys taking ownership of production platforms, resolving complex technical issues and improving reliability through monitoring, automation and performance tuning.
#J-*****-Ljbffr

📌 Platform Engineer - Cloudera, Kafka & Databricks (New South Wales)
🏢 Rubix Solutions
📍 New South Wales