Our global IT Services client seeking an experienced Platform Engineer to support, maintain and improve a large-scale enterprise data platform.
This is a hands‑on engineering role working across Cloudera, Kafka, Databricks, Spark and cloud technologies. You will be responsible for platform reliability, cluster maintenance, infrastructure automation, production troubleshooting and performance optimisation.

Key responsibilities

- Maintain and administer Cloudera data platform environments
- Support Kafka clusters, including monitoring, configuration, troubleshooting and maintenance
- Operate and support Databricks and Azure Synapse environments
- Monitor platform availability, capacity, reliability and performance
- Diagnose complex production issues across Spark and PySpark workloads
- Support Apache Iceberg and lakehouse-based architectures
- Automate infrastructure and platform configuration using Terraform and Ansible
- Develop operational scripts and tooling using Python and Bash
- Support containerised data workloads running on Kubernetes
- Tune Spark workloads and Hive, Impala and Trino queries
- Contribute to CI/CD pipelines, setting promotion and controlled releases
- Work closely with data engineering, cloud, infrastructure and operations teams

Our global IT Services client seeking an experienced Platform Engineer to support, maintain and improve a large-scale enterprise data platform.
This is a hands‑on engineering role working across Cloudera, Kafka, Databricks, Spark and cloud technologies. You will be responsible for platform reliability, cluster maintenance, infrastructure automation, production troubleshooting and performance optimisation.

Key responsibilities

- Maintain and administer Cloudera data platform environments
- Support Kafka clusters,



including monitoring, configuration, troubleshooting and maintenance
- Operate and support Databricks and Azure Synapse environments
- Monitor platform availability, capacity, reliability and performance
- Diagnose complex production issues across Spark and PySpark workloads
- Support Apache Iceberg and lakehouse-based architectures
- Automate infrastructure and platform configuration using Terraform and Ansible
- Develop operational scripts and tooling using Python and Bash
- Support containerised data workloads running on Kubernetes
- Tune Spark workloads and Hive, Impala and Trino queries
- Contribute to CI/CD pipelines, environment promotion and controlled releases
- Work closely with data engineering, cloud, infrastructure and operations teams

About you

You are an experienced platform engineer with strong troubleshooting skills and a practical understanding of how distributed data platforms operate in production.

You will bring experience in:

- Cloudera platform maintenance or administration
- Kafka cluster support or maintenance
- Databricks
- Apache Iceberg and lakehouse architecture
- Azure Synapse
- Cloud environments
- Terraform and Ansible
- Python and Bash scripting
- PySpark and Spark troubleshooting
- Kubernetes
- SQL
- Hive, Impala or Trino performance tuning

Desirable experience

The following would be advantageous:

- Informatica Intelligent Data Management Cloud administration
- Ataccama data quality, master data management or profiling
- Jenkins, GitHub Actions or similar CI/CD tooling
- Cloud-hosted PostgreSQL administration

This opportunity would suit someone who enjoys taking ownership of production platforms, resolving complex technical issues and improving reliability through monitoring, automation and performance tuning.

#J-18808-Ljbffr

📌 Platform Engineer - Cloudera, Kafka & Databricks (City of Sydney)
🏢 Rubix Solutions
📍 City of Sydney