- Hands on experience in Batch (must) and Streaming (preferable) processing on Cloudera data platform tool-stack:
- Must have: Hadoop, Spark, HIVE, Oozie and Python/Pyspark as the programming language
- Preferable: Scala, Hbase, Java, Shell scripting
- Min 3 years of hands-on project experience on Big Data platform – preferable Cloudera/Hortonworks
- Min 2 years of Cloud experience – preferable on Azure
- Min 2 end to end data lake project delivery experience
- A very clear understanding of data warehousing processes, methodologies and supporting capabilities
- Be able to propose solutions and clearly articulate pros and cons of various technologies and platforms in the Big Data world
- To be able to benchmark systems, analyse system bottlenecks.
- To be able to document use cases, solutions,



and recommendations.
- To have excellent written and verbal communication skills
- To be able to perform detailed analysis of business problems and technical environments and use this in designing the solution
- To be able to work in teams, as a big data environment is developed in a team of employees with different disciplines
- To be able to work in a fast-paced agile development environment.

Job Types: Full time, Permanent Pay: $91,383.00 – $164,767.00 per year

Work Authorisation

- Australia (Required)

Work Location: Hybrid remote in North Sydney NSW 2060

📌 Data Engineer (North Sydney)
🏢 Centelon
📍 North Sydney