Vivanti Consulting in Australia is seeking a Databricks Specialist to design and implement Lakehouse architectures, turning large datasets into high-performance analytics and AI workloads. You will work with Delta Lake, Unity Catalog, and streaming/batch pipelines, collaborate with data scientists and ML engineers, and optimise cost and security across client clusters.
Ideal candidates bring solid PySpark, Python (and Scala), Spark SQL, cloud fluency (Azure, AWS or GCP), and hands-on delivery