Job Description

n

n
We’re seeking a hands-on experience in Databricks with deep technical expertise in building and optimizing Lakehouse-based data and AI solutions.
n
In this role, you’ll design, develop, and operationalize Delta Lakehouse architectures using Databricks, driving real-world outcomes for enterprise customers. You’ll take ownership of implementation tasks, lead technical delivery, and mentor engineering teams in best practices across data engineering, governance, and AI.
n

Key Responsibilitiesn n
Design and implement scalable data pipelines using Delta Live Tables (DLT), Spark SQL, Python, or Scala.
n
Optimize ETL, streaming, and ML workloads for performance, cost efficiency, and reliability.
n
Administer and configure Databricks Workspaces, Unity Catalog, and cluster policies for secure, governed environments.
n
Automate infrastructure and deployments using Terraform, Git, and CI/CD pipelines.
n
Implement observability, cost optimization,



and monitoring frameworks using tools like Splunk, Prometheus, or CloudWatch.
n
Collaborate with customers to build AI and LLM solutions leveraging MLflow, DBRX, and Mosaic AI.
n

Required Skills & Experiencen n
Solid 10+ hands-on experience with Databricks, including workspace setup, notebooks, clusters, and job orchestration.
n
Expertise in Delta Lake, DLT, Unity Catalog, and SQL Warehouses.
n
Solid 8+ Years of experience with Spark
n
Proficiency in Python or Scala for data engineering and ML workflows.
n
Robust understanding of AWS, Azure, or GCP cloud ecosystems.
n
Experience with Terraform automation, DevOps, and MLOps practices.
n
Familiarity with monitoring and governance frameworks for large-scale data platforms.
n

n
J-18808-Ljbffr

📌 Databricks Solution Architect New South Wales (Australia)
🏢 Unison Group
📍 Australia