18 Sep
|
Kaliba
|
New South Wales
18 Sep
Kaliba
New South Wales
Job Description
Senior Databricks Solution Architect | Sydney n
We're partnering with a specialist technology consultancy that is expanding its Databricks capability across Australia and the wider APAC region.
n
This is an opportunity to design and deliver enterprise-scale Databricks Lakehouse platforms, lead complex implementations and provide technical direction across major data‐modernisation initiatives.
n
We're looking for an experienced architect who combines strong solution-design capability with genuine hands‐on expertise across Databricks, Spark and modern cloud data platforms.
What you'll be doing n
n
Designing enterprise Databricks Lakehouse solutions
n
Defining workspace architecture, cluster strategy, security models and operational standards
n
Designing Delta Lake and Medallion architectures across Bronze, Silver and Gold layers
n
Architecting scalable data pipelines using Databricks, Apache Spark, PySpark and SQL
n
Leading Databricks implementations, migrations and production deployments
n
Improving platform performance, reliability and cost efficiency
n
Establishing data-quality frameworks and schema-evolution strategies
n
Implementing governance through Unity Catalog, access controls, lineage and auditing
n
Producing architecture documentation and leading technical design discussions
n
Working with engineering teams and enterprise stakeholders throughout delivery
n
What we're looking for n
n
Strong hands‐on Databricks architecture experience
n
Proven delivery of enterprise‐scale Databricks solutions
n
Deep knowledge of Apache Spark, PySpark, SQL and Delta Lake
n
Solid understanding of Lakehouse and Medallion architecture
n
Experience with enterprise ETL/ELT, data modelling and data engineering
n
Azure, AWS or Google Cloud data‐platform experience
n
Knowledge of Databricks Workflows, Jobs, Notebooks, Repos and cluster management
n
Experience implementing CI/CD practices for modern data platformsStrong troubleshooting, performance‐tuning and cost‐optimisation skills
n
Excellent solution‐design, documentation and stakeholder‐management capability
n
Highly regarded n
n
Unity Catalog and enterprise data‐governance experience
n
MLflow or MLOps experience
n
Experience supporting AI and machine‐learning workloads
n
Data‐platform migration and Lakehouse‐transformation experience
n
Why consider it? n
n
Permanent position based in Sydney
n
Australian‐standard employee benefits
n
Opportunity to work on enterprise Databricks transformation programs
n
Influence over platform architecture, governance and engineering standards
n
Hands‐on technical work combined with strategic solution design
n
Exposure to modern data, cloud and AI‐enabled platforms
n
Opportunity to contribute to a growing Databricks capability
n
n
Candidates must be available immediately or have a maximum notice period of 30 days.
n
The selection process includes two technical interviews followed by one client interview with Databricks.
n
#J-*****-Ljbffr
📌 Senior Databricks Solution Architect (New South Wales)
🏢 Kaliba
📍 New South Wales