16 Nov
|
Ssquare Consulting
|
Canberra
16 Nov
Ssquare Consulting
Canberra
Company Description Ssquare Consulting is a boutique recruitment and payroll management company based in Canberra, specializing in supplying ICT contractor services to federal government agencies and private organizations. The company focuses on building long-term partnerships with clients and professionals in the technology sector. Applicants can expect high standards of service, integrity, and transparent communication throughout their engagement. Ssquare Consulting offers opportunities to work on impactful ICT projects within government and commercial environments.
We are looking for an experienced Databricks Lead / Lead Data Engineer with strong hands-on expertise in Databricks, AWS, PySpark, Data Engineering, and Platform Optimisation.
We’re Hiring – Databricks Lead / Lead Data Engineer
Location: Brisbane (On-site)
Employment: Full time | Permanent
Experience: 10+ Years
We are looking for an experienced Databricks Lead / Lead Data Engineer with strong hands-on expertise in Databricks, AWS, PySpark, Data Engineering,
and Platform Optimisation.
Must-Have Skills (Client Requirements)
- Databricks: Lakehouse Architecture, Delta Lake, Unity Catalog, Delta Live Tables (DLT) / Lakeflow Pipelines
- Data Engineering: PySpark, SQL, ETL/ELT Pipelines, Data Modeling
- AWS Cloud: S3, IAM, Lambda, CloudWatch, SNS/SQS, Secrets Manager
- Performance Optimisation: Spark Tuning, Query Optimisation, Liquid Clustering, Z-Ordering
- Data Integration: Databricks Asset Bundles (DABs), dbt Core / dbt Cloud
- Streaming: Kafka, Structured Streaming, Batch and Real-Time Processing
- Platform Management: Serverless Compute, SQL Warehouses, Databricks Dashboards & Alerting
- Leadership: Technical Team Leadership, Data Architecture, Platform Governance, Security and Cost Optimisation
Note: Candidates must be willing to work on-site in Brisbane.
#J-18808-Ljbffr
📌 Lead Data Engineer (Canberra)
🏢 Ssquare Consulting
📍 Canberra