- Minimum 8+ years of IT experience with 5+ years of hands‑on experience in designing, developing, implementing, and maintaining data solutions with Databricks.
- This role requires close collaboration with various teams to gather data requirements, build scalable data pipelines, and ensure the overall solution is reliable, available, and optimized for high performance.
- Proven expertise with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution, ACID compatibility, History capture etc.
- Integrating Databricks with various ETL/Orchestration tools and perform required operations.
- Robust expertise in fundamental areas like Spark ecosystems, Data frame API & Spark SQL with Python/Scala and SQL as language.
- Knowledge of latest Databricks features.
- Hands on knowledge on Databricks native features like Workflows, Delta Live Tables, Unity CatLog etc.
- Expertise in workspace and cluster configuration, performance tuning, cost optimization, data security, and log monitoring.
- Experience with Spark Structured Streaming jobs with Autoloader integrating with different streaming platforms.
- Experience in building optimal data pipeline architecture with knowledge and best practices from Databricks platform.
- Fair understanding of Data Modelling and defining conceptual logical and physical data models.
- Knowledge of different Azure Could services.
- Nice to have - exposure to AI/Gen AI skill and/or any associate or professional level Databricks/Cloud certifications.
Interested candidates can share their updated resumes on OR reach out to me on +61 .
Seniority level
Mid‑Senior level
Employment type
Contract
Job function
Information Technology
#J-18808-Ljbffr
📌 Databricks developer (City of Sydney)
🏢 CareCone Group
📍 City of Sydney
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.