21 Aug
|
Whizdom
|
New South Wales
21 Aug
Whizdom
New South Wales
Job Description
Our client is a globally recognised consulting leader, delivering innovative technology solutions across industries such as finance, healthcare, retail, and telecommunications. With a strong international footprint and offices in major cities worldwide, they are known for their commitment to excellence, scalability, and cutting-edge solutions. Their reputation for partnering with prestigious organisations and leveraging advanced technologies makes them a trusted name in the consulting space. They offer a collaborative environment where talent thrives and ideas shape the future.
n
About the Role
n
We are seeking an experienced Databricks Developer for a 6-month contract based in Sydney. This role offers the opportunity to work on high-impact projects within leading sectors, using modern data engineering practices and tools.
n
Key responsibilities include:
n
n
- Designing, developing, and maintaining scalable data solutions using Databricks.
n
- Expertise in Lakehouse Architecture with Delta Tables, including schema evolution, ACID compatibility, and history capture.
n
- Building and optimising data pipelines, integrating Databricks with ETL/orchestration tools.
n
- Strong proficiency in Spark ecosystems, DataFrame API, Spark SQL, and programming in Python/Scala.
n
- Hands-on experience with Databricks native features such as Workflows, Delta Live Tables, and Unity Catalog.
n
- Configuring workspaces and clusters, performance tuning, cost optimisation, and ensuring data security.
n
- Developing Spark Structured Streaming jobs with Autoloader and integrating with streaming platforms.
n
- Understanding of data modelling concepts and best practices.
n
- Nice to have: Exposure to AI/GenAI and relevant Databricks or Cloud certifications.
n
n
This is an exciting opportunity to work on cutting-edge data solutions in a fast-paced, collaborative setting.
n
The Successful Candidate
n
You will bring:
n
n
- 5+ years of IT experience, with 3+ years of hands-on Databricks development.
n
- Proven expertise in Lakehouse architecture and Delta tables.
n
- Strong knowledge of Spark ecosystems and data engineering best practices.
n
- Ability to optimise solutions for performance, scalability, and security.
n
- Excellent problem-solving skills and attention to detail.
n
- Exceptional communication and collaboration skills.
n
- A proactive, passionate, and diligent approach to delivering high-quality solutions.
n
- Ability to work independently and as part of a team in a dynamic environment.
n
n
What's on Offer
n
n
- Opportunity to work with a prestigious consulting organisation and collaborate with leading end clients.
n
- Competitive daily rate of AUD 420.
n
- Exposure to world-class technology and cutting-edge projects.
n
- Access to learning and development opportunities to enhance your skills.
n
- Work alongside talented managers and colleagues in a supportive environment.
n
- A chance to make a real impact while advancing your career.
n
#J-18808-Ljbffr
📌 Databricks Developer (New South Wales)
🏢 Whizdom
📍 New South Wales