19 Aug
|
Whizdom
|
City of Sydney
19 Aug
Whizdom
City of Sydney
Our client is a globally recognised consulting leader, delivering innovative technology solutions across industries such as finance, healthcare, retail, and telecommunications. With a strong international footprint and offices in major cities worldwide, they are known for their commitment to excellence, scalability, and cutting-edge solutions. Their reputation for partnering with prestigious organisations and leveraging advanced technologies makes them a trusted name in the consulting space. They offer a collaborative environment where talent thrives and ideas shape the future.
About the Role
We are seeking an experienced Databricks Developer for a 6-month contract based in Sydney. This role offers the opportunity to work on high-impact projects within leading sectors, using modern data engineering practices and tools.
Key responsibilities include:
- Designing, developing, and maintaining scalable data solutions using Databricks.
- Expertise in Lakehouse Architecture with Delta Tables, including schema evolution, ACID compatibility, and history capture.
- Building and optimising data pipelines, integrating Databricks with ETL/orchestration tools.
- Strong proficiency in Spark ecosystems, DataFrame API, Spark SQL, and programming in Python/Scala.
- Hands-on experience with Databricks native features such as Workflows, Delta Live Tables, and Unity Catalog.
- Configuring workspaces and clusters, performance tuning, cost optimisation, and ensuring data security.
- Developing Spark Structured Streaming jobs with Autoloader and integrating with streaming platforms.
- Understanding of data modelling concepts and best practices.
- Nice to have: Exposure to AI/GenAI and relevant Databricks or Cloud certifications.
This is an exciting opportunity to work on cutting-edge data solutions in a fast-paced, collaborative environment.
The Successful Candidate
You will bring:
- 5+ years of IT experience, with 3+ years of hands-on Databricks development.
- Proven expertise in Lakehouse architecture and Delta tables.
- Strong knowledge of Spark ecosystems and data engineering best practices.
- Ability to optimise solutions for performance, scalability, and security.
- Excellent problem-solving skills and attention to detail.
- Exceptional communication and collaboration skills.
- A proactive, passionate, and diligent approach to delivering high-quality solutions.
- Ability to work independently and as part of a team in a energetic environment.
What’s on Offer
- Opportunity to work with a prestigious consulting organisation and collaborate with leading end clients.
- Competitive daily rate of AUD 420.
- Exposure to world-class technology and innovative projects.
- Access to learning and development opportunities to enhance your skills.
- Work alongside talented managers and colleagues in a supportive environment.
- A chance to make a real impact while advancing your career.
#J-18808-Ljbffr
📌 Databricks Developer (City of Sydney)
🏢 Whizdom
📍 City of Sydney