Data Engineer Azure Databricks Sydney

02 Oct

CareCone Group

Sydney

02 Oct

CareCone Group

Sydney

We are looking for a Data Engineer to design, build, and optimize high throughput data pipelines on Azure Databricks using Spark (Scala) and SQL
Design & develop scalable ETL/ELT pipelines in Azure Databricks using Spark (Scala) and SQL, following medallion architecture (Bronze/Silver/Gold) and Delta Lake best practices.
Proven expertise in designing real time and near real time integrations
Operationalize workloads: jobs & workflows scheduling, CI/CD with Git (e.g., Azure DevOps), secrets management, and observability.

Expertise in cloud platforms and related technologies, specifically:
Data Platforms (e.g. Databricks) and big data technologies.
Real time data processing frameworks Spark Streaming, Apache/Confluent Kafka
CICD tools GitHub, Confluence, Jira, Jenkins
Proficiency in SQL, Python, and data integration tools.
Familiarity with Master Data Management solutions
Excellent communication and stakeholder management skills.
J-18808-Ljbffr

📌 Data Engineer Azure Databricks Sydney
🏢 CareCone Group
📍 Sydney

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Videographer and Content Creator (Sydney)

03 Oct

Green by Nature AU

Sydney

03 Oct
Green by Nature AU
Sydney

Bring our people, projects and impact to life. Are you a creative storyteller who loves being behind the camera just as much as being behind the edit? This is a hands-on role where no two days will [...]

DoorDash Shopper (Rous)

03 Oct

Doordash

Rous

03 Oct
Doordash
Rous

*Shop & Deliver with DoorDash!* Turn your shopping skills into a flexible way to earn income. As a Shopper with DoorDash, you can deliver groceries, convenience, retail, alcohol, and more–earning [...]