Role: Data Engineer (Azure Databricks)

Location: Sydney

Permanent (Fulltime)

- We are looking for a

Data Engineer to design, build, and optimize high throughput data pipelines on Azure Databricks using Spark (Scala) and SQL

- Design & develop scalable ETL/ELT pipelines in Azure Databricks using Spark (Scala) and SQL, following medallion architecture (Bronze/Silver/Gold) and Delta Lake best practices.

- Proven expertise in designing real time and near real time integrations

- Operationalize workloads: jobs & workflows scheduling, CI/CD with Git (e.g., Azure DevOps), secrets management, and observability.

Expertise in cloud platforms and related technologies, specifically:

- Hyperscalars Azure

- Data Platforms (e.g. Databricks)



and big data technologies.

- Big Data Hive, Impala, Sqoop, Spark (Scala/ Python)

- Real time data processing frameworks Spark Streaming, Apache/Confluent Kafka

- CICD tools GitHub, Confluence, Jira, Jenkins

- Proficiency in SQL, Python, and data integration tools.

- Familiarity with Master Data Management solutions

- Excellent communication and stakeholder management skills.

Interested Candidates can share their updated resumes on [email protected] or can reach me on +61 251 103 879

📌 Data Engineer (Azure Databricks) (Sydney)
🏢 CareCone Group
📍 Sydney