16 Aug
|
The HR Ally
|
Melbourne
16 Aug
The HR Ally
Melbourne
Location: Melbourne, VIC
Role Type: Permanent
Work Rights: Australian PR / Citizens preferred
Experience: 10+ years
If you are an experienced Azure Data Engineer with solid Databricks, Spark, SQL and ADF expertise, we would like to hear from you.
Role Overview
We are seeking a Senior Data Engineer with strong experience in Microsoft Azure, Databricks, Spark, SQL and Azure Data Factory to design, develop and deliver scalable data engineering solutions.
Key Responsibilities
Design, develop and implement robust, scalable data engineering solutions on Microsoft Azure.
Develop and optimise data pipelines using Azure Databricks, Spark and Azure Data Factory.
Write and optimise complex SQL/T-SQL queries and data transformations.
Implement robust engineering practices across development, testing, deployment and production support.
Build and maintain CI/CD pipelines to support automated and reliable deployments.
Work with stakeholders, architects and development teams to deliver high-quality data solutions.
Troubleshoot performance, data quality and integration issues.
Contribute to data platform standards, architecture and continuous improvement.
Essential Skills & Experience
Degree in Engineering, Computer Science or a related technology discipline.
10+ years' experience as a Software Engineer or Data Engineer.
Strong hands-on experience with Azure Databricks and Apache Spark – Mandatory.
Strong hands-on experience with Azure Data Factory – Mandatory.
Strong SQL/T-SQL skills.
Strong CI/CD experience.
Solid software/data engineering practices and development standards.
Azure certification(s) or equivalent experience.
Azure Technologies
Mandatory:
Azure Databricks / Spark
Azure Data Factory
Desirable:
Azure Synapse / Azure SQL Data Warehouse
Azure Analysis Services
Azure Cosmos DB
Azure Event Hubs
Azure ML
Power BI
📌 Senior Data Engineer – Melbourne
🏢 The HR Ally
📍 Melbourne