Location
Sydney/Melbourne
About the Role
We are looking for an experiencedData Engineerwith strong expertise inMicrosoft AzureandDatabricksto design, develop, and optimize data solutions.
You will be responsible for building scalable data pipelines, managing big data environments, and enabling advanced analytics for business insights.
Key Responsibilities
Design and implementdata pipelinesusingAzure Data Factory,Databricks, and related services.
Develop and optimizeETL/ELT workflowsfor structured and unstructured data.
Build and maintaindata lakes and data warehouseson Azure.
Implementdata governance, security, and compliancestandards.
Collaborate with data scientists and analysts to deliverhigh-quality datasetsfor analytics and machine learning.
Monitor and troubleshootdata workflowsfor performance and reliability.
Work withSparkandPySparkfor big data processing in Databricks.
Integrate data from multiple sources includingAPIs, streaming data, and on-prem systems.
Required Skills & Qualifications




Bachelor's degree inComputer Science, Engineering, or related field.
Hands-on experience withAzure services:
Solid experience withDatabricks,Apache Spark, andPySpark.
Proficiency inPythonandSQLfor data engineering tasks.
Knowledge ofdata modeling,data governance, andsecurity best practices.
Familiarity withCI/CD pipelinesandDevOps practicesfor data solutions.
Preferred Qualifications
Experience withreal-time data streaming(Azure Event Hub, Kafka).
Knowledge ofDelta Lake architectureandLakehouse concepts.
Familiarity withPower BIor other visualization tools.
Understanding ofmachine learning workflowsin Databricks.
Seniority Level
Mid-Senior level
Employment Type
Full-time
Job Function
Information Technology
Industries
Software Development
Compensation
A$140,******-A$180,******
#J-*****-Ljbffr

📌 Data Engineer – Azure & Databricks (New South Wales)
🏢 N2S.Global
📍 New South Wales