Job details
The Department of Agriculture, Fisheries and Forestry (DAFF) is looking for a Data Engineer to join the Digital Transformation Program in theAustralian Bureau of Agricultural and Resource Economics and Sciences(ABARES) to work across several data and analytics platforms.
The candidate will develop and optimise data pipelines inAzure Databricks, with a strong focus onPython and SQL.
The candidate will have expertise inAzure Data Factory, Azure DevOps, CI/CD, andGit version control, as well as a deep understanding ofKimball dimensional modellingandMedallion architecture.
This role requires strong collaboration skills to translate business requirements into effective technical solutions.
Key duties and responsibilities
Key Responsibilities:
Develop, optimise, and maintaindata pipelinesusingPython and SQLwithinAzure Databricks Notebooks.
Design and implementETL/ELT workflowsinAzure Data Factory, ensuring efficient data transformation and loading.
ApplyKimball dimensional modellingandMedallion architecturebest practices for scalable and structured data solutions.
Collaborate with team members and business stakeholdersto understand data requirements and translate them into technical solutions.
Implement and maintainCI/CD pipelinesusingAzure DevOps, ensuring automated deployments and version control withGit.
Monitor, troubleshoot, and optimiseDatabricks jobs and queriesfor performance and efficiency.




Work closely with data analysts and business intelligence teams to providewell-structured, high-quality datasetsfor reporting and analytics.
Ensure compliance withdata governance, security, and privacy best practices.
Contribute tocode quality improvementthrough peer reviews, best practices, and knowledge sharing.
Preferred Skills & Experience:
Robust proficiency in Pythonfor data transformation, automation, and pipeline development.
Advanced SQL skillsfor query optimisation and performance tuning inDatabricks Notebooks.
Hands-on experience withAzure Databricksfor large-scale data processing.
Expertise inAzure Data Factoryfor orchestrating and automating data workflows.
Experience withAzure DevOps, including setting upCI/CD pipelinesand managing code repositories withGit.
Strong understanding ofKimball dimensional modelling(fact and dimension tables, star/snowflake schemas) for enterprise data warehousing.
Knowledge ofMedallion architecturefor structuring data lakes with bronze, silver, and gold layers.
Familiarity withdata modelling best practicesfor analytics and business intelligence.
Strong analytical and problem-solving skills with a proactive approach to identifying and resolving issues.
Excellent collaboration and communication skills, with the ability to engage both technical and business stakeholders effectively.

📌 Senior Data Engineer (Canberra)
🏢 Ontrack Systems Aus Pty
📍 Canberra