Data Engineer to build and stabilise data pipelines and Power BI reporting across Databricks and Fabric for a current agency.

This role is within newly established Australian Government agency delivering work of national significance.

They are building a modern, values-driven organisation with a strong focus on transparent, timely and evidence-based decision making.

The Opportunity

This opportunity is for a Data Engineer to give hands-on technical support across the agency’s data and reporting environment, within the Data and Knowledge Management section.

The agency works with a wide range of environmental and regulatory data, which supports both its operations and its public reporting.

The Agency is uplifting its data maturity to document and improve the knowledge, performance and resilience behind the Databricks and Power BI functions

You’ll work across pipelines, data models and reporting products. You’ll fix what’s fragile and make sure the knowledge stays in the team.

You’ll have a chance to:

- Work on the data foundations of a national regulator in its first year, while its data capability is still being built and shaped
- Hands-on across the full stack, from Databricks pipelines and curated datasets through to the Power BI models and reports the business relies on, with Fabric also in the mix
- A clearly defined 6-month brief: make critical data and reporting functions reliable, well documented and supportable

The Role

You’ll be responsible for:

- Developing, maintaining and optimising data pipelines, transformations and curated datasets in Azure Databricks, using SQL and Python or PySpark
- Investigating and resolving data quality, integration, refresh and reporting issues across an integrated data workplace, and putting validation and controls in place so they don’t recur




- Designing and maintaining fit-for-purpose data models, and supporting the Power BI datasets and reports built on them
- Documenting data assets, technical processes, dependencies, controls and support procedures, so critical functions can be supported by the APS team
- Identifying gaps in current processes and systems, then testing and implementing improvements through the agency’s change-control processes
- Applying security, privacy and data governance requirements, including data-sharing obligations when data is reused beyond its original purpose
- Providing technical advice to the data team and business’ areas and ICT specialists, and transferring knowledge to APS staff to support operational continuity

The Ideal Person

You’re a hands-on data engineer with solid Azure Databricks experience.

You’re as comfortable untangling a failed refresh as you are building a new pipeline.

You’ve developed and supported data pipelines, transformations and data models in Databricks using SQL and Python or PySpark.

You’ve also worked on the Power BI side, with Power Query, DAX and semantic models.

You know how to assess data quality and fitness for purpose, build validation and controls into your work, and work within source control, deployment and change-control processes.

Experience with Microsoft Fabric will be well regarded.

An Australian citizenship, with an existing Baseline security clearance is essential for this role.

Salary / Rate

This role is being offered as an APS6/ EL1 equivalent full-time labour hire contract for 6 months.

There is no set rate for this RFQ. However the value for you coming through myself for this opportunity is that I have extensive experience recruiting into this market, I work with each candidate individually to land on a rate that’s competitive

📌 Data Engineer (Braddon)
🏢 HorizonOne Recruitment
📍 Braddon