An exciting opportunity is available for an experienced Data Engineer to join a large-scale, enterprise data transformation program within a Queensland Government organisation. This multi-year initiative is establishing a centralised Enterprise Data Platform that will transform how data is managed, governed and leveraged across the organisation.

This role offers the opportunity to work on a high-profile program that will shape the future of enterprise analytics and reporting while utilising the latest Microsoft data technologies.

Key responsibilities

- Design, develop and maintain secure and scalable data pipelines using Microsoft Fabric, Azure and related technologies.
- Build and manage ingestion and transformation processes across Bronze, Silver and Gold data layers using medallion architecture principles.
- Develop curated datasets, semantic models and reusable data products to support Power BI reporting and enterprise analytics.
- Configure and manage Microsoft Purview scans, metadata, classifications, sensitivity labels and data lineage.
- Implement automated data quality validation, testing and technical documentation.
- Apply security, privacy-by-design and governance principles, including RBAC, managed identities and data masking.
- Develop and maintain CI/CD pipelines using Azure DevOps and Git-based workflows.
- Monitor platform performance, optimise storage and compute utilisation, and support operational reliability.
- Collaborate with data stewards, analysts, product owners and technical teams to deliver prioritised outcomes.
- Contribute to engineering standards, reusable templates, best practices and continuous improvement initiatives.

Highly desirable criteria

- Demonstrated experience with Microsoft Fabric, including Pipelines, Dataflows Gen2, Notebooks, Lakehouse, OneLake and SQL Endpoints.
- Strong SQL and PySpark development experience.




- Hands-on experience with Microsoft Purview, including metadata scanning, lineage, governance and sensitivity classifications.
- Proven experience designing and implementing enterprise data platforms using medallion architecture.
- Experience developing semantic models and delivering data products for Power BI.
- Experience with Azure Data Factory, Azure Synapse Analytics or Azure Databricks.
- Exposure to Infrastructure as Code using Bicep or Terraform.
- Experience working within enterprise data governance frameworks.
- Previous experience delivering large-scale data transformation or cloud migration programs within complex environments.

Skills and experience

- Minimum five years' experience as a Data Engineer or in a similar enterprise data engineering role.
- Strong understanding of Microsoft Azure data services and modern cloud-based data platforms.
- Experience building production-grade ETL/ELT pipelines and curated datasets.
- Strong understanding of data governance, security, privacy and data quality principles.
- Excellent analytical and problem-solving skills with strong attention to detail.
- Ability to communicate effectively with both technical and non-technical stakeholders.
- Experience working in Agile delivery environments and collaborating within cross-functional teams.
- Opportunity to work on a significant, enterprise-wide data transformation program.
- Exposure to up-to-date Microsoft Fabric and Azure technologies.
- Hybrid working arrangements available upon request.
- Supportive, collaborative and high-performing team workplace.
- Long-term contract opportunity with a large Queensland Government organisation.
- Standard full-time hours (38 hours per week) with flexible working arrangements available.

Please note that a National Police Check might be required as part of pre-employment screening.

#J-18808-Ljbffr

📌 Data Engineer (Brisbane)
🏢 Exclaim IT
📍 Brisbane