Lead the enterprise rollout of Fabric and Databricks after a successful pilot, shaping how it's scaled.

This is a large, environment-focused line agency covering a diverse range of policy areas, with data and reporting needs spanning many parts of the organisation.

The Opportunity

This prospect is for multiple Data Engineers to help scale the agency’s move to Microsoft Fabric and Databricks.

Fabric has already been proven in a handful of business areas, well beyond a simple proof of concept, and the agency is now looking to build a common data ecosystem the rest of the organisation can use for reporting, analytics and AI/ML.

You’ll likely be working across multiple deployments and rollouts as the enterprise capability scales, with roles open across both the Fabric and Databricks streams.

- Play a lead role in scaling a Microsoft Fabric pilot, already proven in select business areas, into a genuine enterprise-wide data platform capability
- Real influence over the architecture, engineering patterns and governance standards that other business areas will adopt as the platform scales, rather than maintaining a platform someone else has already finished building
- Multiple positions on offer on a long-term contract (12 months plus two further 12-month extension options), across both the Fabric and Databricks streams

The Role

Within this role you’ll be:

- Designing and building enterprise-scale data pipelines and lakehouse architecture on Microsoft Fabric and/or Databricks, using Delta Lake and Medallion design patterns
- Developing data ingestion and transformation processes for structured, semi-structured and unstructured data, using PySpark, Spark SQL, Python and Fabric’s native engineering tools
- Establishing reusable data engineering patterns, quality checks,



lineage and monitoring that other business areas can adopt as the platform moves beyond pilot stage
- Implementing CI/CD, Infrastructure as Code and automated testing across data engineering solutions, using Git and Azure DevOps
- Working directly with stakeholders across multiple business areas to translate differing reporting, analytics and AI/ML requirements into governed, sustainable data solutions

The Ideal Person

You’re a senior or lead data engineer with hands on experience with Microsoft Fabric and/or Databricks, and exposure to lakehouse and warehouse architectures.

You’re comfortable working with Azure DevOps and CI/CD, understand data governance, privacy and security requirements, and can independently design, build, deploy and support enterprise-scale data solutions while working closely with stakeholders.

You’ve designed, developed, implemented and supported enterprise-scale data engineering solutions using Databricks and/or Microsoft Fabric. That work has spanned data pipeline development, lakehouse and data warehouse architectures, data integration, transformation and modelling, DevOps and CI/CD practices, and data governance and security controls. Throughout, you’ve delivered data capabilities that support analytics, reporting, artificial intelligence and machine learning outcomes.

Due to the nature of the work Australian Citizenship and existing Baseline security clearance is mandatory

Salary

- This role is being offered as an EL1 equivalent full-time labour hire contract for an initial 12 months, with the potential for two further 12-month extensions
- There is no set rate for this RFQ. However the value for you coming through myself for this opportunity is that I have extensive experience recruiting into this market, I work with each candidate individually to land on a rate that’s competitive
- Office presence 3 days per week (Canberra), with flexibility to work from home up to 2 days per week

📌 Lead Data Engineer (Braddon)
🏢 HorizonOne Recruitment
📍 Braddon