19 Oct
|
Blackroc
|
Brisbane
Duration:
Initial contract to 29 October **** + possible 6-month extension
Location:
Brisbane CBD
Work Arrangements:
Flexible WFH
Company Overview
BLACKROC is partnering with a Queensland Government department to recruit a Senior Data Engineer for a major transformation program now in its build stage. The program is delivering a new customer portal, CRM, modern data platform and integration platform.
Role Purpose
You'll design, build, test and support scalable data pipelines, medallion-layer structures and reusable data products in Microsoft Fabric. Data will come from Dynamics 365, Dataverse, Power Platform and Azure. You'll work independently in an Agile team and test patterns early through prototypes and spikes. You'll partner with Data Architects, Senior Data Analysts, Solution Architects, developers and testers so the data is trusted, secure and ready for reporting, analytics, migration and operational use.
Key Responsibilities
Design, build and support Fabric pipelines, lakehouses, warehouses, dataflows, notebooks and reusable data products
Move data through raw, transformed and curated medallion layers, each with a clear purpose and quality standard
Ingest and curate data from Dynamics 365, Dataverse, Azure, legacy and external systems, including through Fabric Link for Dataverse
Build validation, reconciliation, error handling, logging, monitoring and alerting into every pipeline
Investigate data quality issues and drive practical fixes with analysts, architects and the business
Use spikes and proof-of-concepts to test data patterns, performance and Fabric Link behaviour before full build
Support Power BI, semantic models and curated datasets with the Senior Data Analysts
Help with testing, defect triage, migration cycles, release readiness and operational handover
Required Skills & Experience
Extensive data engineering experience in large or complex enterprise environments
Solid hands-on Microsoft Fabric experience: lakehouses, warehouses, OneLake, pipelines, notebooks, dataflows,
SQL analytics endpoints and workspace delivery patterns
Strong experience building ETL/ELT pipelines, transformations, curated datasets and reusable data products
Experience with medallion or similar layered data architecture
Experience ingesting data from Dynamics 365, Dataverse, Power Platform or comparable enterprise systems
Experience with Fabric Link for Dataverse, Azure Synapse Link or similar Dataverse-to-analytics patterns
Strong SQL skills across structured and semi-structured data
Experience with data validation, reconciliation, error handling, monitoring and operational support
Experience supporting semantic models, data marts and Power BI consumption
Azure DevOps (or equivalent) for source control, CI/CD and release support
Strong understanding of data quality, lineage, security, privacy, role-based access and governance
Experience in Agile teams covering backlog refinement, estimation, sprint planning and release readiness
Preferred Skills & Qualifications
PySpark, Python, T-SQL, Power Query, Dataflow Gen2, Fabric deployment pipelines and Fabric Git integration
Direct Lake, domain-aligned data products or data mesh patterns
Azure Data Lake, Azure SQL, Functions, Logic Apps, Service Bus, Event Grid, API Management, Key Vault and managed identities
Power BI semantic models, DAX awareness, row-level and object-level security, sensitivity labels
Data migration, mock loads, cutover validation and legacy system replacement programs
Data governance, metadata management, cataloguing, MDM and data quality frameworks
Infrastructure as code (Bicep or Terraform)
Microsoft Fabric, Azure Data Engineer, Power BI, Dynamics 365, Power Platform or Azure certifications
At BLACKROC Recruitment, we are committed to fostering diversity, equity, and inclusion. We welcome applications from individuals of diverse backgrounds, including those with lived experiences. If you require any adjustments during the recruitment process, please don't hesitate to reach out to the above-mentioned BLACKROC Consultant.
#J-*****-Ljbffr
📌 Data Engineer - Fabric (Brisbane)
🏢 Blackroc
📍 Brisbane