05 Aug
|
Wirrigan Group
|
City of Sydney
05 Aug
Wirrigan Group
City of Sydney
10d ago , from Illawarra Mercury Job Board
As a Data Engineer, you will join a large-scale enterprise data transformation program. This is a hands-on technical role working within a complex Azure data platform where you will design, build and optimise modern data pipelines while investigating and resolving challenging data quality issues.
The environment contains large, undocumented datasets with known structural and data quality challenges. Success in this role requires not only strong technical capability but also the ability to systematically diagnose issues, produce high-quality technical documentation, and communicate findings clearly to technical and non-technical stakeholders, including senior leadership.
Key Responsibilities
Design, develop and maintain scalable Azure data pipelines, notebooks and ELT processes using Microsoft Fabric and Azure Synapse.
Profile, analyse and resolve data quality, integration and structural issues across complex enterprise datasets.
Develop dimensional data models and Power BI semantic models that support business reporting and analytics.
Produce high-quality technical documentation, investigation reports and recommendations suitable for senior management and governance reviews.
Collaborate with business stakeholders, analysts and technical teams to translate complex technical issues into clear, actionable outcomes.
Key Skills
Strong hands-on experience with Azure Synapse Analytics, Microsoft Fabric, Azure SQL, Azure Data Lake Storage, Azure Key Vault and Power BI.
Expert-level SQL skills with strong experience in Python, PySpark, notebook development and complex data transformations.
Proven experience designing and implementing Medallion Architecture (Bronze, Silver and Gold layers) and dimensional data models.
Robust knowledge of Power BI, including semantic models, DAX, row-level security and dashboard development.
Experience with Azure DevOps/Git, data profiling, root cause analysis and troubleshooting complex enterprise data issues.
#J-18808-Ljbffr
📌 Data Engineer (City of Sydney)
🏢 Wirrigan Group
📍 City of Sydney