Job Description
We are seeking an experienced Data Engineer to join a dynamic team operating within a complex data integration workplace. The ideal candidate will possess strong technical expertise combined with the ability to work with partially documented and quality-challenged data sources. This role involves diagnosing data issues, producing detailed documentation, and effectively communicating technical findings to stakeholders at all levels.
n
Key Responsibilities:
n
n
Work with undocumented and partially defective data extracts, diagnosing issues systematically.
n
Develop and maintain data pipelines using core Azure services and modern architecture patterns.
n
Produce formal documentation and communicate technical issues clearly to non-technical stakeholders.
n
Profile large datasets, identify data quality issues, and develop solutions.
n
Collaborate with teams using version control tools such as Azure DevOps or GIT.
n
n
Required Skills and Experience:
n
n




Expert-level SQL development, including complex transformations and data analysis.
n
Proficiency in Python and PySpark with hands-on pipeline development experience.
n
Practical experience implementing Medallion architecture across multiple data layers.
n
Advanced knowledge of Power BI, including semantic modeling, DAX, and visual development.
n
Deep understanding of dimensional modeling techniques and their implementation.
n
Hands-on data profiling and diagnosis of large, undocumented datasets.
n
Experience with version control systems, particularly Azure DevOps or GIT.
n
Metadata-driven or framework-based ELT experience, particularly with Azure Synapse or Azure Data Factory.
n
Familiarity with Microsoft Dynamics CRM and Dataverse, including data quality issues and GUID generation patterns.
n
#J-*****-Ljbffr

📌 Data Engineer (New South Wales)
🏢 Talent International
📍 New South Wales