We are seeking an experienced Data Engineer to join a energetic team operating within a complex data integration environment. The ideal candidate will possess strong technical expertise combined with the ability to work with partially documented and quality-challenged data sources. This role involves diagnosing data issues, producing detailed documentation, and effectively communicating technical findings to stakeholders at all levels.
n
Key Responsibilities:
n
n
- Work with undocumented and partially defective data extracts, diagnosing issues systematically.
n
- Develop and maintain data pipelines using core Azure services and modern architecture patterns.
n
- Produce formal documentation and communicate technical issues clearly to non-technical stakeholders.
n
- Profile large datasets, identify data quality issues, and develop solutions.
n
- Collaborate with teams using version control tools such as Azure DevOps or GIT.
n
n
Required Skills and Experience:
n
n
- Expert-level SQL development, including complex transformations and data analysis.
n
- Proficiency in Python and PySpark with hands‐on pipeline development experience.
n
- Practical experience implementing Medallion architecture across multiple data layers.
n
- Advanced knowledge of Power BI, including semantic modeling, DAX, and visual development.
n
- Deep understanding of dimensional modeling techniques and their implementation.
n
- Hands‐on data profiling and diagnosis of large, undocumented datasets.
n
- Experience with version control systems, particularly Azure DevOps or GIT.
n
- Metadata-driven or framework-based ELT experience, particularly with Azure Synapse or Azure Data Factory.
n
- Familiarity with Microsoft Dynamics CRM and Dataverse, including data quality issues and GUID generation patterns.
n
n
If you are a proactive Data Engineer with a passion for tackling complex data challenges and eager to contribute to impactful projects, we encourage you to apply.
#J-18808-Ljbffr
📌 Data Engineer (New South Wales)
🏢 Talent
📍 New South Wales
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.