- Design, develop, and maintain scalable data architectures, pipelines, and data integration solutions to support enterprise reporting, analytics, and AI initiatives.
- Build and optimize data platforms that enable the reliable collection, transformation, storage, and delivery of high-quality data across cloud and on-premises environments.
- Collaborate with business stakeholders, data analysts, architects, and technology teams to deliver governed, secure, and accessible data assets that support organizational decision-making.

Core Responsibilities

- Design, develop, implement, and maintain robust data pipelines, ETL/ELT processes, and data integration solutions using Microsoft data platforms and cloud technologies.
- Develop and optimize logical and physical data models, database structures, and data storage solutions to support operational, analytical, and AI workloads.
- Build, manage, and enhance enterprise data solutions using SQL Server, Azure Data Factory, Azure SQL Database, Microsoft Fabric, and related technologies.
- Integrate data from multiple internal systems, databases, SaaS applications, and external sources while ensuring data quality, consistency, and integrity.
- Develop, test, and maintain SQL Server stored procedures, scripts, notebooks, and automated data processing workflows to support business and technical requirements.
- Support data migration initiatives, including the transition of SQL Server databases and data assets to Microsoft Fabric Lakehouse and up-to-date cloud-based data platforms.
- Implement and maintain data governance, metadata management, lineage, and compliance practices using Microsoft Purview and enterprise data management frameworks.
- Collaborate with reporting and analytics teams to deliver reusable datasets, support Power BI workspaces, and ensure reliable, scalable, and well-governed data delivery.

Specific Skills, Qualifications, and Experience required for the Position





- 6–10 years of experience in Data Engineering, Database Development, Data Integration, or related disciplines, delivering enterprise-scale data solutions.
- Strong expertise in SQL Server development, including database design, performance tuning, stored procedures, query optimization, and data modelling.
- Hands-on experience building and maintaining ETL/ELT pipelines using Azure Data Factory, SSIS, Azure SQL Database, and Microsoft Fabric technologies.
- Proven experience in data migration, data integration, Lakehouse architectures, reusable dataset creation, and modern cloud-based data platforms.
- Experience working with Microsoft Fabric, Microsoft Purview, Azure DevOps, and Power BI environments, including deployment, governance, and operational support.
- Strong analytical, problem-solving, and stakeholder engagement skills, with the ability to communicate technical concepts effectively to both technical and business audiences.

Key Responsibilities

Core Responsibilities

- Design, develop, implement, and maintain robust data pipelines, ETL/ELT processes, and data integration solutions using Microsoft data platforms and cloud technologies.
- Develop, optimize logical and physical data models, database structures, and data storage solutions to support operational, analytical, and AI workloads.
- Build, manage, and enhance enterprise data solutions using SQL Server, Azure Data Factory, Azure SQL Database, Microsoft Fabric, and related technologies.
- Integrate data from multiple internal systems, databases,



SaaS applications, and external sources while ensuring data quality, consistency, and integrity.
- Develop, test, and maintain SQL Server stored procedures, scripts, notebooks, and automated data processing workflows to support business and technical requirements.
- Support data migration initiatives, including the transition of SQL Server databases and data assets to Microsoft Fabric Lakehouse and contemporary cloud-based data platforms.
- Implement and maintain data governance, metadata management, lineage, and compliance practices using Microsoft Purview and enterprise data management frameworks.
- Collaborate with reporting and analytics teams to deliver reusable datasets, support Power BI workspaces, and ensure reliable, scalable, and well-governed data delivery.

Skill & Experience

Specific Skills, Qualifications, and Experience required for the Position

- 6–10 years of experience in Data Engineering, Database Development, Data Integration, or related disciplines, delivering enterprise-scale data solutions.
- Strong expertise in SQL Server development, including database design, performance tuning, stored procedures, query optimization, and data modelling.
- Hands-on experience building and maintaining ETL/ELT pipelines using Azure Data Factory, SSIS, Azure SQL Database, and Microsoft Fabric technologies.
- Proven experience in data migration, data integration, Lakehouse architectures, reusable dataset creation, and modern cloud-based data platforms.
- Experience working with Microsoft Fabric, Microsoft Purview, Azure DevOps, and Power BI environments, including deployment, governance, and operational support.
- Strong analytical, problem-solving, and stakeholder engagement skills, with the ability to communicate technical concepts effectively to both technical and business audiences.

#J-18808-Ljbffr

📌 Data Engineer (City of Sydney)
🏢 DoublU
📍 City of Sydney