Data Engineer – Azure Data Factory and SQL Database Expertise
n
Sydney
n
Job Description: Data Engineer – Azure Data Factory and SQL Database Expertise
n
We are seeking a skilledData Engineerwith expertise in Microsoft Azure Data Factory (ADF) and SQL Database to join our dynamic team. The ideal candidate will have a strong background in Data Warehousing, ETL/ELT processes, and building robust data pipelines on Azure cloud platforms. This role is critical to ensuring efficient data modeling, integration, and transformation processes to support business operations and decision-making.
n
Key Responsibilities
n
n
- Design, build, and maintain scalable data pipelines and ETL/ELT processes usingAzure Data Factory (ADF)and other Azure cloud services.
n
- Write and optimizeT-SQL proceduresfor querying, data transformation, and validation in a Data Warehouse environment.
n
- Develop and maintainmetadata-driven data load frameworksfor automated processing.
n
- Implement dynamic data masking and ensure data security withinAzure SQL Databases.
n
- Perform data modeling to support Data Warehousing and Data Mart architecture.
n
- Collaborate with stakeholders to gather requirements and provide technical solutions that meet business needs.
n
- Ensuredata quality checksand implement quality management processes.
n
- Contribute toCI/CD pipeline implementation and managementusing Azure DevOps.
n
- Maintain repository management usingGit version control.
n
- Engage inpeer programmingand contribute to agile project delivery.
n
- Work withAzure FunctionsandLogic Appsto extend data integration capabilities.
n
- 5+ yearsof experience as a Microsoft Azure Cloud ADF Data Engineer, including T-SQL in a Data Warehouse setting.
n
- Solid understanding ofData Warehousing and Data Mart Architectureson Azure Cloud.
n
- Proficiency inSQLfor data querying, transformation, and validation.
n
- Experience in building metadata-driven frameworks for automation on Azure.
n
- Strong knowledge ofdata security practicesand dynamic data masking in Azure SQL Database.
n
- Hands-on experience withAzure Data Lake, Azure SQL Database, Azure Functions, and Logic Apps.
n
- Minimum3 yearsof experience in design and build using an agile delivery framework.
n
- Familiarity withpeer programmingpractices.
n
- Knowledge ofSPSS programming language.
n
- Experience in theTransport Safety industry(highly beneficial).
n
- Proficiency withCI/CD pipelinesin Azure DevOps and version control with Git.
n
- Agile Scrum Masterexperience (optional but advantageous).
n
- Strong communication skills for engaging business and technical stakeholders.
n
n
Qualifications and Skills
n
n
- Expertise indata engineering technologiesincluding data extraction, integration, and transformation.
n
- In-depth knowledge ofdata modelingand working with various file types, databases, and APIs.
n
- Hands-on experience withdata quality management processes.
n
📌 Data Engineer - Azure Data Factory and SQL Database Expertise (New South Wales)
🏢 Tech Aalto Pte
📍 New South Wales
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.