Data Engineer – Azure Data Factory and SQL Database Expertise

Sydney

Job Description: Data Engineer – Azure Data Factory and SQL Database Expertise

We are seeking a skilledData Engineer with expertise in Microsoft Azure Data Factory (ADF) and SQL Database to join our dynamic team. The ideal candidate will have a strong background in Data Warehousing, ETL/ELT processes, and building robust data pipelines on Azure cloud platforms. This role is critical to ensuring efficient data modeling, integration, and transformation processes to support business operations and decision-making.

Key Responsibilities

- Design, build, and maintain scalable data pipelines and ETL/ELT processes usingAzure Data Factory (ADF) and other Azure cloud services.
- Write and optimizeT-SQL procedures for querying, data transformation, and validation in a Data Warehouse environment.
- Develop and maintainmetadata-driven data load frameworks for automated processing.
- Implement dynamic data masking and ensure data security withinAzure SQL Databases .
- Perform data modeling to support Data Warehousing and Data Mart architecture.
- Collaborate with stakeholders to gather requirements and provide technical solutions that meet business needs.
- Ensuredata quality checks and implement quality management processes.
- Contribute toCI/CD pipeline implementation and management using Azure DevOps.
- Maintain repository management usingGit version control .




- Engage inpeer programming and contribute to agile project delivery.
- Work withAzure Functions andLogic Apps to extend data integration capabilities.
- 5+ years of experience as a Microsoft Azure Cloud ADF Data Engineer, including T-SQL in a Data Warehouse environment.
- Solid understanding ofData Warehousing and Data Mart Architectures on Azure Cloud.
- Proficiency inSQL for data querying, transformation, and validation.
- Experience in building metadata-driven frameworks for automation on Azure.
- Strong knowledge ofdata security practices and energetic data masking in Azure SQL Database.
- Hands-on experience withAzure Data Lake , Azure SQL Database, Azure Functions, and Logic Apps.
- Minimum3 years of experience in design and build using an agile delivery framework.
- Familiarity withpeer programming practices.
- Knowledge ofSPSS programming language .
- Experience in theTransport Safety industry (highly beneficial).
- Proficiency withCI/CD pipelines in Azure DevOps and version control with Git.
- Agile Scrum Master experience (optional but advantageous).
- Strong communication skills for engaging business and technical stakeholders.

Qualifications and Skills

- Expertise indata engineering technologies including data extraction, integration, and transformation.
- In-depth knowledge ofdata modeling and working with various file types, databases, and APIs.
- Hands-on experience withdata quality management processes .

#J-18808-Ljbffr

📌 Data Engineer – Azure Data Factory and SQL Database Expertise (Sydney)
🏢 Tech Aalto Pte
📍 Sydney