We are seeking an experienced Data Engineer with robust hands-on expertise in Microsoft Fabric PySpark and Data Lake solutions. The ideal candidate should have deep technical knowledge and practical experience in designing developing and implementing scalable data engineering solutions.
Key Responsibilities
Design develop and maintain data pipelines using Microsoft Fabric.
Build and optimise ETL/ELT workflows and data integration solutions.
Develop PySpark scripts for large-scale data processing and transformation.
Work with Data Lake Lakehouse architecture and related data engineering components.
Perform data transformation cleansing validation and optimisation.
Troubleshoot performance issues and ensure data quality and reliability.
Leverage AI-assisted coding tools to improve development efficiency and productivity.
Required Skills
Strong hands-on experience with Microsoft Fabric.
Excellent programming skills in PySpark and Python.
Solid understanding of Data Lake and Lakehouse architectures.
Experience developing and optimising data pipelines and ETL/ELT processes.
Solid technical understanding of data engineering concepts and architecture.
Practical knowledge of AI-assisted development tools such as GitHub Copilot or similar.
Ability to independently design develop and troubleshoot technical solutions.
Preferred Skills
Experience with Azure Data Factory Azure Databricks and Spark.
Knowledge of data modelling and performance optimisation.
Experience working in Agile development settings.
📌 Microsoft Fabric & Pyspark Data Engineer Melbourne
🏢 The HR Ally
📍 Melbourne
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.