We are seeking an experienced Data Engineer with solid hands-on expertise in Microsoft Fabric, PySpark and Data Lake solutions. The ideal candidate should have deep technical knowledge and practical experience in designing, developing and implementing scalable data engineering solutions.
Key Responsibilities
- Design, develop and maintain data pipelines using Microsoft Fabric.
- Build and optimise ETL/ELT workflows and data integration solutions.
- Develop PySpark scripts for large-scale data processing and transformation.
- Work with Data Lake, Lakehouse architecture and related data engineering components.
- Perform data transformation, cleansing, validation and optimisation.
- Troubleshoot performance issues and ensure data quality and reliability.
- Leverage AI-assisted coding tools to improve development efficiency and productivity.
Required Skills
- Strong hands-on experience with Microsoft Fabric.
- Excellent programming skills in PySpark and Python.
- Solid understanding of Data Lake and Lakehouse architectures.
- Experience developing and optimising data pipelines and ETL/ELT processes.
- Strong technical understanding of data engineering concepts and architecture.
- Practical knowledge of AI-assisted development tools such as GitHub Copilot or similar.
- Ability to independently design, develop and troubleshoot technical solutions.
Preferred Skills
- Experience with Azure Data Factory, Azure Databricks and Spark.
- Knowledge of data modelling and performance optimisation.
- Experience working in Agile development environments.
📌 Microsoft Fabric & PySpark Data Engineer (Melbourne)
🏢 The HR Ally
📍 Melbourne
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.