21 Oct
|
NSW Department of Climate Change, Energy, the Environment and Water
|
Sydney
21 Oct
NSW Department of Climate Change, Energy, the Environment and Water
Sydney
Do you want your work to make a difference for NSW?
Working to protect the state’s setting and heritage.
- Help shape the future of data in one of Australia’s most critical sectors
- Two X Temporary full time opportunity up to 30 June 2028, 35 hours/week
- Parramatta preferred, with hybrid working supported
- Salary relative to experience, and ranges from $ 133,348 - $ 146,945 + super and annual leave loading
Are you ready to help shape the future of data in one of Australia’s most critical sectors?
Join the NSW Department of Climate Change, Energy, the Environment and Water (DCCEEW) and be part of a team that’s driving innovation at scale, leveraging cutting-edge technology to deliver insights that matter for our environment, energy, and water resources.
About the Role
As a Senior Data Engineer, you will help shape the department’s modern data environment and build the foundations that enable better decisions across climate, energy, and water management.
You will design, develop, and support trusted data products used by teams across the department. Working with subject matter experts, analysts, and other engineers, you will turn complex and diverse data sources into reliable, scalable, and accessible products that support real-world outcomes.
This role will involve:
- Designing and delivering modern data ingestion pipelines using Microsoft Fabric Data Pipelines, Mirroring, and Eventstreams.
- Building robust transformation processes in Fabric Notebooks using modular, reusable, and parameterised Python and PySpark code.
- Applying Medallion architecture patterns to create well-structured, governed, and high-performing Lakehouses and Warehouses.
- Developing data products that are reliable, observable, and fit for purpose, with strong controls for auditing, load assurance, data quality, and error handling.
- Monitoring pipeline performance and resolving issues before they affect downstream use.
- Working directly with domain experts to understand their data challenges and deliver solutions aligned with data mesh principles.
- Sharing your knowledge through reusable notebooks, templates, frameworks, and engineering practices that help lift capability across the team.
- Support and operate the department's enterprise data platform, including platform monitoring, operational support, access management, incident resolution, and the ongoing maintenance of secure and reliable data services.
- Implement and continuously improve platform governance, operational controls, monitoring, automation, and support processes to ensure data products remain available, secure, and fit for purpose.
You will have the opportunity to work on complex datasets, solve challenging data problems, and contribute to a growing enterprise data platform built on Microsoft Fabric.
About You
You are an experienced data engineer who enjoys turning complex data challenges into practical, reliable solutions.
You are comfortable working across the full data engineering lifecycle- from ingestion and transformation through to performance optimisation, monitoring, and support.
You will bring:
- Extensive experience in a data engineering role involving the design, development, and support of production data solutions.
- Practical experience with Microsoft Fabric, including Lakehouses, Warehouses, Data Pipeline, Mirroring, and Notebooks.
- Strong programming skills in Python, PySpark, and SQL.
- Experience developing scalable ETL and ELT processes using reusable and maintainable code.
- Knowledge of Delta Lake, schema evolution, Medallion architecture, and data quality practies.
- Experience implementing monitoring, auditing, error handling, and operational controls for data pipelines.
- A strong understanding of Microsoft Azure and Azure DevOps.
- Experience working in agile teams and collaborating with technical and non-technical stakeholders.
- The ability to understand business and domain requirements and translate them into high-quality data products.
- A proactive approach to problem solving, continuous improvement, and knowledge sharing.
You will be someone who can work independently, contribute confidently to technical discussions, and help establish engineering standards as the department continues to grow its Microsoft Fabric capability.
For more information, read the full Role Description: Senior Data Engineer
Who we are
The Department of Climate Change, Energy, the Environment and Water (DCCEEW) works to protect the state’s environment and heritage. It leads the way on climate change, driving the sustainable transition to a net zero economy, powered by affordable, reliable,
📌 Senior Data Engineer (Sydney)
🏢 NSW Department of Climate Change, Energy, the Environment and Water
📍 Sydney