Senior Data Engineer, Regulatory Systems (Melbourne)

Senior Data Engineer, Regulatory Systems (Melbourne)

21 Oct
|
Department of Government Services
|
Melbourne

21 Oct

Department of Government Services

Melbourne

Senior Data Engineer, Regulatory Systems Department of Government Services – Melbourne VIC The Department of Government Services (DGS) wasestablishedon 1 January 2023 to improveeveryone’s experience of doing business and interacting with the Victorian government. We bring important day-to-day services together in one department to make things easy and seamless for Victorians and businesses. We are doing this by connecting and digitising our systems and platforms across state and localgovernment as well as streamlining our corporate and procurement services. You can find out more aboutour Ministers,leadershipand entitieshere:Department of Government Services. About the Branch Group The Consumer Affairs and Local Government(CALG)groupis responsible forpolicy development;regulatory design and administration;system and program design;and the delivery of services in the best interest of Victorians. Spanning both the Consumer Affairs and Local Government portfolios, the groupidentifiesstrategic priorities, drives system and regulatory reform and coordinates DGS’ emergency management responsibilities to improve practical outcomes for the community.

About the Role
The Senior Data Engineer is a key member of the Regulatory Data Insights team, responsible for designing, building, and maintaining data platforms and pipelines that power trusted analytics and regulatory intelligence across CAV and the wider group. Reporting to the Technical Data Lead, Regulatory Insights and Systems, the role leads complex engineering initiatives across Microsoft Fabric, Azure, and over time Databricks, ensuring regulatory, compliance, and operational datasets are reliable, secure, and ready for analytics and AI. The position enhances CAV’s data foundations by engineering Lakehouses/Warehouses in OneLake,



developing scalable ingestion and transformation pipelines, and implementing reusable data engineering patterns that integrate multiple internal and external systems. This enables high‑quality insights, dashboards, and AI‑ready data products that support policy development, regulatory strategy, compliance intelligence, operational improvement, and public reporting. The Senior Data Engineer provides expert technical advice on data architecture, performance, and governance; and contributes to standards, CI/CD pipelines, testing frameworks, and documentation that underpin the reliability of the Regulatory Data Insights function. Working closely with the Enterprise Architect, Senior Data Analysts, ICT, and broader regulatory and intelligence teams, the Senior Data Engineer champions best‑practice data engineering, modern cloud patterns, and scalable platform design that strengthens the department’s analytical and AI readiness. The role also supports the future introduction of Databricks, helping ensure interoperability and consistent engineering standards across platforms. Key Accountabilities
- Design, build, and maintain scalable data pipelines for batch and near real-time ingestion and transformation across internal and external data sources using Microsoft Fabric and Azure services.
- Implement and maintain Lakehouse and Warehouse solutions using standard data formats and Medallion architecture to support analytics, reporting,



and advanced use cases.
- Develop curated datasets and semantic models optimised for consumption, ensuring consistency, usability, and alignment with enterprise standards.
- Implement data quality, validation, monitoring, and testing practices to ensure data accuracy, availability, and reliability, including troubleshooting and root cause analysis.
- Apply data governance and security controls, including access management, data protection, and metadata management aligned with enterprise and regulatory requirements and governance framworks.
- Contribute to CI/CD processes, version control, and workplace management to enable consistent and reliable deployment of data platform assets.
- Collaborate with analysts, data scientists, and business stakeholders to translate requirements into data solutions, reusable components, and data products.
- Contribute to documentation, reusable engineering patterns, and continuous improvement, and support uplift of team capability through knowledge sharing and mentoring. About You We are seeking applicants who have demonstrated experience from the following criteria:
- Demonstrated experience designing, developing and delivering scalable data engineering solutions using Microsoft Azure, Microsoft Fabric and/or Databricks, having expertise in Data Factory, Fabric Data Engineering, Spark/PySpark, Delta Lake, Lakehouse, Data Warehouse and advanced SQL.
- Demonstrated expertise in dimensional and Data Vault modelling, Medallion architecture, data contracts, data quality management, metadata and lineage governance, monitoring, observability and performance optimisation practices.
- Experienced in integrating data platforms with Microsoft Power Platform (Datave

📌 Senior Data Engineer, Regulatory Systems (Melbourne)
🏢 Department of Government Services
📍 Melbourne

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer, regulatory systems (melbourne) / melbourne

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer, regulatory systems (melbourne) / melbourne