- 12 + 12 + 12-month contract with a key Commonwealth Government agency
- Hybrid role, open to candidates across Australia
- Baseline security clearance required
- Lead modernisation of nationally significant environmental data platforms
Resolve Recruit is partnering with a leading Commonwealth Government agency to find an experienced Senior Data Engineer.
The role will lead the design, development and implementation of up-to-date cloud-native data solutions within a large-scale Azure environment. It will support the transition from legacy data warehouse platforms to a scalable, secure and high-performing modern data platform, with responsibility for data pipeline development, platform optimisation, migration planning and implementation, and the uplift of contemporary data architecture and governance practices.
Key Responsibilities
- Translate Solution Architect direction into detailed, scalable data platform designs within Azure cloud-native environments
- Design and optimise data pipelines using Azure Databricks (PySpark, notebooks, workflows) and Azure Data Factory
- Drive migration of legacy SQL Server/SSIS/SSAS environments to Azure-based platforms
- Implement data governance,
security and compliance using Unity Catalog (access control, lineage, classification)
- Define and enforce data testing and quality frameworks in collaboration with Test Analysts
- Provide technical leadership and mentoring to ICT professionals and technical specialists
- Maintain CI/CD pipelines and DataOps practices using Azure DevOps
Key Experience and Skills
- Demonstrated experience leading enterprise-scale data platform design, delivery and optimisation
- Strong expertise in Azure Databricks (Spark, PySpark), Azure Data Factory and Delta Lake
- Proven experience with modern data architecture patterns (medallion, Kimball, Data Vault)
- Experience migrating legacy SQL Server/SSIS/SSAS environments to Azure
- Strong understanding of data governance, Unity Catalog and metadata/lineage management
- Demonstrated capability in Python (PySpark) and advanced SQL, with Azure DevOps/CI/CD experience
Security Requirements
Applicants must hold an active Baseline Security Clearance (or higher) to be considered.