10 Nov
|
Indigitise
|
Canberra
10 Nov
Indigitise
Canberra
Under direction of the Commonwealth, undertake the following duties:
Enterprise Data Migration
- Design and implement data integration pipelines that source logistics and sustainment data from legacy applications
- Collaborate with stakeholders including Business Analysts, Data Architects and developers, analyse logistics, maintenance, inventory, supply chain, procurement and asset management data structures and develop data mappings
- Generate and revise suggested data object designs across relational and data mesh environments as part of the prescribed data generation life cycle for Army analytical products
- Research and develop data migration strategies, cutover approaches and ongoing integration mechanisms between legacy data source and target data sources plus platform migration.
- Support testing, verification and operational acceptance of migrated logistics datasets.
Legacy Data Warehouse to Enterprise Data Mesh Migration
- Support the migration of analytical data assets, from Army legacy data warehouse into a Defence enterprise data mesh architecture.
- Design and develop domain-aligned data products that support self-service analytics, reporting and decision support capabilities.
- Transform landed data into centrally managed warehouse STAR schema plus governed, reusable data products aligned to Data Mesh principles.
- Support implementation of federated governance, data discoverability and enterprise-wide data sharing capabilities.
Data Product and Data Mart Development
- Design and develop business-ready data marts and analytical models supporting:
- Organisational structure and hierarchy management
- Logistics and inventory management
- Maintenance and sustainment management
- Equipment readiness and asset visibility
- Workforce and establishment reporting
- Operational planning and decision support
- Develop conformed dimensions and shared business entities to ensure consistency across analytical domains.
- Support data engineering for dimensional, data vault and hybrid modelling approaches as appropriate to support enterprise analytics requirements.
- Analyse enterprise semantic-ready datasets suitability for Army use cases.
Data Engineering and Platform Development
- Apply DevSecOps, CI/CD and pipeline execution where appropriate.
- Ensure compliance with enterprise governance, security, privacy and information management policies. Including standards for data quality, stewardship and lifecycle management, and master data management.
Requirements
Minimum 5 years dedicated data engineering experience across:
· SQL development including 3NF design, STAR schema design and implementation, in a data warehouse context.
· Agile development, preferably Scrum.
· Experience migrating legacy data warehouse environments to preferably up-to-date analytical platforms or experience with large application data migration or refactoring.
· Python scripting, data engineering or data analysis
· Data DevOps including ETL/ELT pipeline execution, data quality controls / verification
· Datamart design, build and testing.
· SQL code optimisation and refactoring.
· Python scripting and data transformation.
Desirable
· Experience with Data Vault 2.0 patterns, data mesh structures
· Experience with the logistics systems and logistics business domain, especially in a SAP enterprise context.
· Experience with Defence or related industries such as capability development and delivery, sustainment or operational planning.
· Experience with data engineering of sensitive datasets at SECRET, protected identities (PI) and personality identifiable information (PII)
· Working in a large team on a complex application in a decision support or data analytics context.
· Cloudera data analytics suite (CDV, CML etc) including Hive, Impala, Ozone, Iceberg, Spark or contemporary suite eg Databricks including data mesh concepts.
📌 Data EngineerFusion (Canberra)
🏢 Indigitise
📍 Canberra