25 Aug
|
Paxus - Technology + Digital Talent
|
Melbourne
25 Aug
Paxus - Technology + Digital Talent
Melbourne
Location: MelbourneContract: 12 monthResponsibilitiesBuild and maintain scalable ETL/ELT workflows using Informatica (mappings, workflows, scheduling and monitoring)Manage BigQuery datasets and tables, including partitioning and clustering for large-scale analyticsWrite and optimise advanced SQL to improve performance and reduce compute costDevelop Python scripts for file parsing, orchestration and integration with cloud APIsAutomate operational routines using Unix shell scripting (file transfers, pre/post-load steps, batch sequencing)Schedule, monitor and troubleshoot integrated batch workflows across on-prem and cloud schedulersImplement robust data validation, error handling and logging to improve data quality and reliabilityDiagnose and resolve bottlenecks across Informatica, BigQuery SQL and scripting componentsMaintain technical documentation (mapping specs, runbooks, diagrams) and collaborate with analysts/testing/business stakeholdersRequirements4-7 years' hands-on data engineering experience building and supporting production data pipelinesStrong Informatica experience (development, scheduling, monitoring, troubleshooting)Proven Google BigQuery capability (table design, dataset management, partitioning/clustering, performance optimisation)Advanced SQL skills (complex joins,
window functions, tuning, validation routines)Python proficiency for data processing, automation and reusable utilitiesStrong understanding of operational monitoring, reconciliation, logging and batch workload supportDemonstrated ability to troubleshoot end-to-end data pipeline issues across tools and scriptsExperience producing and maintaining technical documentation and working in delivery teamsDesirablesUnix shell scripting for orchestration/automation in data pipeline operationsExperience supporting cloud migration or hybrid integration (moving legacy on-prem data into cloud platforms)Familiarity with Agile delivery, version control and release processes across distributed teamsRelevant degree (Computer Science / IT / Data Engineering or similar) and/or cloud/data/Informatica certificationsPaxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability.
If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
#J-*****-Ljbffr
📌 Data Engineer (Melbourne)
🏢 Paxus - Technology + Digital Talent
📍 Melbourne