21 Aug
|
Paxus - Technology + Digital Talent
|
Melbourne
21 Aug
Paxus - Technology + Digital Talent
Melbourne
Location:
Melbourne
Contract:
12 month
Responsibilities
Build and maintain scalable ETL/ELT workflows using Informatica (mappings, workflows, scheduling and monitoring)
Manage BigQuery datasets and tables, including partitioning and clustering for large-scale analytics
Write and optimise advanced SQL to improve performance and reduce compute cost
Develop Python scripts for file parsing, orchestration and integration with cloud APIs
Automate operational routines using Unix shell scripting (file transfers, pre/post-load steps, batch sequencing)
Schedule, monitor and troubleshoot integrated batch workflows across on-prem and cloud schedulers
Implement robust data validation, error handling and logging to improve data quality and reliability
Diagnose and resolve bottlenecks across Informatica, BigQuery SQL and scripting components
Maintain technical documentation (mapping specs, runbooks, diagrams) and collaborate with analysts/testing/business stakeholders
Requirements
4-7 years' hands-on data engineering experience building and supporting production data pipelines
Strong Informatica experience (development, scheduling, monitoring, troubleshooting)
Proven Google BigQuery capability (table design, dataset management, partitioning/clustering, performance optimisation)
Advanced SQL skills (complex joins, window functions, tuning, validation routines)
Python proficiency for data processing, automation and reusable utilities
Solid understanding of operational monitoring, reconciliation, logging and batch workload support
Demonstrated ability to troubleshoot end-to-end data pipeline issues across tools and scripts
Experience producing and maintaining technical documentation and working in delivery teams
Desirables
Unix shell scripting for orchestration/automation in data pipeline operations
Experience supporting cloud migration or hybrid integration (moving legacy on-prem data into cloud platforms)
Familiarity with Agile delivery, version control and release processes across distributed teams
Relevant degree (Computer Science / IT / Data Engineering or similar) and/or cloud/data/Informatica certifications
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability.
If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
#J-*****-Ljbffr
📌 Data Engineer (Melbourne)
🏢 Paxus - Technology + Digital Talent
📍 Melbourne