28 Aug
|
Boltin
|
Victoria
Job Description
n
- Build and maintain scalable data extraction, transformation, and loading workflows using Informatica
n
- Manage tables, datasets, partitions, and clustering inside Google BigQuery for large-scale analytics.
n
- Write and tune advanced SQL scripts and queries to boost execution speed and lower compute costs.
n
- Use Unix shell scripting to automate file transfers, pre- and post-load routines, and batch job sequencing.
n
- Develop custom Python scripts to parse files, orchestrate data movement, and interact with cloud APIs.
n
- Schedule, monitor, and troubleshoot integrated workflows across Unix cron jobs and cloud schedulers.
n
- Move legacy on-premise data assets into cloud environments via hybrid ETL pipelines.
n
- Implement error-handling, logging, and data validation rules using SQL and Python checks.
n
- Diagnose bottlenecks in Informatica mappings, BigQuery queries, and shell scripts.
n
- Maintain technical mapping specs, system architecture diagrams, and partner with analysts or data
n
n
Key Skills & Experience
n
n
- 4-7 years of hands-on data engineering experience designing, developing, and supporting production data pipelines.
n
- Experience building ETL/ELT workflows using Informatica, including mapping development, workflow scheduling, monitoring, and troubleshooting.
n
- Proven capability working with Google BigQuery, including dataset management, table design, partitioning, clustering, and query performance optimisation.
n
- Advanced SQL skills, including complex joins, window functions, stored procedures, query tuning, and data validation routines.
n
- Practical experience with Unix shell scripting for file handling, batch orchestration, job sequencing, and automation of operational tasks. (desired)
n
- Proficiency in Python for data processing, file parsing, API integration, automation, and development of reusable data engineering utilities.
n
- Experience supporting cloud migration or hybrid data integration initiatives, including movement of legacy on-premise data assets to cloud platforms. (desired)
n
- Positive understanding of data quality, reconciliation, error handling, logging, and operational monitoring practices across batch and scheduled workloads.
n
- Ability to diagnose and resolve technical issues across Informatica mappings, SQL queries, shell scripts, and cloud data pipelines.
n
- Experience maintaining technical documentation, mapping specifications, operational runbooks, and working closely with analysts, testers, and business stakeholders.
n
- Familiarity with Agile delivery practices, code version control, release processes, and collaborative delivery across onshore and offshore teams.
n
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline; relevant cloud, data, or Informatica certifications are desirable.
n
n
#J-18808-Ljbffr
📌 Data Engineer (Victoria)
🏢 Boltin
📍 Victoria