About the Role

Viable Solutions is seeking 5 experienced Data Engineers to join our team and deliver critical ETL pipeline solutions for an enterprise client. You will be responsible for designing, building, and operating automated ETL jobs that extract data from SQL databases and CSV files, transform them into consumer-defined formats, and securely deliver them to downstream systems via SFTP and similar mechanisms. This role requires self-starters who can independently design and deliver robust data pipeline solutions while ensuring the highest standards of data security and PII protection.

Key Responsibilities

ETL Pipeline Development

- Design, build, and maintain end-to-end ETL pipelines for extracting, transforming, and loading data across enterprise systems
- Read and process data from SQL databases and CSV files
- Transform and reformat data into consumer-defined CSV file interfaces
- Deliver processed data files securely to consumer systems via SFTP or similar file transfer mechanisms
- Build reusable, modular, and maintainable ETL components and frameworks
- Optimise ETL jobs for performance, reliability, and scalability

Data Transformation & Quality

- Develop complex data transformation logic — filtering, aggregation, mapping, cleansing, and enrichment
- Parse and process XML and CSV data formats across multiple source systems
- Implement data quality checks, validation rules, and reconciliation processes
- Identify and resolve data issues, gaps, and inconsistencies across pipelines

Deployment & Environment Management

- Deploy ETL solutions to non-production and production environments with appropriate controls
- Implement and maintain CI/CD pipelines for ETL workloads
- Manage deployment processes with proper change management and approval controls
- Support testing — unit testing, SIT, and UAT — across all pipeline deployments

PII & Data Security

- Implement appropriate controls to protect Personally Identifiable Information (PII)



throughout the data pipeline
- Ensure data masking, encryption, and access controls are applied consistently
- Adhere to data governance, privacy, and compliance requirements across all data assets
- Follow security best practices for file transfer and data delivery mechanisms

Design & Architecture

- Independently design and propose appropriate technical solutions for ETL and data pipeline requirements
- Document technical designs, data flows, and pipeline architecture
- Collaborate with business stakeholders and consumer teams to understand data requirements and output specifications
- Contribute to technical reviews and architecture discussions

AWS Cloud Operations

- Deploy and operate ETL workloads on AWS — Lambda, Glue, S3, EC2, Step Functions, or similar
- Manage AWS infrastructure supporting data pipeline operations
- Ensure high availability, performance, and cost efficiency of cloud-based ETL solutions

Required Skills & Experience

- 5–8 years of hands-on data engineering experience
- Strong proficiency in Python — ETL scripting, automation, and pipeline development (mandatory)
- Strong proficiency in Java — enterprise-grade data processing components (mandatory)
- Advanced SQL skills — complex querying, stored procedures, and database interactions (mandatory)
- Experience with XML — parsing, transformation, and data format handling (mandatory)
- Hands-on AWS experience — Glue, Lambda, S3, Step Functions, EC2, or similar (mandatory)
- Proven experience building and operating ETL pipelines in production environments
- Experience with SFTP and secure file transfer mechanisms
- Experience processing and transforming CSV and flat file formats
- Solid understanding of PII data protection and data privacy best practices
- Experience deploying to non-production and production environments with appropriate controls
- Ability to work as a self-starter and independently design and deliver solutions
- Strong analytical and problem-solving skills with high attention to detail

📌 Data Engineer (Sydney)
🏢 Viable Solutions
📍 Sydney