About the Role

Viable Solutions is seeking 5 experienced Data Engineers to join our team and deliver critical ETL pipeline solutions for an enterprise client. You will be responsible for designing, building, and operating automated ETL jobs that extract data from SQL databases and CSV files, transform them into consumer-defined formats, and securely deliver them to downstream systems via SFTP and similar mechanisms. This role requires self-starters who can independently design and deliver robust data pipeline solutions while ensuring the highest standards of data security and PII protection.

Key Responsibilities

ETL Pipeline Development

Design, build, and maintain end-to-end ETL pipelines for extracting, transforming, and loading data across enterprise systems

Read and process data from SQL databases and CSV files

Transform and reformat data into consumer-defined CSV file interfaces

Deliver processed data files securely to consumer systems via SFTP or similar file transfer mechanisms

Build reusable, modular, and maintainable ETL components and frameworks

Optimise ETL jobs for performance, reliability, and scalability

Data Transformation & Quality

Develop complex data transformation logic — filtering, aggregation, mapping, cleansing, and enrichment

Parse and process XML and CSV data formats across multiple source systems

Implement data quality checks, validation rules, and reconciliation processes

Identify and resolve data issues, gaps, and inconsistencies across pipelines

Deployment & Workplace Management

Deploy ETL solutions to non-production and production environments with appropriate controls

Implement and maintain CI/CD pipelines for ETL workloads

Manage deployment processes with proper change management and approval controls

Support testing — unit testing, SIT, and UAT — across all pipeline deployments

PII & Data Security

Implement appropriate controls to protect Personally Identifiable Information (PII)



throughout the data pipeline

Ensure data masking, encryption, and access controls are applied consistently

Adhere to data governance, privacy, and compliance requirements across all data assets

Follow security best practices for file transfer and data delivery mechanisms

Design & Architecture

Independently design and propose appropriate technical solutions for ETL and data pipeline requirements

Document technical designs, data flows, and pipeline architecture

Collaborate with business stakeholders and consumer teams to understand data requirements and output specifications

Contribute to technical reviews and architecture discussions

AWS Cloud Operations

Deploy and operate ETL workloads on AWS — Lambda, Glue, S3, EC2, Step Functions, or similar

Manage AWS infrastructure supporting data pipeline operations

Ensure high availability, performance, and cost efficiency of cloud-based ETL solutions

Required Skills & Experience

5–8+ years of hands-on data engineering experience

Strong proficiency in Python — ETL scripting, automation, and pipeline development (mandatory)

Strong proficiency in Java — enterprise-grade data processing components (mandatory)

Advanced SQL skills — complex querying, stored procedures, and database interactions (mandatory)

Experience with XML — parsing, transformation, and data format handling (mandatory)

Hands-on AWS experience — Glue, Lambda, S3, Step Functions, EC2, or similar (mandatory)

Proven experience building and operating ETL pipelines in production environments

Experience with SFTP and secure file transfer mechanisms

Experience processing and transforming CSV and flat file formats

Strong understanding of PII data protection and data privacy best practices

Experience deploying to non-production and production environments with appropriate controls

Ability to work as a self-starter and independently design and deliver solutions

Strong analytical and problem-solving skills with high attention to detail

📌 Data Engineer (Sydney)
🏢 Viable Solutions
📍 Sydney