Viable Solutions is seeking
5 experienced Data Engineers
to join our team and deliver critical ETL pipeline solutions for an enterprise client. You will be responsible for designing, building, and operating automated ETL jobs that extract data from SQL databases and CSV files, transform them into consumer-defined formats, and securely deliver them to downstream systems via SFTP and similar mechanisms. This role requires self-starters who can independently design and deliver robust data pipeline solutions while ensuring the highest standards of data security and PII protection.
Key Responsibilities
Design, build, and maintain end-to-end ETL pipelines for extracting, transforming, and loading data across enterprise systems
Read and process data from
SQL databases and CSV files
Transform and reformat data into consumer-defined
CSV file interfaces
Deliver processed data files securely to consumer systems via
SFTP or similar file transfer mechanisms
Build reusable, modular, and maintainable ETL components and frameworks
Optimise ETL jobs for performance, reliability, and scalability
Data Transformation & Quality
Develop complex data transformation logic - filtering, aggregation, mapping, cleansing, and enrichment
Parse and process
XML and CSV
data formats across multiple source systems
Implement data quality checks, validation rules, and reconciliation processes
Identify and resolve data issues, gaps, and inconsistencies across pipelines
Deploy ETL solutions to
non-production and production environments
with appropriate controls
Implement and maintain CI/CD pipelines for ETL workloads
Manage deployment processes with proper change management and approval controls
Support testing - unit testing, SIT, and UAT - across all pipeline deployments
PII & Data Security
Implement appropriate controls to
protect Personally Identifiable Information (PII)
throughout the data pipeline




Ensure data masking, encryption, and access controls are applied consistently
Adhere to data governance, privacy, and compliance requirements across all data assets
Follow security best practices for file transfer and data delivery mechanisms
Independently design and propose appropriate technical solutions for ETL and data pipeline requirements
Document technical designs, data flows, and pipeline architecture
Collaborate with business stakeholders and consumer teams to understand data requirements and output specifications
Contribute to technical reviews and architecture discussions
AWS Cloud Operations
Deploy and operate ETL workloads on
AWS
- Lambda, Glue, S3, EC2, Step Functions, or similar
Ensure high availability, performance, and cost efficiency of cloud-based ETL solutions
Required Skills & Experience
5-8+ years of hands-on data engineering experience
Strong proficiency in
Python
- ETL scripting, automation, and pipeline development
(mandatory)
Solid proficiency in
Java
- enterprise-grade data processing components
(mandatory)
Advanced
SQL
skills - complex querying, stored procedures, and database interactions
(mandatory)
Experience with
XML
- parsing, transformation, and data format handling
(mandatory)
Hands-on
AWS
experience - Glue, Lambda, S3, Step Functions, EC2, or similar
(mandatory)
Proven experience building and operating
ETL pipelines
in production environments
Experience with
SFTP and secure file transfer
mechanisms
Experience processing and transforming
CSV and flat file formats
Strong understanding of
PII data protection
and data privacy best practices
Experience deploying to
non-production and production environments
with appropriate controls
Ability to work as a
self-starter
and independently design and deliver solutions
Strong analytical and problem-solving skills with high attention to detail
#J-*****-Ljbffr

📌 Data Engineer (Sydney)
🏢 Viable Solutions
📍 Sydney