Viable Solutions is seeking5 experienced Data Engineersto join our team and deliver critical ETL pipeline solutions for an enterprise client.
You will be responsible for designing, building, and operating automated ETL jobs that extract data from SQL databases and CSV files, transform them into consumer-defined formats, and securely deliver them to downstream systems via SFTP and similar mechanisms.
This role requires self-starters who can independently design and deliver robust data pipeline solutions while ensuring the highest standards of data security and PII protection.
Key Responsibilities
Design, build, and maintain end-to-end ETL pipelines for extracting, transforming, and loading data across enterprise systems
Read and process data fromSQL databases and CSV files
Transform and reformat data into consumer-definedCSV file interfaces
Deliver processed data files securely to consumer systems viaSFTP or similar file transfer mechanisms
Build reusable, modular, and maintainable ETL components and frameworks
Optimise ETL jobs for performance, reliability, and scalability
Data Transformation & Quality
Develop complex data transformation logic - filtering, aggregation, mapping, cleansing, and enrichment
Parse and processXML and CSVdata formats across multiple source systems
Implement data quality checks, validation rules, and reconciliation processes
Identify and resolve data issues, gaps, and inconsistencies across pipelines
Deploy ETL solutions tonon-production and production environmentswith appropriate controls
Implement and maintain CI/CD pipelines for ETL workloads
Manage deployment processes with proper change management and approval controls
Support testing - unit testing, SIT, and UAT - across all pipeline deployments
PII & Data Security




Implement appropriate controls toprotect Personally Identifiable Information (PII)throughout the data pipeline
Ensure data masking, encryption, and access controls are applied consistently
Adhere to data governance, privacy, and compliance requirements across all data assets
Follow security best practices for file transfer and data delivery mechanisms
Independently design and propose appropriate technical solutions for ETL and data pipeline requirements
Document technical designs, data flows, and pipeline architecture
Collaborate with business stakeholders and consumer teams to understand data requirements and output specifications
Contribute to technical reviews and architecture discussions
AWS Cloud Operations
Deploy and operate ETL workloads onAWS- Lambda, Glue, S3, EC2, Step Functions, or similar
Ensure high availability, performance, and cost efficiency of cloud-based ETL solutions
Required Skills & Experience
5-8+ years of hands-on data engineering experience
Strong proficiency inPython- ETL scripting, automation, and pipeline development(mandatory)
Strong proficiency inJava- enterprise-grade data processing components(mandatory)
AdvancedSQLskills - complex querying, stored procedures, and database interactions(mandatory)
Experience withXML- parsing, transformation, and data format handling(mandatory)
Hands-onAWSexperience - Glue, Lambda, S3, Step Functions, EC2, or similar(mandatory)
Proven experience building and operatingETL pipelinesin production environments
Experience withSFTP and secure file transfermechanisms
Experience processing and transformingCSV and flat file formats
Solid understanding ofPII data protectionand data privacy best practices
Experience deploying tonon-production and production environmentswith appropriate controls
Ability to work as aself-starterand independently design and deliver solutions
Strong analytical and problem-solving skills with high attention to detail
#J-*****-Ljbffr

📌 Data Engineer (New South Wales)
🏢 Viable Solutions
📍 New South Wales