13 Aug
|
Viable Solutions
|
Sydney
13 Aug
Viable Solutions
Sydney
: Data Engineer (ETL / Integration) @ Melbourne or Sydney
Number of Positions: 5 Location: Melbourne or Sydney, Australia Work Rights: Candidates must be based in Australia with full work rights Start Date: By end of August (immediate availability preferred) Engagement Type: Either Contract ($700/day) or Perm (upto 140K including Super)
About the Role
We are seeking 5 experienced Data Engineers to design, build, and operate ETL (Extract, Transform, Load) pipelines that move data between source systems and downstream consumers. This role is well suited to self-starters who can take a set of requirements, design a clean and secure solution, and deliver it into non-production and production environments with appropriate controls — particularly around the handling of Personally Identifiable Information (PII).
You will work on data integration pipelines that extract data from SQL databases and/or CSV files, transform it into consumer-specific CSV file formats, and deliver these files via secure mechanisms such as SFTP to downstream consumer systems.
Key Responsibilities
- Design, build, and maintain ETL jobs that extract data from SQL databases and/or CSV file sources.
- Transform extracted data into CSV file formats/interfaces as specified by each downstream consumer.
- Deliver output files securely to consumer systems via mechanisms such as SFTP.
- Produce appropriate technical design documentation for current and existing data pipelines.
- Deploy ETL jobs to non-production and production environments, following change and release controls.
- Implement and maintain controls to protect PII and other sensitive data throughout the pipeline lifecycle.
- Monitor, troubleshoot, and support production ETL jobs, resolving issues in a timely manner.
- Collaborate with business stakeholders, consumer teams, and technical teams to clarify interface and data requirements.
- Contribute to continuous improvement of ETL frameworks, standards, and reusable components.
Required Skills & Experience
- Proven experience building and operating ETL/data integration pipelines in a production environment.
- Strong hands-on skills in Python and Java.
- Strong SQL skills, including working with relational databases for data extraction and querying.
- Working knowledge of XML (structuring, parsing, and transforming XML data).
- Hands-on experience with AWS cloud services relevant to data engineering (e.g. S3, Lambda, Glue, RDS, or similar — specifics to be confirmed by hiring team).
- Experience designing file-based integration interfaces (e.g. CSV) to meet consumer-specific specifications.
- Experience with secure file transfer mechanisms such as SFTP.
- Sound understanding of data security and privacy practices, including handling and protecting PII.
- Experience deploying and supporting jobs across non-production and production environments, including familiarity with deployment/change controls.
- Strong solution design skills — able to independently propose an appropriate technical approach for a given integration requirement.
- Self-starter, able to work autonomously with minimal supervision while collaborating effectively within a team.
Desirable Skills
- Experience using AI-assisted development tools such as Claude Code (or similar) to improve engineering productivity.
- Exposure to data pipeline orchestration tools (e.g. Airflow, AWS Step Functions, Glue Workflows).
- Experience working in regulated industries with strong data governance requirements (e.g. banking, finance, insurance).
- CI/CD experience for automated build and deployment of data pipelines.
Other Requirements
- Must be based in Australia, with a strong preference for candidates located in Melbourne or Sydney.
- Must be available to start by end of August.
- Full working rights in Australia.
📌 Data Engineer (Melbourne or Sydney)
🏢 Viable Solutions
📍 Sydney