About The Company
Softtest Pays Pty is seeking skilled technology professionals for opportunities supporting data and analytics work in Australia. The organisation values reliable engineering, secure information management and practical collaboration across technical teams. This opportunity is suited to an experienced data professional who can design and build data solutions that support complex workloads and make information accessible for analysis and decision-making.

About The Role
We are looking for a cloud-focused data engineering professional to develop and improve ETL and ELT processes for large-scale or complex data movement, transformation and visualisation. In this role, you will work with data engineering, storage and analytics services in cloud infrastructure, preparing data for efficient querying and dependable downstream use. You will contribute to solutions that may involve distributed computing engines, relational databases and graph databases, and will help ensure data is structured to meet performance, scalability and operational requirements. This opportunity is open only to Australian citizens residing in Australia. Applicants must hold a valid Baseline security clearance or be willing and eligible to obtain one. The successful candidate will bring strong technical capability, sound judgement when handling data and the ability to collaborate with engineering and analytics stakeholders. Qualifications Candidates should demonstrate substantial practical experience developing ETL or ELT processes for complex and/or large data movement, transformation or visualisation, particularly in a cloud environment.



You should also have experience preparing and organising data to optimise query performance in cloud compute engines. Relevant technologies and approaches may include Spark, distributed computing, graph databases and Azure SQL. Experience working with cloud infrastructure services across engineering, storage and analytics is essential. Applicants with experience using Azure Data Factory and Databricks, or with knowledge of data lakes and lakehouses, will be well regarded. A strong understanding of SQL, data storage patterns, analytics needs and secure engineering practices will support success in this role. Equivalent practical experience is welcomed where it demonstrates the required capabilities. Applicants must be Australian citizens currently residing in Australia and must hold, or be eligible and willing to obtain, a valid Baseline security clearance. Responsibilities Design, develop, test and maintain robust ETL/ELT workflows that move and transform data from relevant source systems into trusted, usable destinations. Work with large or complex datasets and apply appropriate cloud-based approaches to improve reliability, scalability and maintainability. Prepare data for efficient querying by selecting suitable structures, processing patterns and storage approaches.



Apply knowledge of distributed compute engines, including Spark, and relevant database technologies to support performance requirements. Collaborate with engineering, storage and analytics teams to understand data needs, align solutions with cloud infrastructure and make information suitable for reporting, analysis and visualisation. Contribute to data quality, validation, documentation and troubleshooting. Identify workflow issues, investigate performance concerns and recommend improvements. Follow security and access requirements, including applicable clearance obligations, and communicate technical decisions clearly to stakeholders. Benefits This role offers the prospect to work on meaningful data engineering challenges in a cloud-focused environment and apply modern data technologies to complex workloads. You will collaborate with professionals across engineering, storage and analytics, deepen your experience with large-scale data solutions, and contribute to systems designed to support informed decision-making. Specific employment conditions and benefits will be discussed during the recruitment process. Equal Opportunity Softtest Pays Pty is committed to fair and respectful recruitment. Applicants will be considered on their skills, experience and ability to meet the role requirements. We welcome applications from people of diverse backgrounds and will provide reasonable adjustments during the recruitment process where requested. Eligibility requirements relating to Australian citizenship, residency and Baseline security clearance apply to this opportunity.

📌 Data Engineer (Australia)
🏢 TaskVerse
📍 Australia