17 Nov
|
TaskVerse
|
Australia
17 Nov
TaskVerse
Australia
About The Company
Softtest pays Pty Ltd works with organisations to connect skilled technology professionals with opportunities across Australia. This role supports cloud data engineering work focused on moving, transforming, preparing and presenting data for effective use. The successful candidate will contribute to data solutions designed to handle complex requirements and large volumes of information, while working with cloud infrastructure, engineering services, storage platforms and analytics technologies.
About The Role
Softtest pays Pty Ltd is seeking an experienced cloud data professional to develop and improve ETL/ELT processes and prepare data for reliable, effective analysis. You will work across data movement, transformation and visualisation, helping ensure that information is structured and optimised for use in cloud-computed environments.
The role involves working with technologies and services such as distributed computing engines, graph databases and Azure SQL. You will collaborate across engineering, storage and analytics areas of cloud infrastructure to deliver practical data solutions. Experience with Azure Data Factory, Databricks, data lakes or lakehouses would be advantageous.
This opportunity is open only to Australian citizens who are residing in Australia. Applicants must hold a valid Baseline security clearance or be willing and eligible to obtain one.
Qualifications
Candidates should demonstrate experience developing ETL/ELT processes for complex or large-scale data movement, transformation and/or visualisation, particularly in a cloud environment.
This is the most heavily weighted selection criterion and represents 50% of the assessment.
You should also have experience preparing data for query performance in cloud-computed environments. Relevant examples may include work with distributed computing engines such as Spark, graph databases, or Azure SQL. This criterion represents 25% of the assessment.
Experience working with cloud infrastructure services across engineering, storage and analytics is also required and represents 25% of the assessment. Familiarity with Azure Data Factory and Databricks, as well as knowledge or experience with data lakes and lakehouses, is desirable.
Applicants should be able to communicate technical ideas clearly, work constructively with colleagues, and apply sound engineering practices to data solutions. Australian citizenship and the specified security clearance eligibility are mandatory requirements for consideration.
Responsibilities
Design, develop and maintain ETL/ELT workflows that support complex and large-scale data movement and transformation. Prepare data for analysis and visualisation, with attention to quality, usability and the needs of downstream consumers.
Optimise data structures and processing approaches to support query performance in cloud-computed environments. Apply relevant tools and techniques when working with Spark, graph databases, Azure SQL and other suitable platforms.
Work with cloud engineering, storage and analytics services to support the delivery of integrated data solutions. Contribute to the appropriate use of cloud data platforms, including data lakes and lakehouses where relevant, and use Azure Data Factory or Databricks where project requirements call for them.
Collaborate with technical stakeholders to understand data requirements, resolve implementation challenges and support dependable, maintainable outcomes. Follow applicable security requirements and handle information responsibly in a security-cleared environment.
Benefits
This role offers the opportunity to apply cloud data engineering skills to complex data challenges and work across a range of engineering, storage and analytics services. You will be able to contribute to solutions involving modern data processing approaches and cloud platforms, while developing practical experience with technologies such as Spark, Azure SQL, Azure Data Factory and Databricks, depending on project needs.
Equal Opportunity
Softtest pays Pty Ltd is committed to fair and respectful recruitment. Applicants will be considered on their relevant skills, experience and ability to meet the role requirements. The position is restricted to Australian citizens residing in Australia who hold, or are willing and eligible to obtain, a valid Baseline security clearance.
📌 Data Engineer (Australia)
🏢 TaskVerse
📍 Australia