13 Sep
|
Talent
|
Canberra
Design and build complex AWS data pipelines across APIs, MFT, ETL and streaming12-month contract + 12-month extension optionAustralian citizenship required | Must be able to obtain NV1 clearanceTake on a senior, hands-on data engineering role focused on designing, building and optimising the pipelines that move data across a complex cloud setting.You'll work primarily across AWS data services, ETL, data processing and automation, building scalable pipelines while working closely with data scientists, analysts and technical specialists to ensure data remains secure, reliable and accessible.The RoleAs a Senior Data Pipeline Engineer, you'll provide hands-on technical expertise across the design and implementation of cloud-based data pipelines.Your responsibilities will include:Designing, building, testing and deploying pipelines across MFT, APIs, file extracts and other integration patternsBuilding and maintaining AWS-based ETL and data processing solutions, including AWS GlueDeveloping data processing streams using technologies such as AWS KinesisImplementing appropriate security and access controls across data pipelinesAutomating and optimising pipeline delivery using Terraform,
scripting and contemporary engineering practicesAbout YouWe're particularly interested in:5+ years' Data Pipeline Engineering experience within cloud environmentsStrong AWS experience across data storage, extraction, transformation and processingExperience designing and delivering different pipeline patterns, including MFT, APIs and file extractsExperience with ETL technologies such as AWS Glue, Informatica, dbt or TalendStrong SQL skills and practical understanding of cloud data architectureExperience with Terraform and Agile delivery methodologiesExperience with GoAnywhere MFT, Control-M, GitHub, Bitbucket and CI/CD automation would be highly regarded.Why Consider the Opportunity?
There's good technical variety in this one.
Rather than being focused solely on traditional ETL, you'll work across APIs, managed file transfer, streaming, cloud data processing, security and automation, with ownership across the pipeline lifecycle from design through to deployment and optimisation.It's particularly suited to someone who enjoys staying hands-on while taking greater ownership of how data moves securely and reliably across a large cloud environment.
#J-*****-Ljbffr
📌 Data Pipeline Engineer (Canberra)
🏢 Talent
📍 Canberra