12 Sep
|
Talent
|
Canberra
Design and build complex AWS data pipelines across APIs, MFT, ETL and streaming
12-month contract + 12-month extension option
Australian citizenship required | Must be able to obtain NV1 clearance
Take on a senior, hands-on data engineering role focused on designing, building and optimising the pipelines that move data across a complex cloud environment.
You'll work primarily across AWS data services, ETL, data processing and automation, building scalable pipelines while working closely with data scientists, analysts and technical specialists to ensure data remains secure, reliable and accessible.
The Role
As a Senior Data Pipeline Engineer, you'll provide hands-on technical expertise across the design and implementation of cloud-based data pipelines.
Your responsibilities will include:
Designing, building, testing and deploying pipelines across MFT, APIs, file extracts and other integration patterns
Building and maintaining AWS-based ETL and data processing solutions, including AWS Glue
Developing data processing streams using technologies such as AWS Kinesis
Implementing appropriate security and access controls across data pipelines
Automating and optimising pipeline delivery using Terraform, scripting and contemporary engineering practices
About You
We're particularly interested in:
5+ years' Data Pipeline Engineering experience within cloud environments
Strong AWS experience across data storage, extraction, transformation and processing
Experience designing and delivering different pipeline patterns, including MFT, APIs and file extracts
Experience with ETL technologies such as AWS Glue, Informatica, dbt or Talend
Strong SQL skills and practical understanding of cloud data architecture
Experience with Terraform and Agile delivery methodologies
Experience with GoAnywhere MFT, Control-M, GitHub, Bitbucket and CI/CD automation would be highly regarded.
Why Consider the Opportunity?
There's positive technical variety in this one.
Rather than being focused solely on traditional ETL, you'll work across APIs, managed file transfer, streaming, cloud data processing, security and automation, with ownership across the pipeline lifecycle from design through to deployment and optimisation.
It's particularly suited to someone who enjoys staying hands-on while taking greater ownership of how data moves securely and reliably across a large cloud environment.
#J-*****-Ljbffr
📌 Data Pipeline Engineer (Canberra)
🏢 Talent
📍 Canberra