22 Aug
|
The HR Ally
|
New South Wales
22 Aug
The HR Ally
New South Wales
Job Description
Data Engineer - AWS SageMaker Unified Studio-Australia Only
n
Location: Sydney, NSW
n Experience: 9-14 Years
n Employment Type: Full-Time
n Eligibility: Australian Citizens & Permanent Residents (PR) Only
n Sponsorship: Not Available
n
About the Role
n
We are seeking an experienced Data Engineer with expertise in AWS SageMaker Unified Studio to design and build scalable data platforms, real-time and batch data pipelines, and enterprise data solutions on AWS.
n
Key Responsibilities
n
n
Design and develop batch and real-time data ingestion frameworks.
n
Build ETL/ELT pipelines using Python, PySpark, SQL, and Apache Airflow (MWAA).
n
Develop streaming solutions using AWS Kinesis, Kafka, or similar technologies.
n
Build and manage solutions in AWS SageMaker Unified Studio, including ML pipelines, data processing, governance, and project setup.
n
Develop data solutions using Amazon Redshift, S3, Glue, Lambda, and DynamoDB.
n
Manage Airflow workflows, monitoring, logging, and performance optimisation.
n
Collaborate with Data Engineers, Data Scientists, and Architects to deliver scalable AWS data solutions.
n
n
Required Skills
n
n
9-14 years of Data Engineering experience.
n
Strong hands-on experience with:n
n
AWS SageMaker Unified Studio
n
AWS
n
Python
n
PySpark
n
SQL
n
Apache Airflow (MWAA)
n
Amazon Redshift
n
n
Experience with AWS Kinesis, Apache Kafka, or similar streaming platforms.
n
Strong knowledge of AWS services including S3, Glue, Lambda, DynamoDB, CloudWatch, SQS, SNS, API Gateway, and IAM.
n
Experience with relational and NoSQL databases (Oracle, RDS, Redshift, MongoDB, Snowflake, DynamoDB).
n
Positive understanding of Data Warehousing, Data Lakehouse, Git, CI/CD, Docker, and Infrastructure as Code
(Terraform/CloudFormation).
n
n
Preferred Skills
n
n
Experience with Machine Learning pipelines, MLOps, and Generative AI in SageMaker.
n
Data Modelling experience.
n
Enterprise-scale AWS implementation experience.
n
n
Eligibility
n
n
Australian Citizens & Permanent Residents (PR) only.
n
Candidates must be currently residing in Australia.
n
No visa sponsorship is available.
n
#J-*****-Ljbffr
📌 Data Engineer - Aws Sagemaker Unified Studio-Australia Only (New South Wales)
🏢 The HR Ally
📍 New South Wales