17 Nov
|
Zone IT Solutions
|
New South Wales
17 Nov
Zone IT Solutions
New South Wales
We are looking for an experienced Data Engineer with strong expertise in AWS SageMaker Unified Studio, real-time and batch data ingestion, and scalable data engineering frameworks.
Key Responsibilities & Skills
Strong hands‐on experience with
AWS SageMaker Unified Studio
, including Discover, Build, Govern, JupyterLab, Spaces, Query Editor and ML Pipelines.
Develop reusable and scalable
batch and real‐time data ingestion frameworks
across databases, APIs, message queues and file systems.
Expertise in low‐latency real‐time data streaming using
AWS Kinesis, Apache Kafka
or similar technologies.
Strong programming skills in
Python, Boto3
, with experience in API integrations and performance optimisation.
Hands‐on experience with AWS services including
Lambda, S3, DynamoDB, Glue, CloudWatch, SQS, SNS and API Gateway
.
Solid database experience across
Amazon RDS, Redshift, MongoDB, Oracle, Teradata and Snowflake
.
Experience in data transformation, data warehousing,
Data Lakes and Lakehouse architectures
.
Hands‐on experience with
AWS MWAA (Apache Airflow)
, DAG development and workflow orchestration.
Knowledge of monitoring, logging, alerting, real‐time heartbeat exports, AWS IAM and networking.
Experience with
Git, CI/CD, Terraform/CloudFormation
and Data Modelling (added advantage).
We specialize in Digital, ERP, and larger IT Services. We offer flexible, efficient and collaborative solutions to any organization that requires IT, experts. Our agile, agnostic, and flexible solutions will help you source the IT Expertise you need.
Zone IT Solutions is an equal opportunity employer and our recruitment process focuses on essential skills and abilities. We encourage applications from a diverse array of backgrounds, including individuals of various ethnicities, cultures, and linguistic backgrounds, as well as those with disabilities.
📌 Data Engineer (New South Wales)
🏢 Zone IT Solutions
📍 New South Wales