Job Description

Data Engineer | Sydney, NSW

n

We are looking for an experienced Data Engineer (9–14 Years) to join a high-performing team delivering enterprise-scale data platforms and real-time data solutions on AWS.

n

Must Have Skills

n

n
AWS Cloud Services
n
Python & PySpark
n
Apache Airflow (MWAA)
n
SQL
n
Amazon Redshift
n
AWS SageMaker Unified Studio
n
AWS Kinesis / Kafka (Real-Time Streaming)
n

n

Key Responsibilities

n

n
Design and develop scalable batch and real-time data ingestion frameworks.
n
Build and optimize data pipelines using AWS services and up-to-date data engineering practices.
n
Develop low-latency streaming solutions using Kinesis, Kafka, or similar technologies.
n
Implement data transformations, orchestration workflows, and monitoring solutions.
n




Work with Data Warehouses, Data Lakes, and Lakehouse architectures.
n
Collaborate with cross-functional teams to deliver robust and scalable data solutions.
n

n

Required Experience

n

n
Robust expertise in AWS, Python, PySpark, Airflow, and Redshift.
n
Hands-on experience with SageMaker Unified Studio.
n
Experience with relational and NoSQL databases (Oracle, MongoDB, DynamoDB, Snowflake, Teradata, etc.).
n
Proven experience building real-time and batch data pipelines.
n
Knowledge of CI/CD, Git, Infrastructure as Code (Terraform/CloudFormation).
n
Data Modelling experience is highly desirable.
n

📌 Senior Data Engineer Real Time Aws New South Wales
🏢 The HR Ally
📍 New South Wales