20 Aug
|
The HR Ally
|
New South Wales
20 Aug
The HR Ally
New South Wales
Job Description
Data Engineer | Sydney, NSW
n
We are looking for an experienced Data Engineer (9–14 Years) to join a high-performing team delivering enterprise-scale data platforms and real-time data solutions on AWS.
n
Must Have Skills
n
n
AWS Cloud Services
n
Python & PySpark
n
Apache Airflow (MWAA)
n
SQL
n
Amazon Redshift
n
AWS SageMaker Unified Studio
n
AWS Kinesis / Kafka (Real‐Time Streaming)
n
n
Key Responsibilities
n
n
Design and develop scalable batch and real‐time data ingestion frameworks.
n
Build and optimize data pipelines using AWS services and contemporary data engineering practices.
n
Develop low‐latency streaming solutions using Kinesis, Kafka, or similar technologies.
n
Implement data transformations, orchestration workflows, and monitoring solutions.
n
Work with Data Warehouses,
Data Lakes, and Lakehouse architectures.
n
Collaborate with cross-functional teams to deliver robust and scalable data solutions.
n
n
Required Experience
n
n
Strong expertise in AWS, Python, PySpark, Airflow, and Redshift.
n
Hands‐on experience with SageMaker Unified Studio.
n
Experience with relational and NoSQL databases (Oracle, MongoDB, DynamoDB, Snowflake, Teradata, etc.).
n
Proven experience building real‐time and batch data pipelines.
n
Knowledge of CI/CD, Git, Infrastructure as Code
(Terraform/CloudFormation).
n
Data Modelling experience is highly desirable.
n
#J-*****-Ljbffr
📌 Data Engineer-Nsw (New South Wales)
🏢 The HR Ally
📍 New South Wales