15 Sep
|
Umbrella Club
|
New South Wales
15 Sep
Umbrella Club
New South Wales
We are looking for an experienced Data Engineer to join a team focused on building and supporting scalable, cloud-native data platforms.
What you’ll be doing
Design, develop and support cloud-native data platforms and data pipelines.
Build and maintain ETL/ELT pipelines using AWS services.
Work extensively with SQL, Python and Spark/PySpark for data processing and transformation.
Develop solutions using AWS S3, Glue, EMR, Athena and Aurora PostgreSQL.
Apply data modelling and database design principles to support scalable data solutions.
Work with Change Data Capture (CDC) and operational databases.
Contribute to data governance, monitoring and CI/CD processes.
Work with GitHub Actions to support automated deployments and delivery.
Collaborate with stakeholders and delivery teams in an Agile environment.
Troubleshoot data pipeline and platform issues and contribute to continuous improvement.
What we’re looking for
Robust commercial experience as a Data Engineer.
Hands-on expertise in SQL and Python.
Solid experience with AWS, particularly S3, Glue, EMR, Athena and Aurora PostgreSQL.
Strong knowledge of data modelling.
Hands-on experience with Spark/PySpark.
Experience with CDC, data governance, CI/CD and monitoring.
Experience working with operational databases.
Solid problem-solving and stakeholder engagement skills.
Experience working in Agile delivery environments.
Nice to have
Kafka / Amazon MSK
Terraform
Event-driven architectures
Snowflake
dbt
J-18808-Ljbffr
📌 Data Engineer New South Wales
🏢 Umbrella Club
📍 New South Wales