n
Design, develop and maintain scalable ETL/ELT data pipelines.
n
Build and support data solutions using AWS S3, Glue, EMR, Athena and Aurora PostgreSQL.
n
Develop data processing and transformation solutions using Python, SQL, Spark and PySpark.
n
Design and maintain effective data models for analytical and operational requirements.
n
Implement and support Change Data Capture (CDC) and data integration processes.
n
Ensure data quality, governance, security and reliability across data platforms.
n
Troubleshoot production issues and optimise data pipelines for performance and scalability.
n
Implement automated deployments and testing through CI/CD pipelines and GitHub Actions.
n
Collaborate with engineering, architecture,
product and business stakeholders in an Agile setting.
n
n
Key Skills
n
n
Strong hands-on experience with SQL and Python.
n
Solid AWS experience, particularly S3, Glue, EMR, Athena and Aurora PostgreSQL.
n
Strong experience with Spark/PySpark.
n
Experience developing ETL/ELT pipelines and data integration solutions.
n
Robust understanding of data modelling and operational databases.
n
Experience with CDC, data governance, monitoring and CI/CD.
n
Good problem-solving, communication and stakeholder management skills.
n
📌 Data Engineer New South Wales (Australia)
🏢 Kaizen Global Technologies
📍 Australia
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.