n
- Design, develop and maintain scalable ETL/ELT data pipelines.
n
- Build and support data solutions using AWS S3, Glue, EMR, Athena and Aurora PostgreSQL.
n
- Develop data processing and transformation solutions using Python, SQL, Spark and PySpark.
n
- Design and maintain effective data models for analytical and operational requirements.
n
- Implement and support Change Data Capture (CDC) and data integration processes.
n
- Ensure data quality, governance, security and reliability across data platforms.
n
- Troubleshoot production issues and optimise data pipelines for performance and scalability.
n
- Implement automated deployments and testing through CI/CD pipelines and GitHub Actions.
n
- Collaborate with engineering, architecture,
product and business stakeholders in an Agile environment.
n
n
Key Skills
n
n
- Strong hands-on experience with SQL and Python.
n
- Solid AWS experience, particularly S3, Glue, EMR, Athena and Aurora PostgreSQL.
n
- Strong experience with Spark/PySpark.
n
- Experience developing ETL/ELT pipelines and data integration solutions.
n
- Strong understanding of data modelling and operational databases.
n
- Experience with CDC, data governance, monitoring and CI/CD.
n
- Good problem-solving, communication and stakeholder management skills.
n
📌 Data Engineer (New South Wales)
🏢 Kaizen Global Technologies
📍 New South Wales
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.