Job OverviewWe are seeking an experienced Redshift Data Engineer with 8+ years of experience in data engineering and robust hands-on expertise with Amazon Redshift.
The ideal candidate will be responsible for designing, developing, optimizing, and maintaining scalable data platforms and ETL/ELT pipelines on AWS.Key ResponsibilitiesDesign and develop scalable data pipelines and ETL/ELT workflows using AWS services.Develop and optimize complex SQL queries, stored procedures, views, and data models in Amazon Redshift.Perform Redshift performance tuning, query optimization, distribution/sort key optimization, and workload management.Build and maintain data ingestion pipelines from multiple sources into Amazon Redshift.Work with AWS Glue, S3, Lambda, Step Functions, and CloudWatch for data integration and orchestration.Develop robust data transformation processes using Python and SQL.Implement data quality, validation, reconciliation, and monitoring frameworks.Design and maintain dimensional data models, including fact and dimension tables.Work with large datasets and optimize data processing for performance and cost.Implement incremental data loading and CDC (Change Data Capture) strategies.Troubleshoot data pipeline failures, performance issues, and production incidents.Collaborate with Data Architects, Business Analysts, Developers, and other stakeholders.Follow best practices for data security, governance, access control,



and AWS IAM.Participate in code reviews, technical design discussions, and Agile delivery processes.Mandatory Skills8+ years of experience in Data EngineeringStrong hands-on experience with Amazon RedshiftAdvanced SQL skillsStrong Python programming/scripting experienceExperience developing ETL/ELT pipelinesStrong experience with AWSHands-on experience with Amazon S3Experience with AWS GlueExperience with data warehousing and dimensional data modelingStrong knowledge of Redshift performance tuningExperience with large-scale data processingExperience with CI/CD and GitGood understanding of data quality and data governanceGood to HaveExperience with AWS Lambda, Step Functions, EMR, Athena, and CloudWatchExperience with Apache Spark / PySparkExperience with AirflowKnowledge of Kafka / streaming dataExperience with CDC tools such as AWS DMS, Debezium, or equivalentExperience with Terraform / Infrastructure as CodeExposure to Databricks, Snowflake, or other cloud data platformsExperience working in Agile/Scrum environmentsTechnical SkillsCloud: AWS, S3, Glue, Lambda, Step Functions, CloudWatch Database: Amazon Redshift, PostgreSQL Programming: Python, SQL ETL/ELT: AWS Glue, Airflow, custom Python pipelines Big Data: Spark, PySpark DevOps: Git, CI/CD, Terraform Data Modeling: Star Schema, Snowflake Schema, Dimensional Modeling Streaming: Kafka – desirable

📌 Redshift Data Engineer (Sydney)
🏢 XPT Software Australia Pty
📍 Sydney