30 Aug
|
Whizdom
|
New South Wales
30 Aug
Whizdom
New South Wales
Job Description
Senior Data Engineer - Cloud Data Modernisation
n
Contract Opportunity | Sydney, NSW
n
About the Company
n
Our client is a well-established technology consulting organisation delivering large-scale digital transformation and cloud modernisation projects for enterprise and government customers across Australia. They are recognised for providing innovative data, cloud, and technology solutions that support critical business outcomes.
n
About the End Client
n
The end client is a large organisation undertaking a significant cloud transformation initiative focused on modernising legacy data platforms and establishing scalable, cloud-native data capabilities. This programme will support improved analytics, reporting, operational efficiency, and long-term data strategy.
n
The Opportunity
n
An exciting opportunity exists for an experienced Senior Data Engineer to play a key role in modernising a legacy Microsoft SQL Server data platform and transitioning it to AWS-native services. You will be responsible for designing, building, and optimising scalable cloud data solutions while supporting the migration of databases, ETL processes, reporting platforms, and analytical workloads.
n
Key Responsibilities
n
n
Modernise SQL Server databases to Amazon Aurora PostgreSQL.
n
Analyse and convert SSIS ETL workflows into AWS Glue jobs and workflows.
n
Migrate analytical workloads and legacy data warehouse capabilities into Amazon Redshift.
n
Redevelop reporting and dashboard solutions using AWS-native technologies.
n
Design and build scalable data ingestion, transformation, and reporting solutions.
n
Develop and optimise database structures, schemas, and performance.
n
Implement and maintain CI/CD pipelines for data and database deployments.
n
Establish data quality, monitoring, and operational support frameworks.
n
Collaborate with architects, developers, business stakeholders, and reporting teams.
n
Support testing, reconciliation, cutover activities, and post-production support.
n
n
Required Skills & Experience
n
n
5+ years' experience in Data Engineering and Database Engineering.
n
Strong SQL development and database performance tuning expertise.
n
Hands-on experience with AWS data services, including:n
n
Amazon Aurora PostgreSQL
n
AWS Glue
n
Amazon Redshift
n
AWS QuickSight
n
n
Experience with AWS DMS and AWS Schema Conversion Tool will be highly regarded.
n
Strong data modelling and database design skills.
n
Proficiency with Python and/or PySpark.
n
Proven experience delivering ETL/ELT pipelines and cloud-native data solutions.
n
Experience working with Git, CI/CD pipelines, DevOps practices, and Agile methodologies.
n
Understanding of data governance, security, and operational support requirements.
n
n
What's on Offer
n
n
Opportunity to work on a large-scale cloud data transformation programme.
n
Exposure to contemporary AWS data and analytics technologies.
n
Collaborative and high-performing project environment.
n
Long-term project potential with significant technical impact.
n
Opportunity to shape future-state cloud data architecture and analytics capability.
n
📌 Senior Data Engineer - Cloud Data (New South Wales)
🏢 Whizdom
📍 New South Wales