02 Sep
|
Whizdom
|
City of Sydney
02 Sep
Whizdom
City of Sydney
Senior Data Engineer - Cloud Data Modernisation
Contract Opportunity | Sydney, NSW
About the Company
Our client is a well-established technology consulting organisation delivering large-scale digital transformation and cloud modernisation projects for enterprise and government customers across Australia. They are recognised for providing cutting-edge data, cloud, and technology solutions that support critical business outcomes.
About the End Client
The end client is a large organisation undertaking a significant cloud transformation initiative focused on modernising legacy data platforms and establishing scalable, cloud-native data capabilities. This programme will support improved analytics, reporting, operational efficiency, and long-term data strategy.
The Opportunity
An exciting opportunity exists for an experienced Senior Data Engineer to play a key role in modernising a legacy Microsoft SQL Server data platform and transitioning it to AWS-native services. You will be responsible for designing, building, and optimising scalable cloud data solutions while supporting the migration of databases, ETL processes, reporting platforms, and analytical workloads.
Key Responsibilities
- Modernise SQL Server databases to Amazon Aurora PostgreSQL.
- Analyse and convert SSIS ETL workflows into AWS Glue jobs and workflows.
- Migrate analytical workloads and legacy data warehouse capabilities into Amazon Redshift.
- Redevelop reporting and dashboard solutions using AWS-native technologies.
- Design and build scalable data ingestion, transformation,
and reporting solutions.
- Develop and optimise database structures, schemas, and performance.
- Implement and maintain CI/CD pipelines for data and database deployments.
- Establish data quality, monitoring, and operational support frameworks.
- Collaborate with architects, developers, business stakeholders, and reporting teams.
- Support testing, reconciliation, cutover activities, and post-production support.
Required Skills & Experience
- 5+ years' experience in Data Engineering and Database Engineering.
- Strong SQL development and database performance tuning expertise.
- Hands-on experience with AWS data services, including:
- Amazon Aurora PostgreSQL
- AWS Glue
- Amazon Redshift
- AWS QuickSight
- Experience with AWS DMS and AWS Schema Conversion Tool will be highly regarded.
- Strong data modelling and database design skills.
- Proficiency with Python and/or PySpark.
- Proven experience delivering ETL/ELT pipelines and cloud-native data solutions.
- Experience working with Git, CI/CD pipelines, DevOps practices, and Agile methodologies.
- Understanding of data governance, security, and operational support requirements.
What's on Offer
- Opportunity to work on a large-scale cloud data transformation programme.
- Exposure to modern AWS data and analytics technologies.
- Collaborative and high-performing project environment.
- Long-term project potential with significant technical impact.
- Opportunity to shape future-state cloud data architecture and analytics capability.
#J-18808-Ljbffr
📌 Senior Data Engineer - Cloud Data (City of Sydney)
🏢 Whizdom
📍 City of Sydney