05 Aug
|
Whizdom
|
City of Sydney
05 Aug
Whizdom
City of Sydney
Our client is a leading organisation operating within the Banking, Financial Services and Insurance (BFSI) sector that is continuing to invest heavily in its enterprise data and analytics capability.
As part of a broader cloud and data transformation journey, they are seeking an experienced AWS Data Engineer to help deliver scalable, secure and high-performing data solutions that support critical business operations, regulatory requirements and customer-focused initiatives.
This is an prospect to join a growing data function working at the forefront of modern cloud, analytics and governance technologies.
About the Role
As an AWS Data Engineer, you will play a key role in designing, building and supporting enterprise-grade data platforms across AWS and Microsoft Fabric. Working within a complex and highly regulated environment, you will help deliver trusted data solutions that underpin reporting, analytics, operational decision-making and digital transformation programs.
The role combines platform engineering, cloud data development and production support, offering exposure to both strategic initiatives and day-to-day operational excellence.
Key Responsibilities
- Design and implement scalable data pipelines across AWS and Microsoft Fabric.
- Develop efficient ingestion, transformation and orchestration processes for a wide range of data sources.
- Build and maintain modern Lakehouse and Data Warehouse solutions.
- Enable integration of data from databases, cloud applications, APIs and third-party platforms.
- Deliver high-quality, trusted datasets for analytics, reporting and business intelligence initiatives.
AWS Data Services
- Leverage AWS technologies including S3, Glue, Lambda,
Athena, Redshift, EMR and CloudWatch.
- Monitor and optimise platform performance, scalability and operational efficiency.
- Support the ongoing enhancement of cloud-based data capabilities.
- Maintain secure and reliable data environments aligned to enterprise standards.
Microsoft Fabric
- Support and enhance Microsoft Fabric capabilities including Data Factory, Dataflows Gen2, OneLake, Lakehouses and Warehouses.
- Troubleshoot data pipeline failures and data quality issues.
- Monitor platform usage and recommend performance improvements.
- Support production and non-production environments to ensure platform stability.
Governance & Data Management
- Contribute to data governance initiatives including metadata, lineage and cataloguing activities.
- Support enterprise data security and access management controls.
- Assist with compliance obligations and regulatory requirements.
- Work with governance technologies such as Microsoft Purview.
Operational Support
- Participate in incident, problem and change management processes.
- Perform root cause analysis and implement sustainable improvements.
- Create and maintain operational documentation and support procedures.
- Contribute to continuous improvement initiatives across the data platform.
The Successful Candidate
You will be a technically strong Data Engineer with experience delivering cloud-based data solutions within large and complex enterprise environments. Exposure to financial services, banking or other regulated industries will be highly regarded.
- 5+ years of Data Engineering experience.
- Strong hands-on AWS data platform experience.
- Experience working with Microsoft Fabric and modern analytics platforms.
- Advanced SQL development and optimisation capability.
- Experience designing and supporting ETL/ELT solutions.
- Sound understanding of data modelling and data warehousing principles.
- Experience working with large-scale structured and semi-structured datasets.
- Strong troubleshooting and performance tuning skills.
- Experience within Banking, Financial Services or Insurance environments.
- Microsoft Purview exposure.
- Knowledge of data governance and compliance frameworks.
- DevOps and CI/CD experience.
- Infrastructure as Code exposure using Terraform and/or CloudFormation.
- Experience supporting enterprise Data & Analytics functions.
Certifications (Highly Regarded)
- AWS Certified Solutions Architect.
- Microsoft Fabric Certification.
What's on Offer
- Join a major organisation within the BFSI sector.
- Work on large-scale cloud and data transformation initiatives.
- Exposure to both AWS and Microsoft Fabric technologies.
- Collaborative and high-performing Data & Analytics team.
- Flexible working arrangements.
- Permanent opportunity based in Sydney, Melbourne or Brisbane.
- Strong career progression and long-term development opportunities.
#J-18808-Ljbffr
📌 Data Engineer (City of Sydney)
🏢 Whizdom
📍 City of Sydney