Location: Sydney or NewCastle

Duration: Permanent

Experience: 6+ Years

Role Summary

We are seeking an experienced AWS Data Engineer with Microsoft Fabric expertise to design, build, optimize, and support enterprise-scale data platforms across AWS and Microsoft Fabric environments. The role involves developing scalable data pipelines, managing cloud-based data solutions, ensuring platform reliability, implementing governance standards, and supporting analytics and reporting initiatives.

Key Responsibilities

- Design, develop, and maintain scalable data pipelines using AWS and Microsoft Fabric.
- Build and optimize ETL/ELT processes for structured and unstructured data ingestion.
- Develop and manage data workflows using Microsoft Fabric Data Factory, Dataflows Gen2, and OneLake.
- Create and maintain data models, Lakehouses, and Data Warehouses to support reporting and analytics requirements.
- Integrate data from multiple sources including cloud, databases, APIs, and third-party systems.

AWS Data Platform Management

- Implement and support AWS data services such as S3, Glue, Lambda, Athena, Redshift, EMR, and CloudWatch.
- Monitor and optimize AWS data infrastructure performance, scalability, and cost efficiency.
- Ensure secure data transfer, storage, and access management across AWS environments.

Microsoft Fabric Administration & Support

- Support Microsoft Fabric workspaces, pipelines, Lakehouses, Warehouses, and Power BI environments.
- Troubleshoot and resolve Fabric-related production issues, pipeline failures, and data quality concerns.
- Monitor Fabric capacity utilization and recommend performance improvements.
- Support production and non-production environments, ensuring platform stability and operational excellence.

Data Governance & Security





- Implement governance standards using Microsoft Purview.
- Ensure compliance with enterprise security, privacy, and regulatory requirements.
- Maintain role-based access controls, audit logging, and data protection policies.
- Support data cataloging, lineage, and metadata management initiatives.

Operational Support

- Participate in incident, problem, and change management activities.
- Perform root cause analysis and implement preventive solutions.
- Monitor SLA compliance and support service improvement initiatives.
- Maintain operational documentation, runbooks, and technical standards.
- Work closely with Data Architects, BI Developers, Data Scientists, and Business Stakeholders.
- Support reporting and analytics initiatives through reliable data delivery.
- Contribute to cloud migration, modernization, and data platform transformation programs.
- Robust SQL development and performance tuning skills.
- Experience with ETL/ELT frameworks and big data processing.
- Knowledge of data modeling, data warehousing, and analytics platforms.
- Experience working with structured and semi-structured data.

Governance & Monitoring

- Microsoft Purview experience preferred.
- Understanding of data governance, metadata management, and compliance frameworks.
- Monitoring and troubleshooting experience across cloud data platforms.

Preferred Qualifications

- 5+ years of Data Engineering experience.
- 2+ years of Microsoft Fabric experience.
- AWS Certified Data Engineer, AWS Solutions Architect, or Microsoft Fabric/Azure certifications preferred.
- Experience working in enterprise Data & Analytics environments.
- Knowledge of DevOps, CI/CD, Infrastructure as Code (Terraform/CloudFormation), and Agile delivery methodologies.

#J-18808-Ljbffr

📌 AWS Data Engineer – Microsoft Fabric (City of Sydney)
🏢 Coforge
📍 City of Sydney