03 Aug
|
Coforge
|
New South Wales
03 Aug
Coforge
New South Wales
Location: Sydney or NewCastle
Duration: Permanent
Experience: 6+ Years
Role Summary
We are seeking an experiencedAWS Data Engineer with Microsoft Fabric expertiseto design, build, optimize, and support enterprise-scale data platforms across AWS and Microsoft Fabric environments.
The role involves developing scalable data pipelines, managing cloud-based data solutions, ensuring platform reliability, implementing governance standards, and supporting analytics and reporting initiatives.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using AWS and Microsoft Fabric.
Build and optimize ETL/ELT processes for structured and unstructured data ingestion.
Develop and manage data workflows using Microsoft Fabric Data Factory, Dataflows Gen2, and OneLake.
Create and maintain data models, Lakehouses, and Data Warehouses to support reporting and analytics requirements.
Integrate data from multiple sources including cloud, databases, APIs, and third-party systems.
AWS Data Platform Management
Implement and support AWS data services such as S3, Glue, Lambda, Athena, Redshift, EMR, and CloudWatch.
Monitor and optimize AWS data infrastructure performance, scalability, and cost efficiency.
Ensure secure data transfer, storage, and access management across AWS environments.
Microsoft Fabric Administration & Support
Support Microsoft Fabric workspaces, pipelines, Lakehouses, Warehouses, and Power BI environments.
Troubleshoot and resolve Fabric-related production issues, pipeline failures, and data quality concerns.
Monitor Fabric capacity utilization and recommend performance improvements.
Support production and non-production environments, ensuring platform stability and operational excellence.
Data Governance & Security
Implement governance standards using Microsoft Purview.
Ensure compliance with enterprise security, privacy, and regulatory requirements.
Maintain role-based access controls, audit logging, and data protection policies.
Support data cataloging, lineage, and metadata management initiatives.
Operational Support
Participate in incident, problem, and change management activities.
Perform root cause analysis and implement preventive solutions.
Monitor SLA compliance and support service improvement initiatives.
Maintain operational documentation, runbooks, and technical standards.
Work closely with Data Architects, BI Developers, Data Scientists, and Business Stakeholders.
Support reporting and analytics initiatives through reliable data delivery.
Contribute to cloud migration, modernization, and data platform transformation programs.
Robust SQL development and performance tuning skills.
Experience with ETL/ELT frameworks and big data processing.
Knowledge of data modeling, data warehousing, and analytics platforms.
Experience working with structured and semi-structured data.
Governance & Monitoring
Microsoft Purview experience preferred.
Understanding of data governance, metadata management, and compliance frameworks.
Monitoring and troubleshooting experience across cloud data platforms.
Preferred Qualifications
5+ years of Data Engineering experience.
2+ years of Microsoft Fabric experience.
AWS Certified Data Engineer, AWS Solutions Architect, or Microsoft Fabric/Azure certifications preferred.
Experience working in enterprise Data & Analytics environments.
Knowledge of DevOps, CI/CD, Infrastructure as Code (Terraform/CloudFormation), and Agile delivery methodologies.
#J-*****-Ljbffr
📌 Aws Data Engineer – Microsoft Fabric (New South Wales)
🏢 Coforge
📍 New South Wales