03 Aug
|
Sonata Software
|
Melbourne
03 Aug
Sonata Software
Melbourne
Should be able to work withstructured and unstructured datashould be transformed (ETL/ELT) using Fabric pipelines connected via Data Agents.
Create Data agents from Lakehouse and Train and deploy the
Ensure compatibility withAI model inputs(like normalized tabular data, image files, etc.).
Fabric Data Engineer
Design and Implement Medallion Architecture on OneLake
Ability to design and develop Medallion architecture in Fabric onelake (Bronze, Silver, Gold) pattern.
Work with Structured and Unstructured data
Architect and implement data pipelines using Microsoft Fabric Dataflows and Pipelines to support raw to refined data transitions.
Ensure modularity, reusability, and performance of layered data transformations.
Define and enforcenaming conventions, folder structures, andworkspace strategiesto support scalable data development and governance.
Implementdata quality checks, monitoring, and alerting using Data Quality rules and metrics in Fabric.
Configure and maintainsecurity best practices, including role-based access control (RBAC), OneLake item-level security, and integration with Azure AD.
Create documentation and templates to standardize development across teams.
Support Semantic Data Model Design and Enhancements
Work closely with analysts and business stakeholders to translate reporting needs into optimized semantic models.
Enhance existing models for performance, usability (e.g., calculated measures), and self-service capabilities.
Ensure alignment with Microsoft Fabric best practices for Power BI datasets and Direct Lake modes.
CI/CD and DevOps Enablement
Set up and maintainCI/CD pipelines using Azure DevOpsfor Fabric artifacts (Dataflows, Pipelines, Datasets, Reports).
Automate deployment processes across dev, test, and prod workspaces.
Ensure version control and change tracking for semantic models and pipelines.
Integrate Dynamics 365 (CE and F&O;) as a Data Source
Configure and optimize ingestion pipelines from Dynamics 365 (Dataverse and Finance & Operations).
Use OneLake shortcuts and pipelines to bring in near real-time data with incremental loads.
Ensure consistent schema mapping and data lineage tracking.
Modernize and AI-Enrich Existing BI Reports
Migrate legacy reports to Microsoft Fabric and Power BI using Direct Lake/Hybrid models.
Introduce AI capabilities like Copilot, natural language Q&A;, Smart Narratives, and anomaly detection visuals.
Optimize report performance and accessibility for self-service users.
Desirable Skills and Experience
Strong hands-on experience withMicrosoft Fabric, Power BI, Python/PySpark scripts and Dataflows Gen2.
Proficient inAzure DevOps, Git-based source control, and YAML pipelines.
Knowledge ofMedallion architectureprinciples and implementation patterns.
Experience withDynamics 365 data structures and integration tools.
Familiarity withPower BI advanced featuresincluding Dataflows, Direct Lake, DAX, RLS/OLS, and AI visuals.
Design and provide solutioning
Fabric AI Functions
AI Skills
The role requires strong expertise in enterprise data architecture, Microsoft Fabric, Dynamics 365 data models, Azure AI, Power BI, and up-to-date data engineering practices.
#J-*****-Ljbffr
📌 Data & Ai Architect (Melbourne)
🏢 Sonata Software
📍 Melbourne