Should be able to work with structured and unstructured data should be transformed (ETL/ELT) using Fabric pipelines connected via Data Agents.

Create Data agents from Lakehouse and Train and deploy the

Ensure compatibility with AI model inputs (like normalized tabular data, image files, etc.).

Fabric Data Engineer

- Design and Implement Medallion Architecture on OneLake
- Ability to design and develop Medallion architecture in Fabric onelake (Bronze, Silver, Gold) pattern.
- Work with Structured and Unstructured data
- Architect and implement data pipelines using Microsoft Fabric Dataflows and Pipelines to support raw to refined data transitions.
- Ensure modularity, reusability, and performance of layered data transformations.
- Define and enforce naming conventions, folder structures , and workspace strategies to support scalable data development and governance.
- Implement data quality checks , monitoring, and alerting using Data Quality rules and metrics in Fabric.
- Configure and maintain security best practices , including role-based access control (RBAC), OneLake item-level security, and integration with Azure AD.
- Create documentation and templates to standardize development across teams.
- Support Semantic Data Model Design and Enhancements
- Work closely with analysts and business stakeholders to translate reporting needs into optimized semantic models.
- Enhance existing models for performance, usability (e.g., calculated measures), and self-service capabilities.
- Ensure alignment with Microsoft Fabric best practices for Power BI datasets and Direct Lake modes.
- CI/CD and DevOps Enablement




- Set up and maintain CI/CD pipelines using Azure DevOps for Fabric artifacts (Dataflows, Pipelines, Datasets, Reports).
- Automate deployment processes across dev, test, and prod workspaces.
- Ensure version control and change tracking for semantic models and pipelines.
- Integrate Dynamics 365 (CE and F&O;) as a Data Source
- Configure and optimize ingestion pipelines from Dynamics 365 (Dataverse and Finance & Operations).
- Use OneLake shortcuts and pipelines to bring in near real-time data with incremental loads.
- Ensure consistent schema mapping and data lineage tracking.
- Modernize and AI-Enrich Existing BI Reports
- Migrate legacy reports to Microsoft Fabric and Power BI using Direct Lake/Hybrid models.
- Introduce AI capabilities like Copilot, natural language Q&A;, Smart Narratives, and anomaly detection visuals.
- Optimize report performance and accessibility for self-service users.

Desirable Skills and Experience

- Solid hands-on experience with Microsoft Fabric, Power BI, Python/PySpark scripts and Dataflows Gen2 .
- Proficient in Azure DevOps , Git-based source control, and YAML pipelines.
- Knowledge of Medallion architecture principles and implementation patterns.
- Experience with Dynamics 365 data structures and integration tools .
- Familiarity with Power BI advanced features including Dataflows, Direct Lake, DAX, RLS/OLS, and AI visuals.
- Design and provide solutioning
- Fabric AI Functions
- AI Skills
- The role requires strong expertise in enterprise data architecture, Microsoft Fabric, Dynamics 365 data models, Azure AI, Power BI, and modern data engineering practices.

#J-18808-Ljbffr

📌 Data & AI Architect (Melbourne)
🏢 Sonata Software
📍 Melbourne