Should be able to work with
structured and unstructured data
should be transformed (ETL/ELT) using Fabric pipelines connected via Data Agents.
Create Data agents from Lakehouse and Train and deploy the
Ensure compatibility with
AI model inputs
(like normalized tabular data, image files, etc.).
Fabric Data Engineer
Design and Implement Medallion Architecture on OneLake
Ability to design and develop Medallion architecture in Fabric onelake (Bronze, Silver, Gold) pattern.
Work with Structured and Unstructured data
Architect and implement data pipelines using Microsoft Fabric Dataflows and Pipelines to support raw to refined data transitions.
Ensure modularity, reusability, and performance of layered data transformations.
Define and enforce
naming conventions, folder structures
, and
workspace strategies
to support scalable data development and governance.
Implement
data quality checks
, monitoring, and alerting using Data Quality rules and metrics in Fabric.
Configure and maintain
security best practices
, including role-based access control (RBAC), OneLake item-level security, and integration with Azure AD.
Create documentation and templates to standardize development across teams.
Support Semantic Data Model Design and Enhancements
Work closely with analysts and business stakeholders to translate reporting needs into optimized semantic models.
Enhance existing models for performance, usability (e.g., calculated measures), and self-service capabilities.
Ensure alignment with Microsoft Fabric best practices for Power BI datasets and Direct Lake modes.
CI/CD and DevOps Enablement
Set up and maintain




CI/CD pipelines using Azure DevOps
for Fabric artifacts (Dataflows, Pipelines, Datasets, Reports).
Automate deployment processes across dev, test, and prod workspaces.
Ensure version control and change tracking for semantic models and pipelines.
Integrate Dynamics 365 (CE and F&O;) as a Data Source
Configure and optimize ingestion pipelines from Dynamics 365 (Dataverse and Finance & Operations).
Use OneLake shortcuts and pipelines to bring in near real-time data with incremental loads.
Ensure consistent schema mapping and data lineage tracking.
Modernize and AI-Enrich Existing BI Reports
Migrate legacy reports to Microsoft Fabric and Power BI using Direct Lake/Hybrid models.
Introduce AI capabilities like Copilot, natural language Q&A;, Smart Narratives, and anomaly detection visuals.
Optimize report performance and accessibility for self-service users.
Desirable Skills and Experience
Strong hands-on experience with
Microsoft Fabric, Power BI, Python/PySpark scripts and Dataflows Gen2
.
Proficient in
Azure DevOps
, Git-based source control, and YAML pipelines.
Knowledge of
Medallion architecture
principles and implementation patterns.
Experience with
Dynamics 365 data structures and integration tools
.
Familiarity with
Power BI advanced features
including Dataflows, Direct Lake, DAX, RLS/OLS, and AI visuals.
Design and provide solutioning
Fabric AI Functions
AI Skills
The role requires strong expertise in enterprise data architecture, Microsoft Fabric, Dynamics 365 data models, Azure AI, Power BI, and contemporary data engineering practices.
#J-*****-Ljbffr

📌 Data & Ai Architect (Melbourne)
🏢 Sonata Software
📍 Melbourne