24 Sep
|
Tech Aalto Pte
|
Sydney
24 Sep
Tech Aalto Pte
Sydney
Sydney (Sydney)
: Microsoft Fabric Engineer (Real-Time Intelligence & Time Series Data)
Role Overview
We are seeking a Microsoft Fabric Engineer with expertise in implementing Real-Time Intelligence solutions, particularly for time-series data processing. The ideal candidate will have hands-on experience with Azure Data Explorer (ADX) and be skilled in architecting, designing, and optimizing real-time data pipelines within Microsoft Fabric Real-Time Analytics (RTA).
⸻
Key Responsibilities
1. Implementation:
Design and implement real-time data ingestion and processing pipelines using Microsoft Fabric Real-Time Analytics (RTA) or Azure Data Explorer (ADX). Develop scalable solutions for processing high-volume time-series data from IoT devices, sensors, and telemetry sources.
Optimize data models for efficient storage, querying, and analytics in Fabric or ADX.
1. Data Engineering & Integration:
Work with Kusto Query Language (KQL) to build efficient queries for time-series analysis. Develop connectors and integrations with event streams (IoT Hub, Event Hubs, Kafka, etc.) for real-time data ingestion.
Implement data transformation, enrichment, and aggregation strategies for downstream analytics and dashboards.
1. Performance Optimization & Reliability:
Tune KQL queries and ADX clusters to handle large-scale time-series data efficiently. Implement data retention, indexing, partitioning, and archival strategies for optimized storage and retrieval.
Ensure high availability and fault tolerance in real-time streaming architectures.
1. Visualization & Analytics Enablement:
Enable real-time insights via Power BI, dashboards, alerts, and anomaly detection. Collaborate with Data Science and BI teams to support predictive analytics and machine learning on time-series data.
Implement real-time triggers, alerts, and automated responses based on streaming insights.
⸻
Required Skills & Qualifications
- 3+ years of experience in Microsoft Fabric, Real-Time Analytics (RTA), or Azure Data Explorer (ADX).
- Robust Expertise in Kusto Query Language and ADX data modeling. (good to have )
- Hands-on experience with event-driven architectures, data streaming, and IoT analytics.
- Experience integrating with Event Hubs, IoT Hub, Kafka, or other real-time data sources.
- Knowledge of time-series data processing techniques, downsampling, and anomaly detection.
- Familiarity with Microsoft Synapse, Power BI, Databricks, or other analytics platforms.
When you apply, you voluntarily consent to the disclosure, collection and use of your personal data for employment/recruitment and related purposes in accordance with the Tech Aalto Privacy Policy, a copy of which is published at Tech Aalto’s website (https://www.techaalto.com/privacy/) Confidentiality is assured, and only shortlisted candidates will be notified for interviews.
📌 Microsoft Fabric Engineer (Real-Time Intelligence & Time Series Data) (Sydney)
🏢 Tech Aalto Pte
📍 Sydney