Role Overview

As a Senior Data Engineer, you will take a lead, hands‑on role in architecting, constructing, and maintaining enterprise‑grade data, business intelligence, and AI‑driven analytics frameworks within our Azure Databricks ecosystem. Balancing new project delivery with business‑as‑usual (BAU) operations, you will partner closely with corporate stakeholders, BI divisions, and technology vendors. Your mission is to deploy dependable, scalable, and premium data architectures that empower data‑driven corporate strategy.

Core Responsibilities

- Solution Architecture & Delivery: Architect, implement, and maintain enterprise data platforms, BI architectures, and AI‑powered analytics tools across the Azure Databricks environment.
- Operational Balance: Drive both strategic, project‑based engineering goals and day‑to‑day BAU operational support to guarantee robust, high‑performance reporting and data frameworks.
- Pipeline Engineering: Create, optimise, and manage end‑to‑end data pipelines, ETL/ELT workflows, and structured analytical models using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Databricks, SQL, Python, PySpark, and Databricks SQL.
- BI Ecosystem Management: Construct, tune, and oversee Power BI datasets, semantic layers, and interactive dashboards to facilitate sophisticated analytics and strategic reporting.
- Optimization & Monitoring: Oversee data platform health, proactively monitor data flows, diagnose system bottlenecks, and continually elevate platform performance, uptime, and data fidelity.
- DevOps & Automation:



Integrate and enhance continuous integration and continuous deployment (CI/CD) workflows alongside broader DevOps strategies via Azure DevOps.
- Security & Compliance: Establish and enforce rigorous data governance, security protocols, authentication mechanisms, and access controls throughout the Azure infrastructure.
- Governance Advocacy: Play an active role in defining, executing, communicating, and educating internal teams on data governance policies and standards.
- Cross‑Functional Partnership: Work in close alignment with commercial stakeholders, data science units, BI squads, and engineering peers to deploy scalable, production‑grade systems.

Required Skills & Background

- Demonstrated track record of deploying robust data infrastructure within the Microsoft Azure ecosystem.
- Deep, hands‑on programming expertise in SQL, Python, PySpark, and Databricks SQL.
- Established background in designing enterprise data warehouses and dimensional analytical models.
- Advanced proficiency in Power BI development, administrative management, and complex DAX scripting.
- Practical experience operating in modern DevOps cultures, utilizing source control and automated CI/CD deployment pipelines.




- Proven capacity to simultaneously navigate high‑priority project deadlines and live production BAU troubleshooting.
- Comprehensive grasp of contemporary data integration patterns, analytics platforms, and reporting architectures.
- Prior experience building or maintaining advanced AI/BI integration or machine learning solutions.
- Familiarity with broader Azure AI components (such as Azure Machine Learning).
- Experience steering BI or advanced analytics initiatives from initial conception through to final deployment.
- Background in the retail sector is highly prized, though experience within logistics, supply chain, or banking environments is also highly valued.

Key Behaviors & Attributes

- Analytical Thinking: Exceptional problem‑solving capabilities with a highly diagnostic mindset.
- Execution Focus: Outcome‑oriented with a sharp ability to organize tasks and manage competing priorities effectively.
- Resilience & Agility: A composed, flexible professional who thrives in high‑velocity, evolving workplaces.
- Ownership: A self‑starting attitude marked by personal accountability and proactive problem resolution.
- Commercial Acumen: Strong business intelligence and sound financial/operational judgment.
- Stakeholder Engagement: An inclusive communicator capable of translating complex technical concepts for non‑technical business leaders.
- Communication Excellence: Exceptional written and verbal communication skills.

#J-18808-Ljbffr

📌 Senior Data Engineer (Melbourne)
🏢 Sirius.
📍 Melbourne