Job Description

Lead Data Engineer – Melbourne - $180,000 - Gain "productionised" Agentic AI and Gen AI n
n
nMorgan Consulting are partnering with an exciting and fast growing organisation seeking a Lead Data Engineer to join their Data function. This is an opportunity to gain Agentic and Generative AI "Productionised" experience. This role offers strong Career Development within an organisation which operates with very little red-tape and has a supportive and positive culture.n
About the Role: n
nThe Lead Data Engineer is a hands on technical specialist responsible for building and supporting modern Databricks Lakehouse solutions on Azure within a complex retail data landscape. Working across both project initiatives and BAU, the role delivers robust, scalable data pipelines and curated analytical datasets that underpin enterprise BI, advanced analytics, and AI. You will collaborate closely with retail stakeholders, BI developers, and broader technology teams to transform high volume retail data into trusted, production ready insights that support critical business outcomes. This is an opportunity to gain Agentic and Generative AI "Productionised" experience.n
What You Will Do: n
Platform & Analytics Enablement
n
nEnable enterprise BI, analytics, and AI driven insights by delivering scalable, high‑quality data solutions that support retail trading, operational, and customer use cases.n
nBuild and optimise data pipelines and integrations that underpin reporting, advanced analytics, and AI/ML workloads.n
nEnsure analytics and reporting solutions are performant, secure, scalable, and fit for enterprise and retail decision making.n
Azure & Databricks Data Engineering
n
nDesign, develop, and evolve modern data engineering solutions on Microsoft Azure, with a strong focus on Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage (ADLS).n
nDevelop robust data transformations using PySpark, Databricks SQL, SQL, and Python.n
nDesign, implement,



and maintain curated analytical and dimensional data models aligned to retail BI, analytics, and AI requirements.n
BI & Semantic Layer Delivery
n
nDevelop, optimise, and support Power BI datasets, semantic models, and reports to deliver trusted, business ready insights.n
nAdminister Power BI environments, including workspace management, refresh orchestration, security, and access controls.n
nAlign BI solutions to best practice data modelling, performance optimisation, and usability standards.n
Production Support & Operational Excellence
n
nProvide BAU support across data platforms, pipelines, BI, and analytics solutions, including issue resolution and root cause analysis.n
nMonitor data platforms and pipelines, implementing logging, alerting, and performance tuning.n
nProactively identify and resolve data quality, availability, and performance issues in production environments.n
Engineering Standards, DevOps & Security
n
nImplement and maintain CI/CD pipelines for data and analytics solutions using Azure DevOps.n
nApply cloud security, authentication, and access control best practices across Azure data and analytics services.n
nContribute to design reviews, code reviews, and technical discussions to ensure robust, maintainable, and scalable solutions.n
nSupport the definition and continuous improvement of data engineering, analytics, and BI standards.n
Governance & Collaboration
n
nContribute to the design, adoption, and communication of data governance practices across the data platform.n




nPartner closely with retail business stakeholders to translate requirements into reliable technical solutions.n
nCollaborate with engineering, data science, infrastructure, and DevOps teams to deliver secure, production ready solutions.n
nBalance delivery across project initiatives and ongoing BAU activities within a complex retail data environment.n

n
What You Will Bring: n
n
nStrong hands on Data Engineering experience with SQL, Python, PySpark and Databricks SQL.n
nStrong experience designing and delivering data solutions on Microsoft Azure - Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS).n
nProven experience designing and building data warehouses and analytical data models, including scalable lakehouse and dimensional modelling patterns.n
nStrong understanding of data integration, analytics platforms, and reporting architectures in enterprise environments.n
nHands‑on experience administering and developing Power BI solutions, including Dataset and semantic model design, Strong DAX capability, Performance optimisation and governance.n
nExperience working in DevOps environments, including - CI/CD pipelines, Source control, Release and environment management.n
nGeneral understanding of cloud authentication, security, and access control concepts, including role‑based access and data security principles.n
nDemonstrated ability to deliver both project work and BAU/support, operating confidently in a production data and BI setting.n
nProven retail sector Data Engineering experience to Senior Data Engineer level.n
Why Join: n
nOpportunity to gain Agentic and Generative AI "Productionised" experience.n
nStrong Career Development.n
nAmazing culture with very little red tape.n
nIf you are a Lead Data Engineer with strong stakeholder management, who has experience in a fast-paced retail environment, and is outcome focussed we would love to hear from you. Apply now or reach out for a confidential conversation.

📌 Lead Data Engineer - Melbourne - $180,000 - Gain "productionised" AI
🏢 Morgan Consulting Idibu
📍 Melbourne