25 Aug
|
Commbank
|
New South Wales
25 Aug
Commbank
New South Wales
Job Description
Build acentralised, trusted data warehouse for internal technology insights using Microsoft Fabric.
n
Own complex engineering work acrossPySpark, SQL, medallionarchitectureand source-system integration.
n
Apply AI-powered engineering thoughtfully across coding, testing,deploymentand documentation.
n
Do Work That Matters
n
Be part of the team driving enterprise-wide transformation at CommBank. In End User Experience team, you'll help bring data from internal technology sources into a centralized Microsoft Fabric warehouse, creating a controlled and reusable foundation for reporting, analytics and data sharing across the organisation.
n
See yourself in our team
n
You'll join a collaborative, Sydney-based team working across data engineering, analytics and business stakeholders. Your focus will be to design, build and improve scalable data solutions that turn complex source data into trusted, analytics-ready products.
n
Design and build data ingestion and transformation workloads in Microsoft Fabric using PySpark and advanced SQL.
n
Apply medallion architecture principles across Bronze, Silver and Gold layers to create governed, reusable data products.
n
Connect to and ingest data from APIs, web services, relational databases, files, cloud storage and event-based sources.
n
Design analytics-friendly data models, including facts, dimensions and curated datasets.
n
Implement data quality checks, reconciliation controls, validation, monitoring and robust error handling.
n
Translate business and technical requirements into data models, business rules and practical engineering solutions.
n
Use source control, automated testing, continuous integration and delivery practices,
and clear technical documentation.
n
Collaborate with engineers, analysts, BI developers, architects and stakeholders in an Agile delivery environment.
n
We're interested in hearing from people who:
n
Bring strong hands‐on data engineering experience and can work confidently across design, development, troubleshooting and optimisation. You'll combine technical depth with sound judgement, explicit documentation and a collaborative approach.
n
Have strong hands‐on experience with Microsoft Fabric, PySpark and advanced SQL.
n
Have extensive experience applying medallion architecture to enterprise data solutions.
n
Can develop and troubleshoot scalable ingestion, transformation and API‐based integration patterns across multiple environments.
n
Understand data modelling, data lineage, metadata management, data quality and reconciliation controls.
n
Use generative AI and coding‐assistant tools responsibly, including model selection, prompt and context design, cost awareness, output evaluation, security and human review.
n
Arefamiliar with Git, automated testing, continuous integration and delivery, and release management for data engineering solutions.
n
Can gather requirements and translate them into durable data models, rules and engineering outcomes.
n
Experience with T‐SQL and dynamic SQL is desirable.
n
Working with us:
n
At CommBank,we'recommitted to creating an accessible,inclusiveand respectful workplace.If you require support or adjustments, please let us know.We welcome applications from people of allbackgroundsandwe'reparticularly committed to making a positive difference for Aboriginal and/or Torres Strait Islander Peoples. Forsupportplease contact ******** ***.
#J-*****-Ljbffr
📌 Senior Data Engineer (Microsoft Fabric, Pyspark, Sql) (New South Wales)
🏢 Commbank
📍 New South Wales