Senior Data Engineer (Microsoft Fabric, PySpark, SQL) (City of Sydney)

Senior Data Engineer (Microsoft Fabric, PySpark, SQL) (City of Sydney)

17 Aug
|
Commonwealth Bank
|
City of Sydney

17 Aug

Commonwealth Bank

City of Sydney

Do Work That Matters

- Build a centralised, trusted data warehouse for internal technology insights using Microsoft Fabric.
- Own complex engineering work across PySpark, SQL, medallion architecture and source-system integration.
- Apply AI-powered engineering thoughtfully across coding, testing, deployment and documentation.

- Build a centralised, trusted data warehouse for internal technology insights using Microsoft Fabric.
- Own complex engineering work across PySpark, SQL, medallion architecture and source-system integration.
- Apply AI-powered engineering thoughtfully across coding, testing, deployment and documentation.

Be part of the team driving enterprise-wide transformation at CommBank. In End User Experience team, you’ll help bring data from internal technology sources into a centralised Microsoft Fabric warehouse, creating a controlled and reusable foundation for reporting, analytics and data sharing across the organisation.

See yourself in our team

You’ll join a team-oriented, Sydney-based team working across data engineering, analytics and business stakeholders. Your focus will be to design, build and improve scalable data solutions that turn complex source data into trusted, analytics-ready products.

- Design and build data ingestion and transformation workloads in Microsoft Fabric using PySpark and advanced SQL.
- Apply medallion architecture principles across Bronze, Silver and Gold layers to create governed, reusable data products.
- Connect to and ingest data from APIs, web services, relational databases, files, cloud storage and event-based sources.
- Design analytics-friendly data models, including facts, dimensions and curated datasets.
- Implement data quality checks, reconciliation controls, validation, monitoring and robust error handling.
- Translate business and technical requirements into data models,



business rules and practical engineering solutions.
- Use source control, automated testing, continuous integration and delivery practices, and clear technical documentation.
- Collaborate with engineers, analysts, BI developers, architects and stakeholders in an Agile delivery environment.

We’re interested in hearing from people who:

- Have strong hands-on experience with Microsoft Fabric, PySpark and advanced SQL.
- Have extensive experience applying medallion architecture to enterprise data solutions.
- Can develop and troubleshoot scalable ingestion, transformation and API-based integration patterns across multiple environments.
- Understand data modelling, data lineage, metadata management, data quality and reconciliation controls.
- Use generative AI and coding‑assistant tools responsibly, including model selection, prompt and context design, cost awareness, output evaluation, security and human review.
- Are familiar with Git, automated testing, continuous integration and delivery, and release management for data engineering solutions.
- Can gather requirements and translate them into durable data models, rules and engineering outcomes.
- Experience with T‑SQL and dynamic SQL is desirable

Working with us

At CommBank, we're committed to creating an accessible, inclusive and respectful workplace. If you require support or adjustments, please let us know. We welcome applications from people of all backgrounds and we're particularly committed to making a positive difference for Aboriginal and/or Torres Strait Islander Peoples. For support please contact

We’re aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on .

Advertising End Date: 22/08/2026

#J-18808-Ljbffr

📌 Senior Data Engineer (Microsoft Fabric, PySpark, SQL) (City of Sydney)
🏢 Commonwealth Bank
📍 City of Sydney

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer (microsoft fabric, pyspark, sql) (city of sydney) / city of sydney

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer (microsoft fabric, pyspark, sql) (city of sydney) / city of sydney