28 Oct
|
the original
|
Sydney
28 Oct
the original
Sydney
Make an impact with NTT DATA
Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it's a place where you can grow, belong and thrive.
We are seeking an experienced Data Engineer to join our Data & AI practice. You will design, build and optimize modern cloud data platforms, enabling organizations to unlock value from data through scalable analytics, reporting and AI solutions.
Working with a range of enterprise customers, you will develop robust data pipelines, data models and lakehouse solutions using Microsoft Azure and Microsoft Fabric technologies.
Key Responsibilities
Skills & Experience
Essential
Desirable
AI & Emerging Technologies (Advantageous)
Qualifications
Workplace type
About NTT DATA
NTT DATA is a $30+ billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. Our consulting and industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 70 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start‑up partners. NTT DATA is part of NTT Group, which invests over $3 billion each year in R&D.;
Equal Opportunity Employer
NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.
Opportunity to work with one of the largest and most advanced Data Engineering teams in the country.
As a Senior Data engineer with expertise in software development / programming and a passion for building data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies.
We are seeking people who are:
- Passionate about building next generation data platforms and data pipeline solution across the bank.
- Ready to execute state-of-the-art coding practices, driving high quality outcomes to solve core business objectives and minimise risks.
- Capable to create both technology blueprints and engineering roadmaps, for a multi- year data transformational journey.
- Are experienced in providing data driven solutions that source data from various enterprise data platform into Cloudera Hadoop Big Data environment, using technologies like Spark, MapReduce, Hive, Sqoop, Kafka; transform and process the source data to produce data assets; and transform and egression to other data platforms like Teradata or RDBMS system.
- Are experienced in building effective and efficient Big Data and Data Warehouse frameworks, capabilities, and features,
using common programming language (Scala, Java, or Python), with proper data quality assurance and security controls.
- Are experienced in designing, building, and delivering optimised enterprise-wide data ingestion, data integration and data pipeline solutions for Big Data and Data warehouse platforms.
- Are confident in building group data products or data assets from scratch, by integrating large sets of data derived from hundreds of internal and external sources.
- Can lead and mentor other data engineers in a project work or initiative.
- Have experience and responsible for data security and data management.
Technical skills
Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform. Preferably with at least 5+ years of hands‑on experience in a Data Engineering role.
Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing. Preferably with at least 5+ years of hands‑on experience.
Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python.
Proficient in SQL scripting, writing complex SQLs for building data pipelines.
Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
Experience in working in Agile teams, including working closely with internal business stakeholders.
Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus.
Certification on Cloudera CDP, Hadoop, Spark, Teradata, AWS, Ab Initio is a plus.
Experience in Ab Initio software products (GDE, Co>Operating System, Express>It, etc.) is a plus.
Experience in AWS technology (EMR, Redshift, DocumentDB, S3, etc.) is a plus.
You are passionate to stay ahead of the latest AWS Cloud, Gen AI, Data Lake, and Data Mesh technologies.
We are one of the largest and most advanced Data Engineering teams in the country.
Together we can build state-of-the-art data solutions that power seamless experiences for millions of customers.
Do work that matters:
As a Staff Data Engineer with expertise in software development / programming and a passion for building data-driven solutions, you are ahead of trends and work at the forefront of AWS Cloud, Data Mesh and AI technologies.
See yourself in our team:
Join the Business Banking (BB) Technology team at CommBank, where we are driving innovation through Digital and Gen AI platforms that empower our Business Bank customers.
Our team plays a pivotal role in delivering secure, reliable, and actionable data products. These assets support strategic decision-making, risk management, and customer success.
This is driven by critical data assets which is supported by the Data Engineering teams within the BB Technology who are responsible for ingesting data, creating ESDM aligned Data Products and creating reports which will help business produce strategies.
We are also interested in hearing from people who:
Think AI-first and are passionate about solving problems with intelligent data solutions.
Have a strong learning mindset and thrive in collaborative environments.
Champion a culture of quality, openness, and continuous improvement.
Design and build next-gen data platforms and pipelines using Python, PySpark, or Scala.
Integrate data from diverse sources into centralised lakes and cloud platforms.
Create technology blueprints and engineering roadmaps for long-term transformation.
Ensure data security, governance, and compliance.
Deliver end-to-end solutions that meet business needs and minimise risk.
Build high-quality, scalable data products from scratch.
Communicate effectively with stakeholders and contribute to team-wide engineering practices.
Define and evolve shared semantic models and metric definitions to ensure consistent meaning and reusable data across products and domains.
Drive adoption of catalogues, glossaries, and stewardship practices that promote discoverability, accountability, and self-service.
Embed policy‑as‑code for data access, classification, and retention ensuring compliance with internal and regulatory standards.
Implement automated testing, observability, and end-to-end lineage to improve data trust, traceability, and incident resolution speed.
Key Skills & Experience:
AWS Certified Data Engineer Associate with demonstrable experience in Data Engineering.
Data Processing: Robust expertise in Python, PySpark, SQL, Spark, Scala, and distributed data processing.
Experience in AWS data platforms (Glue, Lambda, Redshift, Athena, Kinesis, EMR).
Data Governance & Security: Experience with AWS DataZone, Lake Formation, IAM, encryption.
Experience in using AI Powered coding Assistants like Cline, Roo and Aider.
Marketplace & APIs: Exposure to AWS Marketplace, API Gateway, and data monetisation strategies.
Automation & CI/CD: Experience with Terraform, CloudFormation, GitOps, and serverless frameworks.
Performance Optimisation: Ability to fine‑tune ETL jobs, query performance, and cost efficiencies.
Experience with Snowflake, or Apache Iceberg.
Knowledge of data product thinking and data mesh principles.
Working with us
Whether you are passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you.
We support our people with the flexibility to balance where work is done with at least half your time each month connecting in our Sydney or Melbourne office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few.
If this sounds like you, apply today!
Apply now to bring your Foundry expertise to a team where you can shape engineering practices and deliver applications with operational impact.
---Technical Founder, AI‑Enabled Product & Data Engineering
---The deal, up front. Most founder conversations start with two questions...
...About Repeat Builders
---How to apply We don't yet know which of the 40 prototypes will be funded... (removed)
...Report Job (removed)
📌 Senior Data Visualisation Engineer (Temporary Opportunity For Up To 22 Months) (Sydney)
🏢 the original
📍 Sydney