Job Description
14h ago , from Nixil Information and Communications Technology Consulting
n
Hadoop Migration | Banking Modernisation Program
n
We are seeking an experienced Data Engineer to support a major banking data modernisation program, migrating existing Hadoop data workloads and pipelines to AWS and Snowflake.
n
This is a hands-on engineering role focused on building reliable data pipelines, transforming and migrating complex datasets, and delivering secure, scalable and production-ready data solutions within a highly regulated banking workplace.
n
What You'll Do
n
n
Analyse existing Hadoop datasets, pipelines, transformations, dependencies and workload characteristics.
n
Build and migrate batch, incremental and near-real-time data pipelines into AWS and Snowflake.
n
Develop ingestion, transformation and integration solutions across raw/landing, curated and business-consumption layers.
n
Re-engineer Hadoop-based workloads into scalable cloud-native data solutions.
n
Develop Snowflake databases, schemas, tables, views, stages, Snowpipe, Streams and Tasks.
n
Implement ETL/ELT pipelines and enterprise data models supporting analytics and reporting.
n
Perform data profiling, cleansing, validation, reconciliation and migration testing.
n
Implement data quality, lineage, metadata and governance requirements.
n
Apply security controls including IAM/RBAC, encryption, masking, privacy and audit logging.
n
Optimise Snowflake queries, warehouse sizing, workload performance and consumption costs.
n
Build automated CI/CD and DataOps deployment processes.
n
Implement monitoring, alerting, logging and operational-support capabilities.
n
Produce technical designs, data mappings, pipeline documentation and operational runbooks.
n
Work closely with data architects, AWS and Snowflake specialists, security teams, analysts and managed-service teams.
n
n
What You'll Bring
n
n




Strong hands-on data engineering experience with Snowflake and AWS.
n
Experience migrating Hadoop-based data platforms, datasets and pipelines to cloud environments.
n
Strong Snowflake development skills across databases, schemas, warehouses, tables, views, stages, Snowpipe, Streams and Tasks.
n
Strong experience building batch, incremental and near-real-time ingestion pipelines.
n
Advanced SQL skills and experience with Python, PySpark or similar data engineering technologies.
n
Strong knowledge of ETL/ELT, data integration, data warehousing and lake/lakehouse concepts.
n
Experience with dimensional and relational modelling, curated data products and semantic layers.
n
Experience with AWS data ingestion, storage, processing and integration services.
n
Knowledge of Hadoop technologies such as HDFS, Hive, Spark and related ecosystem tools.
n
Experience with data quality, reconciliation, metadata, lineage, cataloguing and governance.
n
Knowledge of IAM/RBAC, encryption, masking, privacy controls and secure data engineering.
n
Experience with Git, CI/CD, DataOps and automated testing and deployment.
n
Strong Snowflake performance optimisation and cloud cost-management skills.
n
Experience delivering production monitoring, observability, operational readiness and support documentation.
n
Banking, financial services or highly regulated enterprise experience is strongly preferred.
n
Snowflake and AWS data engineering certifications are highly regarded.
n
Experience with Power BI consumption patterns, enterprise semantic models or data-governance platforms would be advantageous.
n
n
Why Apply?
n
This is an opportunity to contribute to a significant Hadoop-to-AWS-and-Snowflake transformation, solve complex data engineering challenges and help build a modern enterprise data platform within a major banking environment.
n
If you are a hands-on Data Engineer with strong Snowflake, AWS and data migration experience, we would welcome your application.
#J-*****-Ljbffr

📌 Data Engineer - Aws & Snowflake (Victoria)
🏢 Nixil
📍 Victoria