19 Aug
|
Hastha Solutions
|
Sydney
19 Aug
Hastha Solutions
Sydney
Urgent requirement of
Data Migration Architect - Contract - Sydney
Requirements
Seeking a highly experienced Data Migration Architect to lead the end-to-end migration of enterprise data workloads from Greenplum to Databricks.
The ideal candidate will have deep expertise in legacy data warehouse systems, contemporary cloud data platforms, and data migration strategies.
This role involves architecture design, planning, execution, and optimization of scalable data pipelines and transformation logic.
Key Responsibilities:
Design and implement a robust data migration strategy from Greenplum to Databricks.
Assess existing Greenplum schemas, workloads, and performance characteristics.
Define target architecture in Databricks including Lakehouse design, Delta tables, and optimized storage formats.
Develop scalable ETL/ELT pipelines using PySpark, SQL, and Databricks workflows.
Ensure data integrity, consistency, and performance during migration.
Collaborate with data engineers, analysts, and business stakeholders to validate migrated data.
Implement monitoring, logging, and rollback mechanisms for migration processes.
Document migration processes, architecture decisions, and operational runbooks.
Lead large scale data migration with complex workflows & varied data types complexity for migration.
Required Skills and Qualifications:
10+ years of experience in data engineering or data architecture roles.
Proven experience with Greenplum (PostgreSQL-based MPP systems) to Databricks experience – 2 or more projects.
Strong hands-on experience with Databricks, Apache Spark, and Delta Lake.
Proficiency in SQL, Python, and PySpark.
Experience with AWS cloud platform.
Familiarity with data governance, security, and compliance in cloud environments.
Excellent problem-solving and communication skills.
Certifications in Databricks or cloud platforms (Azure/AWS/GCP) is preferable
Experience with orchestration tools like Airflow is preferred
Duration: 06 Months
and possible extension
Eligibility:
Australian/NZ Citizens/PR Holders only
Email:
******
📌 Data Migration Architect - Contract - Sydney
🏢 Hastha Solutions
📍 Sydney