Urgent requirement of Data Migration Architect - Contract - Sydney

Requirements

- Seeking a highly experienced Data Migration Architect to lead the end-to-end migration of enterprise data workloads from Greenplum to Databricks.

- The ideal candidate will have deep expertise in legacy data warehouse systems, contemporary cloud data platforms, and data migration strategies.

- This role involves architecture design, planning, execution, and optimization of scalable data pipelines and transformation logic.

Key Responsibilities:

- Design and implement a robust data migration strategy from Greenplum to Databricks.

- Assess existing Greenplum schemas, workloads, and performance characteristics.

- Define target architecture in Databricks including Lakehouse design, Delta tables, and optimized storage formats.

- Develop scalable ETL/ELT pipelines using PySpark, SQL, and Databricks workflows.

- Ensure data integrity, consistency, and performance during migration.

- Collaborate with data engineers, analysts, and business stakeholders to validate migrated data.

- Implement monitoring, logging, and rollback mechanisms for migration processes.





- Document migration processes, architecture decisions, and operational runbooks.

- Lead large scale data migration with complex workflows & varied data types complexity for migration.

Required Skills and Qualifications:

- 10+ years of experience in data engineering or data architecture roles.

- Proven experience with Greenplum (PostgreSQL-based MPP systems) to Databricks experience – 2 or more projects.

- Strong hands-on experience with Databricks, Apache Spark, and Delta Lake.

- Proficiency in SQL, Python, and PySpark.

- Experience with AWS cloud platform.

- Familiarity with data governance, security, and compliance in cloud environments.

- Excellent problem-solving and communication skills.

- Certifications in Databricks or cloud platforms (Azure/AWS/GCP) is preferable

- Experience with orchestration tools like Airflow is preferred

Duration: 06 Months and possible extension

Eligibility: Australian/NZ Citizens/PR Holders only

Email: [email protected]

📌 Data Migration Architect - Contract - Sydney
🏢 Leading
📍 Sydney