12 Aug
|
CSK Nexus
|
Melbourne
12 Aug
CSK Nexus
Melbourne
We are seeking a highly skilledData Engineer to support large‑scaledata migration and ongoing data platform development within our AWS cloud environment. This role requires deep expertise inrelational databases, Amazon Redshift, PostgreSQL, Python, SQL , and secureaccess management for large user groups. You will work across manual data operations, automated pipelines, and deployment processes to ensure reliable, scalable, and secure data delivery.
Key Responsibilities
- Design and implementETL/ELT pipelines for structured and semi‑structured data.
- Optimise schemas, queries, and data models for performance and scalability.
- Validate, reconcile, and troubleshoot data quality issues during and after migration.
- Build and maintain data solutions using AWS services such asS3, Redshift, RDS/Postgres, IAM, Lambda, Glue, EC2 .
- Ensure secure and efficient data storage, access patterns, and cross‑service integrations.
- Support workplace setup, configuration, and cloud deployments.
- ManageIAM roles, policies, permission boundaries , and database‑level access for large user groups.
- Implement governance, auditing, and compliance controls across AWS and database environments.
- Maintain secure, scalable access models for analysts, engineers, and business users.
- Write high‑qualityPython andSQL for data processing, validation, and automation.
- Automate manual workflows, data operations, and deployment processes using scripts or orchestration tools.Support CI/CD pipelines and version‑controlled deployment practices.
- Build reusable frameworks for ingestion, quality checks, and monitoring.
- Support production systems, troubleshoot incidents, and optimise performance.
- Maintain documentation, runbooks, and operational standards.
- Collaborate with cross‑functional teams including analysts, product teams, and engineering groups.
About the Role
We are seeking a highly skilledData Engineer to support large‑scaledata migration and ongoing data platform development within our AWS cloud environment. This role requires deep expertise inrelational databases, Amazon Redshift, PostgreSQL, Python, SQL , and secureaccess management for large user groups. You will work across manual data operations, automated pipelines, and deployment processes to ensure reliable, scalable, and secure data delivery.
Key Responsibilities
- Lead end‑to‑enddata migration initiatives across relational databases, Redshift, and PostgreSQL.
- Design and implementETL/ELT pipelines for structured and semi‑structured data.
- Optimise schemas, queries, and data models for performance and scalability.
- Validate, reconcile, and troubleshoot data quality issues during and after migration.
- Build and maintain data solutions using AWS services such asS3, Redshift, RDS/Postgres, IAM, Lambda, Glue, EC2 .
- Ensure secure and efficient data storage, access patterns, and cross‑service integrations.
- Support environment setup, configuration, and cloud deployments.
- ManageIAM roles, policies, permission boundaries , and database‑level access for large user groups.
- Implement governance, auditing,
and compliance controls across AWS and database environments.
- Maintain secure, scalable access models for analysts, engineers, and business users.
- Write high‑qualityPython andSQL for data processing, validation, and automation.
- Automate manual workflows, data operations, and deployment processes using scripts or orchestration tools.Support CI/CD pipelines and version‑controlled deployment practices.
- Build reusable frameworks for ingestion, quality checks, and monitoring.
- Support production systems, troubleshoot incidents, and optimise performance.
- Maintain documentation, runbooks, and operational standards.
- Collaborate with cross‑functional teams including analysts, product teams, and engineering groups.
Skills & Experience
Essential
- Strong experience as aData Engineer working in AWS cloud environments.
- Advanced proficiency inPython andSQL .
- Hands‑on experience withRedshift ,PostgreSQL , and relational database migration.
- Experience managingIAM and multi‑user access models.
- Experience withdeployments , environment management, and CI/CD workflows.
- Ability to work with bothmanual data processes andautomated pipelines .
- Strong understanding of ETL/ELT concepts, data modelling, and performance tuning.
Desirable
- Experience with AWS Glue, Step Functions, Airflow, or similar orchestration tools.
- Familiarity with Terraform or CloudFormation.
- Knowledge of data governance, metadata management, and lineage tools.
To be eligible to apply, you must be an Australian / New Zealand citizen or hold permanent residency status in Australia. Please only apply if you meet the above skills
#J-18808-Ljbffr
📌 Data Engineer (Melbourne)
🏢 CSK Nexus
📍 Melbourne