17 Aug
|
Synechron
|
Sydney
We are seeking experienced Data Engineers to design, build, and support scalable cloud-based data solutions. The role will involve developing modern data pipelines, ETL/ELT frameworks, and data integration solutions using Snowflake, DBT, AWS, Python, and SQL.
The ideal candidate will have strong hands-on experience building and operating data platforms, transforming data from multiple sources, implementing robust data quality controls, and developing data models that support analytics and business reporting. Candidates should be self-starters who can work independently, contribute to solution design, and ensure security and governance standards are maintained.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Snowflake, DBT, AWS, and Python.
- Build and optimize data models, transformations, and orchestration workflows.
- Develop frameworks to ingest data from databases, APIs, flat files, CSVs, and other enterprise data sources.
- Create reusable and automated data transformation processes using DBT.
- Design and implement Snowflake data warehouses, schemas, tables, views, and performance optimization strategies.
- Develop data quality, validation, reconciliation, and monitoring solutions.
- Implement secure data movement and integration patterns across cloud and on-premise systems.
- Work closely with business stakeholders, architects, analysts, and downstream consumers to understand requirements and deliver scalable solutions.
- Support deployment and release activities across development, test, and production environments.
- Ensure compliance with security, governance, and PII data protection requirements.
- Troubleshoot and resolve production data issues while maintaining high availability and reliability.
Mandatory Skills & Experience
Technical Skills
- Strong experience with Snowflake Data Cloud.
- Hands-on expertise in DBT (Data Build Tool) for transformations and data modeling.
- Solid experience with AWS services including:
- S3
- Lambda
- Glue
- IAM
- CloudWatch
- Step Functions (preferred)
- Advanced SQL development and query optimization skills.
- Strong Python programming experience for data engineering and automation.
- Experience building enterprise ETL/ELT pipelines.
- Experience working with structured and semi-structured data (JSON, XML, CSV).
- Knowledge of data governance, security, and access management.
- Experience in CI/CD and DevOps practices for data platforms.
Snowflake Expertise
- Snowflake architecture and administration.
- Snowpipe, Streams & Tasks.
- Data sharing and secure views.
- Performance tuning and query optimization.
- Role-based access controls (RBAC).
- Data ingestion and transformation frameworks.
DBT Expertise
- DBT models and macros.
- Incremental loading strategies.
- Data testing and validation.
- Source-to-target mapping.
- Documentation and lineage.
- CI/CD integration with DBT.
Desirable Skills
- Experience with Airflow, Prefect, or similar orchestration tools.
- Knowledge of data lake and lakehouse architectures.
- Experience with AI-assisted development tools such as:
- Claude Code
- GitHub Copilot
- Amazon Q
- Experience within Banking, Financial Services, or regulated environments.
- Exposure to real-time and streaming data solutions.
📌 Data Engineer (Snowflake, DBT & AWS) (Sydney)
🏢 Synechron
📍 Sydney