28 Aug
|
Synechron
|
New South Wales
28 Aug
Synechron
New South Wales
Job Description
We are seeking experienced Data Engineers to design, build, and support scalable cloud-based data solutions. The role will involve developing modern data pipelines, ETL/ELT frameworks, and data integration solutions using Snowflake, DBT, AWS, Python, and SQL.
n
The ideal candidate will have strong hands-on experience building and operating data platforms, transforming data from multiple sources, implementing robust data quality controls, and developing data models that support analytics and business reporting. Candidates should be self-starters who can work independently, contribute to solution design, and ensure security and governance standards are maintained.
n
Key Responsibilities
n
n
- Design, develop, and maintain scalable ETL/ELT pipelines using Snowflake, DBT, AWS, and Python.
n
- Build and optimize data models, transformations, and orchestration workflows.
n
- Develop frameworks to ingest data from databases, APIs, flat files, CSVs, and other enterprise data sources.
n
- Create reusable and automated data transformation processes using DBT.
n
- Design and implement Snowflake data warehouses, schemas, tables, views, and performance optimization strategies.
n
- Develop data quality, validation, reconciliation, and monitoring solutions.
n
- Implement secure data movement and integration patterns across cloud and on-premise systems.
n
- Work closely with business stakeholders, architects, analysts, and downstream consumers to understand requirements and deliver scalable solutions.
n
- Support deployment and release activities across development, test, and production environments.
n
- Ensure compliance with security, governance, and PII data protection requirements.
n
- Troubleshoot and resolve production data issues while maintaining high availability and reliability.
n
n
Mandatory Skills & Experience
n
Technical Skills
n
n
- Robust experience with Snowflake Data Cloud.
n
- Hands-on expertise in DBT (Data Build Tool) for transformations and data modeling.
n
- Strong experience with AWS services including:
n
- S3
n
- Lambda
n
- Glue
n
- IAM
n
- CloudWatch
n
- Step Functions (preferred)
n
- Advanced SQL development and query optimization skills.
n
- Strong Python programming experience for data engineering and automation.
n
- Experience building enterprise ETL/ELT pipelines.
n
- Experience working with structured and semi-structured data (JSON, XML, CSV).
n
- Knowledge of data governance, security, and access management.
n
- Experience in CI/CD and DevOps practices for data platforms.
n
n
Snowflake Expertise
n
n
- Snowflake architecture and administration.
n
- Snowpipe, Streams & Tasks.
n
- Data sharing and secure views.
n
- Performance tuning and query optimization.
n
- Role-based access controls (RBAC).
n
- Data ingestion and transformation frameworks.
n
n
DBT Expertise
n
n
- DBT models and macros.
n
- Incremental loading strategies.
n
- Data testing and validation.
n
- Source-to-target mapping.
n
- Documentation and lineage.
n
- CI/CD integration with DBT.
n
- Experience with Airflow, Prefect, or similar orchestration tools.
n
- Knowledge of data lake and lakehouse architectures.
n
- Experience with AI-assisted development tools such as:
n
- Amazon Q
n
- Experience within Banking, Financial Services, or regulated environments.
n
- Exposure to real-time and streaming data solutions.
n
n
#J-18808-Ljbffr
📌 Data Engineer (Snowflake, DBT & AWS) (New South Wales)
🏢 Synechron
📍 New South Wales