27 Aug
|
SKL Technology
|
Sydney
27 Aug
SKL Technology
Sydney
Lead Data Engineer
Location: QLD, ACT, VIC, NSW, SA
12 months contract with 1 extension
Australian Citizenship is required
About the Role
We are seeking an experienced EL1 Data Acquisition Engineer / Senior Data Engineer to join a major enterprise data warehouse program.
This is a senior, hands-on position combining data engineering, technical leadership, data modelling, SQL/ETL development and delivery governance. You will provide technical guidance to developers, review data designs and models, and help mature data engineering and release practices.
Key Responsibilities
- Provide technical leadership to data delivery teams through design reviews, technical workshops and implementation guidance.
- Design and implement the acquisition and integration of new data sources into the enterprise data platform.
- Review and improve data delivery frameworks to increase performance, scalability and speed of delivery.
- Own technical implementation of current data from analysis through to production delivery.
- Develop and maintain complex SQL, analytical and ETL code.
- Design and maintain data dictionaries, data models and technical documentation.
- Review and approve data designs, models and development approaches.
- Define and improve release processes, coding standards and development best practices.
- Conduct peer reviews and knowledge-transfer sessions for developers.
- Analyse, understand and estimate complex user requirements.
- Manage and prioritise technical work items.
- Work closely with data consumers, database developers, testers and IT support teams.
- Drive continuous improvement across development, documentation, data modelling and delivery practices.
Essential Skills & Experience
- 5 year experience in Snowflake and AWS
- Strong experience with at least 2 of the following data warehouse/platform technologies- MS SQL Server, Teradata ,Amazon Redshift, Databricks
- Advanced SQL development skills, including the ability to analyse and reverse-engineer complex SQL.
- Strong programming capability with languages such as Python, SAS, R or Java.
- Strong understanding of ETL/data integration development.
- Ability to read, interpret and review data models and technical specifications.
- Experience reviewing/auditing data engineering code.
- Good understanding of DevOps processes and tools.
- Strong knowledge of version control and appropriate development practices.
- Ability to provide technical guidance, peer reviews and mentoring to other developers.
Highly Desirable
- Experience with AWS cloud data technologies, including AWS S3 and AWS Glue or similar.
- Experience with SAS and Excel.
- Experience with metadata/model-driven data modelling frameworks.
- Previous experience working with large-scale enterprise data warehouse environments.
📌 Lead Data Engineer (Sydney)
🏢 SKL Technology
📍 Sydney