29 Aug
|
Digital Bay
|
Sydney
29 Aug
Digital Bay
Sydney
Role Description
We are seeking a skilled and analytical Data Engineer to design, develop, and maintain reliable data infrastructure and pipelines that support business intelligence, analytics, and data-driven applications. The role involves collecting, transforming, integrating, and optimizing data from multiple sources while ensuring data quality, availability, scalability, and security.
Key responsibilities include developing and maintaining ETL/ELT pipelines, designing data models and storage solutions, integrating structured and unstructured data sources, optimizing data processing workflows, and implementing data quality and validation processes. The role also involves collaborating with data analysts, data scientists, software developers, and business teams to understand data requirements and deliver productive solutions. The successful candidate will contribute to data architecture improvements, automation, monitoring, and documentation of data systems.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering,
Software Engineering, or a related technical field.
- Strong understanding of data structures, databases, data modeling, and data processing concepts.
- Proficiency in SQL and programming languages such as Python, Java, or Scala.
- Familiarity with ETL/ELT processes, data pipelines, APIs, and workflow orchestration.
- Knowledge of relational and NoSQL databases such as PostgreSQL, MySQL, MongoDB, or similar technologies.
- Familiarity with cloud data platforms such as AWS, Microsoft Azure, or Google Cloud is an advantage.
- Understanding of data warehousing, data lakes, distributed systems, and big data technologies is desirable.
- Strong analytical and problem-solving skills with excellent attention to detail.
- Familiarity with Git, CI/CD, testing, monitoring, and data quality practices.
- Ability to communicate technical concepts clearly and collaborate effectively with cross-functional teams.
📌 Data Enginer (Sydney)
🏢 Digital Bay
📍 Sydney