About the job Data Engineer

- Technical expertise with data models, data mining, and segmentation techniques. Previous experience as a data engineer or in a similar role.
- Experience with deploying machine learning models to production environment. Experience with object-oriented/object function scripting using Python
- Experience with relational SQL and NoSQL databases
- Ability to interact and communicate with the data scientists to understand their data needs.
- Experience with MLOps Architectures and Tools
- PySpark, Scala, Hadoop, Kafka, SAS (Ideal to have)
- Degree in Computer Science, IT, or similar field
- Receiving handover of the existing Feature Repository from Region and establishing a framework and environment where it can be run locally onshore.
- Validating, Deploying and maintaining existing feature repository so it can be leveraged by machine learning models.




- Working with the data scientists in the team to understand what features they would like to include in their ML models.
- Data mining and discovery to create the new features which can be leveraged by the data scientists in their ML models.
- Deployment of any current models built by the data scientists into the production environment.
- Maintaining the data quality, reliability and accuracy of any features deployed into production on an ongoing basis.
- Help setup data tools and data pipelines for analytics and data scientist team members that assist them in model development
- Work with reporting team to understand the requirement from reporting perspective and accordingly maintain and enhance data layer

📌 Data Engineer (New South Wales)
🏢 Pyramid Global Technologies
📍 New South Wales