11 Nov
|
Whizdom
|
Canberra
Seeking a Data Scientist with experience with Advanced skills in writing custom R functions.
The team seeks a skilled Data Scientist to assist with transitioning a complex microsimulation model into a robust, scalable, and well-governed production environment.
The production workplace is in Databricks and needs to support streamlined scenario testing input.
Advanced skills in writing custom R functions are essential for the successful candidate, as the microsimulation model is written in R with supporting pipelines in Python.
Key Responsibilities
- Conduct code analysis and peer review of a microsimulation model, including refactoring, optimisation, and ensuring code readiness for operational use.
- Optimise compute usage and improve performance across Spark jobs and model workloads.
- Maintain scalable data pipelines and workflows using Azure Databricks, Delta Lake, and related services.
- Implement best practice data engineering standards, including version control, testing frameworks, logging, monitoring, and error handling processes.
- Collaborate closely with other data scientists, analysts, engineers and domain experts to understand model structure and ensure accurate, performant implementation.
- Work with cloud and platform support teams to ensure the deployed product aligns with organisational standards, operational requirements,
and platform capabilities.
- Document workflows, architecture, model dependencies, and operational procedures.
Essential Skills
- Strong experience writing custom functions using R and the ability to understand complex code.
- Experience in delivering complex models into production, including validation and unit testing.
- Demonstrated capability in designing and implementing scenario testing methodologies and repeatable testing processes.
- Proficiency in Spark and related data engineering technologies, with experience optimising computational performance and scalability for large-scale data processing.
- Solid understanding of software engineering practices, including automated testing, modular code design, and version control.
- Ability to work collaboratively with technical and non-technical stakeholders.
Desirable skills
- Familiarity with Azure Data Factory, Azure Storage, or Unity Catalog.
- Experience working with labour market data, ABS reports and ABS TableBuilder.
- Experience in the public sector or a regulated environment.
Contract
7 Months Contract
Security Required
BaselineSecurity clearance required
Location
Canberra, Sydney, Melbourne, Adelaide, Perth, Hobart and Brisbane
Closing date
Friday 13 November 2026
#J-18808-Ljbffr
📌 Data Scientist (Canberra)
🏢 Whizdom
📍 Canberra