25 Sep
|
Precision Sourcing
|
New South Wales
25 Sep
Precision Sourcing
New South Wales
Job Description
n
We are implementing a contemporary data and analytics platform to strengthen data quality, governance, automation, and insight generation across our insurance and broader enterprise reporting functions. We operate in a regulated, high-sensitivity environment and are building sustainable internal capability to operate and extend our data solutions over time.
n
This is a hands-on technical role contributing directly to our Databricks platform implementation. You will work alongside engineering, architecture, and data governance colleagues, collaborating across actuarial, IT, security, and implementation partners.
n
The Responsibilities
n
n
- Contribute to day-to-day technical delivery across actuarial, business, IT, and vendor stakeholders.
n
- Build and maintain Databricks pipelines, notebooks, Unity Catalog configurations, orchestration workflows, and performance optimisations.
n
- Support migration of priority data assets, processing logic, and analytics code into Databricks.
n
- Develop reusable patterns that support maintainability, governance, auditability, and performance.
n
- Apply governance practices: version control, code review, CI/CD, access control, data quality checks, and documentation standards.
n
- Adhere to and contribute to standards for open source, libraries, and third-party components including security and licensing compliance.
n
- Participate in technical reviews of key artefacts; support management of technical debt and BAU readiness.
n
- Contribute to knowledge sharing and capability building to reduce reliance on external vendors.
n
n
The Requirements
n
n
- Solid Databricks / Spark delivery in production: pipeline build, orchestration, performance tuning, and operationalisation.
n
- Exposure to data governance practices: RBAC, audit logging, lineage, data quality gates, and change control.
n
- Experience working in a regulated or high-sensitivity data environment with strong security discipline.
n
- Ability to collaborate effectively in co-delivery models with vendors and internal teams.
n
- Strong SQL and Python (including PySpark); solid software engineering discipline including Git, PR/code review, and CI/CD.
n
n
To be considered for this position, you must have real world working experience in Databricks - only those who have the same will be considered.
n
NB: **This position requires you to be an Australian Citizen & living in Sydney**
n
#J-18808-Ljbffr
📌 Data Engineer - Databricks (New South Wales)
🏢 Precision Sourcing
📍 New South Wales