Senior Databricks & AI Architect – Sydney

Delivery Centric is seeking a Senior Databricks & AI Architect to lead modern data platform and AI initiatives. The role focuses on scalable Spark architectures, FinOps and optimisation, and Agentic AI solutions for high-value insuranceprocesses such as claims, underwriting, and risk assessment.

Key Responsibilities

- Architectural Leadership:Design and govern end-to-end data architectures on theDatabricks Data Intelligence Platform, ensuring seamless integration with existing insurance ecosystems.
- AI Innovation:Lead the design of emerging AI workflows, specifically focusing onAgentic AI(multi-agent systems), LLM orchestration (LangChain/LlamaIndex), and RAG patterns tailored for insurance policyand regulatory documents.
- Databricks FinOps & Performance:Own the platform’s efficiency. Implement cluster policies, Photon engine optimisations, and cost-attribution models to ensure high performance with a focus on ROI.
- Data Engineering Excellence:Standardise data engineering templates (Medallion architecture) and implement robust data modelling (Star/Snowflake, Vault 2.0) to handle structured and unstructured insurancedata.




- Domain Alignment:Translate complex insurance concepts (Premiums, Claims, Actuarial models) into scalable technical schemas and AI logic.
- Governance & Security:Ensure all designs comply with industry regulations using DatabricksUnity Catalog.

Required Skills & Experience

- Experience:8+ years in Data Engineering/Architecture, with at least 3+ years of hands‑on leadership within theDatabricks ecosystem.
- Core Tech:Expert‑level knowledge of theSpark framework(PySpark/Scala), Delta Lake, and Databricks SQL.
- AI/ML Expertise:Proven experience building and deploying AI solutions. Deep understanding of theAgentic AIlandscape—moving beyond straightforward chatbots to autonomous, goal‑oriented agents.
- FinOps Mastery:Specific experience in Databricks cost management, instance selection, and performance tuning (Z-Ordering, Liquid Clustering).
- Data Management:Strong background in data modelling and the creation of reusable ETL/ELT templates and frameworks.
- Insurance Domain:Prior experience in the Insurance or FinServ sector is highly preferred; you must understand the nuances of policy‑centric data.

#J-18808-Ljbffr

📌 Senior Databricks & AI Architect – Sydney (City of Sydney)
🏢 Delivery Centric
📍 City of Sydney