Job Description

n

Delivery Centric is seeking a seasoned Databricks Tech Lead to design, build, and scale data ingestion and processing frameworks. The role will lead a team of data engineers, drive software engineering best practices, and developreusable, highly scalable pipelines to ingest and transform data from diverse enterprise sources into a Lakehouse platform.

Key Responsibilities n

n
Design and build metadata-driven, generic data ingestion frameworks supporting batch, streaming, and CDC to automate the onboarding of current data sources.
n
Define architectural standards for Medallion architecture (Bronze, Silver, Gold) using Delta Lake.
n
Optimise Spark jobs for performance, scalability, and cost efficiency across the Databricks platform.
n
Implement and mature CI/CD pipelines using Git and automated testing, while enforcing DataOps best practices.
n
Integrate data pipelines with Unity Catalog to support enterprise data governance and lineage.
n

Required Qualifications nn
8+ years of Data Engineering experience,



including 3–4 years of hands‑on technical leadership experience leading engineering teams or pods.
n
Advanced proficiency in PySpark and Databricks SQL, with strong hands‑on experience in Delta Lake and Unity Catalog.
n
Proven experience building custom or highly configurable data ingestion frameworks for structured and unstructured data.
n
Robust experience with AWS, Azure, or GCP cloud‑native services such as S3 or ADLS.
n
Deep understanding of data modelling, including star/snowflake schemas and SCD (Slowly Changing Dimensions), along with robust software engineering principles applied to data platforms.
n
Excellent stakeholder management skills and the ability to translate complex technical architectures into business value.
n

Preferred Qualifications nn
Experience with Kafka, dbt, or Delta Live Tables (DLT).
n
Databricks Certified Data Engineer Associate or Professional certification.
n

n
J-18808-Ljbffr

📌 Databricks Tech Lead Sydney
🏢 Delivery Centric
📍 Sydney