Job Description

n

Delivery Centric is seeking a seasoned Databricks Tech Lead to design, build, and scale data ingestion and processing frameworks. The role will lead a team of data engineers, drive software engineering best practices, and developreusable, highly scalable pipelines to ingest and transform data from diverse enterprise sources into a Lakehouse platform.

Key Responsibilities n

n
- Design and build metadata-driven, generic data ingestion frameworks supporting batch, streaming, and CDC to automate the onboarding of new data sources.
n
- Define architectural standards for Medallion architecture (Bronze, Silver, Gold) using Delta Lake.
n
- Optimise Spark jobs for performance, scalability, and cost efficiency across the Databricks platform.
n
- Implement and mature CI/CD pipelines using Git and automated testing, while enforcing DataOps best practices.
n
- Integrate data pipelines with Unity Catalog to support enterprise data governance and lineage.
n

Required Qualifications nn
- 8+ years of Data Engineering experience,



including 3–4 years of hands‑on technical leadership experience leading engineering teams or pods.
n
- Advanced proficiency in PySpark and Databricks SQL, with strong hands‑on experience in Delta Lake and Unity Catalog.
n
- Proven experience building custom or highly configurable data ingestion frameworks for structured and unstructured data.
n
- Strong experience with AWS, Azure, or GCP cloud‑native services such as S3 or ADLS.
n
- Deep understanding of data modelling, including star/snowflake schemas and SCD (Slowly Changing Dimensions), along with robust software engineering principles applied to data platforms.
n
- Excellent stakeholder management skills and the ability to translate complex technical architectures into business value.
n

Preferred Qualifications nn
- Experience with Kafka, dbt, or Delta Live Tables (DLT).
n
- Databricks Certified Data Engineer Associate or Professional certification.
n

n

#J-18808-Ljbffr

📌 Databricks Tech Lead - Sydney
🏢 Delivery Centric
📍 Sydney