We are looking for a highly skilled
Senior Databricks Data Engineer
with strong hands-on experience in
Databricks
. The ideal candidate should have a solid background in designing, developing, and supporting enterprise data integration solutions, along with experience working in AWS cloud environments.
This role requires someone who will balance core platform engineering with high-stakes
Data Business as Usual (BAU)
operations. This engineer will have strong expertise in managing, optimizing, and supporting enterprise data pipelines hosted on
AWS (S3)
and
Databricks
. A strong background in
ITIL
and
ITSM
frameworks is critical, as you will play a key role in ensuring SLA compliance, platform stability, incident resolution, and continuous improvement for production data ecosystems.
Technical Competency & Requirements
Data BAU, ITIL & ITSM (Critical)
Strong hands-on experience in
Data BAU operational support
, managing production data pipelines, data freshness, and data quality alerts.
In-depth understanding of
ITIL frameworks
and
ITSM practices
(Incident, Problem, Change, and Release management).
Experience using ITSM ticketing tools (e.g., ServiceNow, Jira Service Management) to track SLAs, manage high priority/impact incidents, and document RCAs.




AWS & Databricks Ecosystem
Hands-on experience with
AWS services
such as S3.
Advanced proficiency in
Databricks Development
work using pyspark and including contemporary features:
Unity Catalog
,
Delta Live Tables (DLT) i.e. lakeflow pipelines
,
Serverless compute
, SQL Warehouse, Dashboarding, Alerting etc
Valuable experience working with performance tuning using
Liquid Clustering
, Z-Ordering, and Spark query optimization.
Practical experience of managing workloads with
Databricks Asset Bundles (DABs)
.
Data Ecosystem & Infrastructure
Advanced experience with
dbt
(dbt Core or Cloud) for version-controlled data transformations.
Kafka-based streaming data pipelines
to support real-time and near real-time data integration requirements.
Proven track record using
Terraform
for Infrastructure as Code (IaC) to provision AWS and Databricks resources.
Production-grade experience with
GitLab
for source control and automated
GitLab CI/CD
pipelines.
Good experience with unix/linux environment.
Preferred
Experience in the
Airline/Aviation domain
is highly preferred.
Databricks certifications will be an added advantage.
#J-*****-Ljbffr

📌 Senior Data Engineer (Brisbane)
🏢 Coforge
📍 Brisbane