Role: Senior Data Engineer (Databricks) Experience Level: 7+ Years

Job Type
Full-time, Permanent

Location:
Client Site (On-site Brisbane) We are looking for a highly skilled Senior Databricks Data Engineer with strong hands-on experience in Databricks. The ideal candidate should have a solid background in designing, developing, and supporting enterprise data integration solutions, along with experience working in AWS cloud environments. This role requires someone who will balance core platform engineering with high-stakes Data Business as Usual (BAU) operations. This engineer will have strong expertise in managing, optimizing, and supporting enterprise data pipelines hosted on AWS (S3) and Databricks. A strong background in ITIL and ITSM frameworks is critical, as you will play a key role in ensuring SLA compliance, platform stability, incident resolution, and continuous improvement for production data ecosystems. Technical Competency & Requirements Data BAU, ITIL & ITSM (Critical)
• Strong hands-on experience in Data BAU operational support, managing production data pipelines, data freshness, and data quality alerts.
• In-depth understanding of ITIL frameworks and ITSM practices (Incident, Problem, Change, and Release management).
• Experience using ITSM ticketing tools (e.g., ServiceNow, Jira Service Management) to track SLAs,



manage high priority/impact incidents, and document RCAs. AWS & Databricks Ecosystem
• Hands-on experience with AWS services such as S3.
• Advanced proficiency in Databricks Development work using pyspark and including contemporary features: Unity Catalog, Delta Live Tables (DLT) i.e. lakeflow pipelines, Serverless compute, SQL Warehouse, Dashboarding, Alerting etc
• Good experience working with performance tuning using Liquid Clustering, Z-Ordering, and Spark query optimization.
• Practical experience of managing workloads with Databricks Asset Bundles (DABs). Data Ecosystem & Infrastructure
• Advanced experience with dbt (dbt Core or Cloud) for version-controlled data transformations.
• Kafka-based streaming data pipelines to support real-time and near real-time data integration requirements.
• Proven track record using Terraform for Infrastructure as Code (IaC) to provision AWS and Databricks resources.
• Production-grade experience with GitLab for source control and automated GitLab CI/CD pipelines.
• Valuable experience with unix/linux environment. Preferred
• Experience in the Airline/Aviation domain is highly preferred.
• Databricks certifications will be an added advantage.

📌 Senior Data Engineer (Brisbane)
🏢 Coforge
📍 Brisbane