20 Aug
|
Nameless
|
Queensland
20 Aug
Nameless
Queensland
Job Description
DATABRICKS CERTIFICATION IS ESSENTIAL & REQUIRED FOR THIS ROLE!!
n
IT IS ABSOLUTLEY ESSENTIAL THAT YOU HAVE SOLID CLIENT FACING DATABRICKS & DLT
n
We are looking for 3 Senior Azure candidates with expertise within Databricks to join our clients teams.
n
We have open Databricks roles with 3 different organisations.
n
We have 2 roles both in office and 1 role which is hybrid.
n
Assignments Summary
n
Design, develop, and maintain data platforms and governance frameworks with a strong focus on Databricks and Fabric, ensuring robust and secure data pipelines.
n
Main Responsibilities
n
n
Drive improvements of the Databricks platform setup for scalable and secure data solutions.
n
Design and implement governance models, catalogs, and metadata management.
n
Work with Databricks and related services including Delta Live Tables and Lakeflow connections.
n
Apply data modelling principles for analytical and operational workloads, including star and snowflake schemas.
n
Implement and manage Infrastructure as Code (IaC) solutions for Databricks.
n
Collaborate with stakeholders to translate requirements into governed data products.
n
n
Key Requirements
n
n
Bachelor's or Master's in Computer Science, Data Engineering, or equivalent experience.
n
Proficiency in Python, SQL, and Terraform (or equivalent IaC tools).
n
Fabric an advantage
n
Deep expertise in the Databricks platform, including Delta Lake and Unity Catalog.
n
Experience in Infrastructure as Code, automation, and CI/CD pipelines.
n
Knowledge of cloud technologies, preferably AWS.
n
Strong background in modeling structured and unstructured data.
n
A Grenadier attitude.
n
n
Infrastructure and DevOps
n
n
Lead and enforce the use of source control systems such as Git or Azure DevOps in line with company standards.
n
Design, implement, and maintain CI/CD pipelines and environment management processes for data engineering solutions.
n
Implement and maintain automated testing and data validation for pipelines.
n
Lead performance testing and optimisation activities for data engineering solutions.
n
n
Testing and Quality
n
n
Design, write, and review unit and integration tests to ensure solution quality and reliability.
n
Document issues and resolutions accurately for review•
n
Lead and oversee testing processes to validate data accuracy, performance, and quality.
n
Ensure solutions are delivered in line with quality and documentation standards.
n
Support knowledge sharing and improvement of internal frameworks and templates.
n
n
Nice to Have
n
n
Familiarity with high-performance data processing pipelines.
n
Experience with data visualisation tools.
n
#J-*****-Ljbffr
📌 Microsoft Data Engineer / Consultant (Queensland)
🏢 Nameless
📍 Queensland