25 Aug
|
Calleo
|
Victoria
Job Description
We are seeking an experienced Lead Data Engineer to join a major Federal Government program focused on delivering modern, enterprise-scale data capabilities.
n
This role will play a key part in designing, building and optimising data platforms that support analytics, reporting, artificial intelligence and business decision-making. Working within a complex and regulated environment, you'll help drive the organisation's data transformation journey through the use of modern cloud technologies including Databricks and Microsoft Fabric.
n
Key Responsibilities:
n
n
Design, develop and maintain enterprise-scale data pipelines and integration solutions
n
Build and optimise modern Lakehouse and data warehouse architectures
n
Develop data transformation processes using Databricks, Microsoft Fabric and cloud technologies
n
Implement data governance, quality, security and monitoring capabilities
n
Support analytics, reporting, AI and machine learning initiatives
n
Collaborate with stakeholders to deliver scalable and sustainable data solutions
n
Provide technical leadership, mentoring and continuous improvement initiatives
n
n
Job Description
n
We are seeking an experienced Lead Data Engineer to join a major Federal Government program focused on delivering modern, enterprise-scale data capabilities.
n
This role will play a key part in designing, building and optimising data platforms that support analytics, reporting, artificial intelligence and business decision-making. Working within a complex and regulated environment, you'll help drive the organisation's data transformation journey through the use of modern cloud technologies including Databricks and Microsoft Fabric.
n
Key Responsibilities:
n
n
Design, develop and maintain enterprise-scale data pipelines and integration solutions
n
Build and optimise modern Lakehouse and data warehouse architectures
n
Develop data transformation processes using Databricks, Microsoft Fabric and cloud technologies
n
Implement data governance, quality, security and monitoring capabilities
n
Support analytics, reporting, AI and machine learning initiatives
n
Collaborate with stakeholders to deliver scalable and sustainable data solutions
n
Provide technical leadership, mentoring and continuous improvement initiatives
n
n
Technical Skills & Experience:
n
n
Strong experience with Databricks and/or Microsoft Fabric environments
n
Advanced skills in Python, SQL, PySpark and Spark SQL
n
Experience building and supporting data pipelines, data lakes and Lakehouse solutions
n
Knowledge of Delta Lake, Databricks Workflows, Unity Catalog or Microsoft Fabric services
n
Experience with Azure technologies including Data Factory, ADLS Gen2 or Fabric
n
Strong understanding of DevOps, CI/CD, automation and Infrastructure as Code practices
n
Knowledge of data governance, security and data quality frameworks
n
n
What's on Offer:
n
n
12-month contract with 2 x 12-month extension options
n
Hybrid working arrangements across multiple Australian locations
n
Opportunity to work on large-scale data transformation initiatives
n
Exposure to Databricks, Microsoft Fabric and up-to-date cloud technologies
n
Collaborative team environment focused on innovation and continuous improvement
n
Opportunity to contribute to national data, analytics and AI capabilities
n
n
Due to the nature of this role, this opportunity is open to Australian Citizens only. Candidates who hold a Baseline Security Clearance (or above) areprefered.
n
Calleo is an equal opportunity employer and we encourage applications from all people including Aboriginal and Torres Strait Islander peoples.
#J-*****-Ljbffr
📌 Lead Data Engineer (Victoria)
🏢 Calleo
📍 Victoria