Job Description

We are seeking an experienced Lead Data Engineer to join a major Federal Government program focused on delivering modern, enterprise-scale data capabilities.

n

This role will play a key part in designing, building and optimising data platforms that support analytics, reporting, artificial intelligence and business decision-making. Working within a complex and regulated environment, you'll help drive the organisation's data transformation journey through the use of modern cloud technologies including Databricks and Microsoft Fabric.

n

Key Responsibilities:

n

n
- Design, develop and maintain enterprise-scale data pipelines and integration solutions
n
- Build and optimise modern Lakehouse and data warehouse architectures
n
- Develop data transformation processes using Databricks, Microsoft Fabric and cloud technologies
n
- Implement data governance, quality, security and monitoring capabilities
n
- Support analytics, reporting, AI and machine learning initiatives
n
- Collaborate with stakeholders to deliver scalable and sustainable data solutions
n
- Provide technical leadership, mentoring and continuous improvement initiatives
n

n

Job Description

n

We are seeking an experienced Lead Data Engineer to join a major Federal Government program focused on delivering modern, enterprise-scale data capabilities.

n

This role will play a key part in designing, building and optimising data platforms that support analytics, reporting, artificial intelligence and business decision-making. Working within a complex and regulated environment, you'll help drive the organisation's data transformation journey through the use of modern cloud technologies including Databricks and Microsoft Fabric.

n

Key Responsibilities:

n

n
- Design, develop and maintain enterprise-scale data pipelines and integration solutions
n




- Build and optimise contemporary Lakehouse and data warehouse architectures
n
- Develop data transformation processes using Databricks, Microsoft Fabric and cloud technologies
n
- Implement data governance, quality, security and monitoring capabilities
n
- Support analytics, reporting, AI and machine learning initiatives
n
- Collaborate with stakeholders to deliver scalable and sustainable data solutions
n
- Provide technical leadership, mentoring and continuous improvement initiatives
n

n

Technical Skills & Experience:

n

n
- Strong experience with Databricks and/or Microsoft Fabric environments
n
- Advanced skills in Python, SQL, PySpark and Spark SQL
n
- Experience building and supporting data pipelines, data lakes and Lakehouse solutions
n
- Knowledge of Delta Lake, Databricks Workflows, Unity Catalog or Microsoft Fabric services
n
- Experience with Azure technologies including Data Factory, ADLS Gen2 or Fabric
n
- Strong understanding of DevOps, CI/CD, automation and Infrastructure as Code practices
n
- Knowledge of data governance, security and data quality frameworks
n

n

What's on Offer:

n

n
- 12-month contract with 2 x 12-month extension options
n
- Hybrid working arrangements across multiple Australian locations
n
- Opportunity to work on large-scale data transformation initiatives
n
- Exposure to Databricks, Microsoft Fabric and modern cloud technologies
n
- Collaborative team environment focused on innovation and continuous improvement
n
- Opportunity to contribute to national data, analytics and AI capabilities
n

n

Due to the nature of this role, this opportunity is open to Australian Citizens only. Candidates who hold a Baseline Security Clearance (or above) areprefered.

n

Calleo is an equal opportunity employer and we encourage applications from all people including Aboriginal and Torres Strait Islander peoples.

n

#J-18808-Ljbffr

📌 Lead Data Engineer (Victoria)
🏢 Calleo
📍 Victoria