20 Aug
|
Data#3
|
New South Wales
20 Aug
Data#3
New South Wales
Job Description
Overview:
n
We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.
n
Responsibilities:
n
n
Design, build, and maintain ETL pipelines using Databricks and Spark SQL
n
Develop and optimise SQL queries for large-scale data transformation and performance
n
Extract and load data from source systems into Azure-based data warehouses and downstream platforms
n
Collaborate with data and integration teams to align data flows and resolve issues
n
Ensure data pipelines are reliable, efficient, and well-documented
n
Support testing, troubleshooting, and performance tuning activities
n
n
Key Skills and Experience:
n
n
Proven experience as a Data Engineer or similar role in a cloud environment
n
Strong expertise in Databricks and Spark SQL, including joins and query optimisation
n
Hands-on experience with ETL development and pipeline orchestration (Azure Data Factory desirable)
n
Solid SQL skills and ability to work with large datasets
n
Familiarity with Azure data services (Data Lake, Synapse, D365 exposure a bonus)
n
Solid problem-solving skills and ability to work collaboratively within cross-functional teams
n
n
Interested candidates who meet the required skillset of the role are encouraged to apply via the link with an updated resume. Reference BIHI ******
n
Seniority level
n
n
Mid-Senior level
n
n
Employment type
n
n
Contract
n
n
Job function
n
n
Information Technology
n
n
Industries
n
n
IT Services and IT Consulting
n
#J-*****-Ljbffr
📌 Data Engineer (New South Wales)
🏢 Data#3
📍 New South Wales