26 Aug
|
Data#3
|
New South Wales
26 Aug
Data#3
New South Wales
Overview:
We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.
Responsibilities:
Design, build, and maintain ETL pipelines using Databricks and Spark SQL
Develop and optimise SQL queries for large-scale data transformation and performance
Extract and load data from source systems into Azure-based data warehouses and downstream platforms
Collaborate with data and integration teams to align data flows and resolve issues
Ensure data pipelines are reliable, efficient, and well-documented
Support testing, troubleshooting, and performance tuning activities
Key Skills and Experience:
Proven experience as a Data Engineer or similar role in a cloud environment
Strong expertise in Databricks and Spark SQL, including joins and query optimisation
Hands-on experience with ETL development and pipeline orchestration (Azure Data Factory desirable)
Solid SQL skills and ability to work with large datasets
Familiarity with Azure data services (Data Lake, Synapse, D365 exposure a bonus)
Solid problem-solving skills and ability to work collaboratively within cross-functional teams
Interested candidates who meet the required skillset of the role are encouraged to apply via the link with an updated resume. Reference BIHI ******
Seniority level
Mid-Senior level
Employment type
Contract
Job function
Information Technology
Industries
IT Services and IT Consulting
#J-*****-Ljbffr
📌 Data Engineer (New South Wales)
🏢 Data#3
📍 New South Wales