20 Aug
|
Data#3
|
New South Wales
20 Aug
Data#3
New South Wales
Overview:
We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.
Responsibilities:
- Design, build, and maintain ETL pipelines using Databricks and Spark SQL
- Develop and optimise SQL queries for large-scale data transformation and performance
- Extract and load data from source systems into Azure-based data warehouses and downstream platforms
- Collaborate with data and integration teams to align data flows and resolve issues
- Ensure data pipelines are reliable, efficient, and well-documented
- Support testing, troubleshooting, and performance tuning activities
Key Skills and Experience:
- Proven experience as a Data Engineer or similar role in a cloud environment
- Strong expertise in Databricks and Spark SQL, including joins and query optimisation
- Hands-on experience with ETL development and pipeline orchestration (Azure Data Factory desirable)
- Solid SQL skills and ability to work with large datasets
- Familiarity with Azure data services (Data Lake, Synapse, D365 exposure a bonus)
- Robust problem-solving skills and ability to work collaboratively within cross-functional teams
Interested candidates who meet the required skillset of the role are encouraged to apply via the link with an updated resume. Reference BIHI 113260
Seniority level
- Mid-Senior level
Employment type
- Contract
Job function
- Information Technology
Industries
- IT Services and IT Consulting
#J-18808-Ljbffr
📌 Data Engineer (New South Wales)
🏢 Data#3
📍 New South Wales