06 Aug
|
Delivery Centric
|
City of Sydney
06 Aug
Delivery Centric
City of Sydney
Delivery Centric is seeking an experienced Data Engineer / Senior Data Lead with strong expertise in Azure Data Factory (ADF), Databricks, Power BI, and modern data engineering practices . This role focuses on designing, building, and maintaining scalable data pipelines, supporting enterprise data warehousing systems, and delivering high-quality analytics solutions. The ideal candidate will have strong hands-on experience in ETL development, cloud data platforms, and performance optimization, along with excellent stakeholder engagement skills.
Delivery Centric is seeking an experienced Data Engineer / Senior Data Lead with strong expertise in Azure Data Factory (ADF), Databricks, Power BI, and modern data engineering practices . This role focuses on designing, building, and maintaining scalable data pipelines, supporting enterprise data warehousing systems, and delivering high-quality analytics solutions. The ideal candidate will have strong hands-on experience in ETL development, cloud data platforms, and performance optimization, along with excellent stakeholder engagement skills.
Key Responsibilities
- Design, develop, and manage scalable data pipelines and ETL processes using Azure Data Factory (ADF).
- Build and maintain data flows, integration workflows, and data ingestion processes across cloud environments.
- Develop and enhance existing data warehouse systems to improve performance, scalability, and reliability.
- Work with Databricks to process and transform large datasets using PySpark and distributed computing frameworks.
- Develop Python and PySpark scripts for data processing, automation, and transformation requirements.
- Create and optimize SQL queries, including joins, subqueries, and performance tuning for efficient data processing.
- Design and develop interactive dashboards and reports using Power BI.
- Support production ETL jobs, ensuring smooth execution, monitoring, and issue resolution.
- Modify and enhance existing codebases based on evolving business requirements.
- Collaborate with business stakeholders and technical teams to deliver data-driven solutions.
- Ensure data quality, integrity, and adherence to data warehousing standards.
Qualifications
- 7 to 10 years of hands-on experience in data engineering or related roles.
- Strong expertise in Azure Data Factory (ADF) for building and managing ETL pipelines.
- Hands-on experience with Databricks for data processing and transformation.
- Proficiency in Power BI for creating dashboards and reports.
- Strong experience in SQL, including joins, subqueries, and performance optimization.
- Solid understanding of data warehouse concepts and ETL methodologies.
- Hands-on experience in Python and PySpark for data engineering tasks.
- Experience supporting and maintaining production ETL applications.
- Strong analytical, troubleshooting, and debugging skills.
- Excellent communication and client interaction skills.
- Ability to work independently and adapt to new technologies.
Preferred Skills
- Azure Data Engineer Associate (DP-203) certification.
- Databricks Certified Data Engineer Associate certification.
- Experience in the Transport domain or similar large-scale data environments.
- Exposure to enterprise data migration or modernization projects.
- Strong understanding of data modeling and analytics best practices.
At Delivery Centric, you will contribute to building modern cloud-based data platforms that enable advanced analytics and business intelligence. You will work in a cooperative workplace alongside data engineers, analysts, and cloud specialists, delivering scalable and high-performance data solutions that drive strategic decision-making.
#J-18808-Ljbffr
📌 Senior Data Lead / Data Engineer (City of Sydney)
🏢 Delivery Centric
📍 City of Sydney