04 Aug
|
Mivada
|
City of Sydney
04 Aug
Mivada
City of Sydney
Overview
We are seeking a highly skilled and innovative Senior Data Consultant (Databricks) to join our dynamic Data & Analytics team. This role is ideal for someone passionate about building scalable data solutions and driving business value through advanced analytics.
As a Senior Data Consultant, you will play a key role in designing, developing, and optimizing data pipelines, collaborating closely with solution architects, analysts, and cross-functional teams to deliver robust data models and cloud-based solutions that support enterprise analytics and machine learning initiatives.
Responsibilities
- Design, develop, and maintain end-to-end data pipelines using modern data platforms and tools.
- Build and manage ETL/ELT processes for large-scale data transformation in both real-time and batch modes.
- Develop and maintain scalable data models and schemas to support analytics and ML applications.
- Collaborate with data scientists, analysts, and IT teams to gather requirements and deliver high-quality data solutions.
- Optimize performance and scalability of data pipelines, ensuring efficient resource usage and data quality.
- Implement data governance best practices, ensuring data integrity, privacy, and security.
- Leverage cloud platforms (AWS, Azure, or GCP )
to implement and manage data pipelines and infrastructure.
- Monitor, troubleshoot, and resolve data pipeline issues to ensure reliability and uptime.
- Automate workflows and implement CI/CD pipelines for seamless deployment of data applications.
- Stay current with emerging technologies and best practices in data engineering and cloud platforms.
Required Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field.
- Proven experience as a Senior Data Consultant with hands-on expertise in Databricks .
- Strong understanding of data warehousing , ETL/ELT , and data modeling principles.
- Experience with Delta Lake and building scalable, high-performance data pipelines.
- Hands-on experience with cloud platforms (AWS, Azure, or GCP).
- Familiarity with tools like Apache Kafka , Airflow , or similar orchestration frameworks.
- Knowledge of version control (e.g., Git) and CI/CD practices.
- Excellent analytical, problem-solving, and communication skills.
Advantages
- Competitive Compensation & Pay for Performance
- Opportunities to be more for yourself and others
#J-18808-Ljbffr
📌 Senior Data Consultant (Databricks) (City of Sydney)
🏢 Mivada
📍 City of Sydney