31 Jul
|
Mivada
|
City of Sydney
31 Jul
Mivada
City of Sydney
Overview
We are seeking a highly skilled and innovative Senior Data Consultant (Databricks) to join our energetic Data & Analytics team. This role is ideal for someone passionate about building scalable data solutions and driving business value through advanced analytics.
As a Senior Data Consultant, you will play a key role in designing, developing, and optimizing data pipelines, collaborating closely with solution architects, analysts, and cross-functional teams to deliver robust data models and cloud-based solutions that support enterprise analytics and machine learning initiatives.
Responsibilities
Design, develop, and maintain end-to-end data pipelines using modern data platforms and tools.
Build and manage ETL/ELT processes for large-scale data transformation in both real-time and batch modes.
Develop and maintain scalable data models and schemas to support analytics and ML applications.
Collaborate with data scientists, analysts, and IT teams to gather requirements and deliver high-quality data solutions.
Optimize performance and scalability of data pipelines, ensuring productive resource usage and data quality.
Implement data governance best practices, ensuring data integrity, privacy, and security.
Leverage cloud platforms (AWS, Azure, or GCP )
to implement and manage data pipelines and infrastructure.
Monitor, troubleshoot, and resolve data pipeline issues to ensure reliability and uptime.
Automate workflows and implement CI/CD pipelines for seamless deployment of data applications.
Stay current with emerging technologies and best practices in data engineering and cloud platforms.
Required Qualifications
Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field.
Proven experience as a Senior Data Consultant with hands-on expertise in Databricks .
Robust understanding of data warehousing , ETL/ELT , and data modeling principles.
Experience with Delta Lake and building scalable, high-performance data pipelines.
Hands-on experience with cloud platforms (AWS, Azure, or GCP).
Familiarity with tools like Apache Kafka , Airflow , or similar orchestration frameworks.
Knowledge of version control (e.g., Git) and CI/CD practices.
Excellent analytical, problem-solving, and communication skills.
Benefits
Competitive Compensation & Pay for Performance
Opportunities to be more for yourself and others
J-18808-Ljbffr
📌 Senior Data Consultant Databricks City Of Sydney
🏢 Mivada
📍 City of Sydney