26 Aug
|
Mivada
|
New South Wales
26 Aug
Mivada
New South Wales
Overview
We are seeking a highly skilled and innovativeSenior Data Consultant (Databricks)to join our dynamicData & Analyticsteam.
This role is ideal for someone passionate about building scalable data solutions and driving business value through advanced analytics.
As a Senior Data Consultant, you will play a key role in designing, developing, and optimizing data pipelines, collaborating closely with solution architects, analysts, and cross-functional teams to deliver robust data models and cloud-based solutions that support enterprise analytics and machine learning initiatives.
Responsibilities
Design, develop, and maintain end-to-end data pipelines using modern data platforms and tools.
Build and manage ETL/ELT processes for large-scale data transformation in both real-time and batch modes.
Develop and maintain scalabledata models and schemasto support analytics and ML applications.
Collaborate with data scientists, analysts, and IT teams to gather requirements and deliver high-quality data solutions.
Optimize performance and scalability of data pipelines, ensuring efficient resource usage and data quality.
Implementdata governancebest practices, ensuring data integrity, privacy, and security.
Leverage cloud platforms (AWS, Azure, or GCP)
to implement and manage data pipelines and infrastructure.
Monitor, troubleshoot, and resolve data pipeline issues to ensure reliability and uptime.
Automate workflows and implementCI/CD pipelinesfor seamless deployment of data applications.
Stay current with emerging technologies and best practices in data engineering and cloud platforms.
Required Qualifications
Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
Proven experience as aSenior Data Consultantwith hands-on expertise inDatabricks.
Robust understanding ofdata warehousing,ETL/ELT, anddata modelingprinciples.
Experience withDelta Lakeand building scalable, high-performance data pipelines.
Hands-on experience withcloud platforms(AWS, Azure, or GCP).
Familiarity with tools likeApache Kafka,Airflow, or similar orchestration frameworks.
Knowledge ofversion control(e.g., Git) andCI/CDpractices.
Excellent analytical, problem-solving, and communication skills.
Benefits
Competitive Compensation & Pay for Performance
Opportunities to be more for yourself and others
#J-*****-Ljbffr
📌 Senior Data Consultant (Databricks) (New South Wales)
🏢 Mivada
📍 New South Wales