20 Aug
|
Mivada
|
New South Wales
20 Aug
Mivada
New South Wales
Job Description
Overview
n
We are seeking a highly skilled and innovative Senior Data Consultant (Databricks) to join our agile Data & Analytics team. This role is ideal for someone passionate about building scalable data solutions and driving business value through advanced analytics.
n
As a Senior Data Consultant, you will play a key role in designing, developing, and optimizing data pipelines, collaborating closely with solution architects, analysts, and cross-functional teams to deliver robust data models and cloud-based solutions that support enterprise analytics and machine learning initiatives.
n
Responsibilities
n
n
Design, develop, and maintain end-to-end data pipelines using modern data platforms and tools.
n
Build and manage ETL/ELT processes for large-scale data transformation in both real-time and batch modes.
n
Develop and maintain scalable data models and schemas to support analytics and ML applications.
n
Collaborate with data scientists, analysts, and IT teams to gather requirements and deliver high-quality data solutions.
n
Optimize performance and scalability of data pipelines, ensuring efficient resource usage and data quality.
n
Implement data governance best practices, ensuring data integrity, privacy, and security.
n
Leverage cloud platforms (AWS, Azure, or GCP)
to implement and manage data pipelines and infrastructure.
n
Monitor, troubleshoot, and resolve data pipeline issues to ensure reliability and uptime.
n
Automate workflows and implement CI/CD pipelines for seamless deployment of data applications.
n
Stay current with emerging technologies and best practices in data engineering and cloud platforms.
n
n
Required Qualifications
n
n
Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
n
Proven experience as a Senior Data Consultant with hands-on expertise in Databricks.
n
Strong understanding of data warehousing, ETL/ELT, and data modeling principles.
n
Experience with Delta Lake and building scalable, high-performance data pipelines.
n
Hands-on experience with cloud platforms (AWS, Azure, or GCP).
n
Familiarity with tools like Apache Kafka, Airflow, or similar orchestration frameworks.
n
Knowledge of version control (e.g., Git) and CI/CD practices.
n
Excellent analytical, problem-solving, and communication skills.
n
n
Benefits
n
n
Competitive Compensation & Pay for Performance
n
Opportunities to be more for yourself and others
n
#J-*****-Ljbffr
📌 Senior Data Consultant (Databricks) (New South Wales)
🏢 Mivada
📍 New South Wales