26 Aug
|
Mivada
|
New South Wales
26 Aug
Mivada
New South Wales
Overview
We are seeking a highly skilled and innovative
Senior Data Consultant (Databricks)
to join our dynamic
Data & Analytics
team. This role is ideal for someone passionate about building scalable data solutions and driving business value through advanced analytics.
As a Senior Data Consultant, you will play a key role in designing, developing, and optimizing data pipelines, collaborating closely with solution architects, analysts, and cross-functional teams to deliver robust data models and cloud-based solutions that support enterprise analytics and machine learning initiatives.
Responsibilities
Design, develop, and maintain end-to-end data pipelines using modern data platforms and tools.
Build and manage ETL/ELT processes for large-scale data transformation in both real-time and batch modes.
Develop and maintain scalable
data models and schemas
to support analytics and ML applications.
Collaborate with data scientists, analysts, and IT teams to gather requirements and deliver high-quality data solutions.
Optimize performance and scalability of data pipelines, ensuring productive resource usage and data quality.
Implement
data governance
best practices, ensuring data integrity, privacy, and security.
Leverage cloud platforms (
AWS, Azure, or GCP
)
to implement and manage data pipelines and infrastructure.
Monitor, troubleshoot, and resolve data pipeline issues to ensure reliability and uptime.
Automate workflows and implement
CI/CD pipelines
for seamless deployment of data applications.
Stay current with emerging technologies and best practices in data engineering and cloud platforms.
Required Qualifications
Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
Proven experience as a
Senior Data Consultant
with hands-on expertise in
Databricks
.
Strong understanding of
data warehousing
,
ETL/ELT
, and
data modeling
principles.
Experience with
Delta Lake
and building scalable, high-performance data pipelines.
Hands-on experience with
cloud platforms
(AWS, Azure, or GCP).
Familiarity with tools like
Apache Kafka
,
Airflow
, or similar orchestration frameworks.
Knowledge of
version control
(e.g., Git) and
CI/CD
practices.
Excellent analytical, problem-solving, and communication skills.
Benefits
Competitive Compensation & Pay for Performance
Opportunities to be more for yourself and others
#J-*****-Ljbffr
📌 Senior Data Consultant (Databricks) (New South Wales)
🏢 Mivada
📍 New South Wales