21 Aug
|
Mivada
|
New South Wales
21 Aug
Mivada
New South Wales
Job Description
Overview
n
We are seeking a highly skilled and innovative Senior Data Consultant (Databricks) to join our dynamic Data & Analytics team. This role is ideal for someone passionate about building scalable data solutions and driving business value through advanced analytics.
n
As a Senior Data Consultant, you will play a key role in designing, developing, and optimizing data pipelines, collaborating closely with solution architects, analysts, and cross-functional teams to deliver robust data models and cloud-based solutions that support enterprise analytics and machine learning initiatives.
n
Responsibilities
n
n
- Design, develop, and maintain end-to-end data pipelines using modern data platforms and tools.
n
- Build and manage ETL/ELT processes for large-scale data transformation in both real-time and batch modes.
n
- Develop and maintain scalable data models and schemas to support analytics and ML applications.
n
- Collaborate with data scientists, analysts, and IT teams to gather requirements and deliver high-quality data solutions.
n
- Optimize performance and scalability of data pipelines, ensuring effective resource usage and data quality.
n
- Implement data governance best practices, ensuring data integrity, privacy, and security.
n
- Leverage cloud platforms (AWS, Azure, or GCP)
to implement and manage data pipelines and infrastructure.
n
- Monitor, troubleshoot, and resolve data pipeline issues to ensure reliability and uptime.
n
- Automate workflows and implement CI/CD pipelines for seamless deployment of data applications.
n
- Stay current with emerging technologies and best practices in data engineering and cloud platforms.
n
n
Required Qualifications
n
n
- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
n
- Proven experience as a Senior Data Consultant with hands-on expertise in Databricks.
n
- Strong understanding of data warehousing, ETL/ELT, and data modeling principles.
n
- Experience with Delta Lake and building scalable, high-performance data pipelines.
n
- Hands-on experience with cloud platforms (AWS, Azure, or GCP).
n
- Familiarity with tools like Apache Kafka, Airflow, or similar orchestration frameworks.
n
- Knowledge of version control (e.g., Git) and CI/CD practices.
n
- Excellent analytical, problem-solving, and communication skills.
n
n
Benefits
n
n
- Competitive Compensation & Pay for Performance
n
- Opportunities to be more for yourself and others
n
#J-18808-Ljbffr
📌 Senior Data Consultant (Databricks) (New South Wales)
🏢 Mivada
📍 New South Wales