02 Nov
|
Datamatics
|
Victoria
02 Nov
Datamatics
Victoria
Role : Senior Databricks Developer
Location: Sydney/ Melbourne
Work Mode: Hybrid
Experience required: 5+yrs
Requirement
Data Engineering & Platform Development
- Design, develop and maintain scalable, reliable data pipelines using Databricks, Delta Lake and PySpark.
- Build efficient and optimized data transformation processes using SQL and Spark SQL.
- Develop robust data solutions that support both batch and operational data processing requirements.
- Apply software engineering best practices to data engineering delivery, including reusable code, testing and automation.
Quality Engineering & DevOps
- Implement unit testing and integration testing to ensure data quality, reliability and maintainability.
- Manage source code, branching strategies and deployments using Git and CI/CD practices.
- Support production releases and ensure solutions meet operational and production readiness standards.
- Monitor platform health through observability, monitoring and alerting capabilities, proactively identifying and resolving issues.
Data Platform & Governance
- Deliver data assets through the full lifecycle, including discovery, design, development, testing, deployment and operational support.
- Adhere to engineering standards, code review processes and governance controls.
- Optimize and continuously improve data pipelines and platform performance.
- Utilize Databricks platform capabilities, including Workflows, Jobs and Unity Catalog, to support secure and governed data delivery.
Agile Delivery
- Work effectively within Agile delivery teams, participating in planning, estimation, sprint ceremonies and continuous improvement activities.
- Contribute to delivery outcomes while balancing feature development, operational support and platform enhancements.
Stakeholder & Business Engagement
- Collaborate with business and technical stakeholders to understand, clarify and refine requirements.
- Translate business problems and data needs into practical technical solutions and implementation plans.
- Support prioritization discussions and contribute to delivering business value through data products and services.
Collaboration & Communication
- Work collaboratively within cross-functional teams comprising engineers, product owners, analysts and business stakeholders.
- Produce clear and effective technical documentation, including solution designs, implementation approaches and operational procedures.
- Participate in peer reviews, knowledge sharing sessions and collaborative problem-solving activities.
Continuous Improvement & Capability Uplift
- Demonstrate a commitment to continuous learning and keeping current with up-to-date data engineering practices and technologies.
- Contribute to uplifting team capability through mentoring, coaching and sharing best practices.
- Support continuous improvement initiatives that enhance engineering maturity, delivery efficiency and platform capability.
📌 Sr. Databricks Developer (Victoria)
🏢 Datamatics
📍 Victoria