21 Aug
|
Techforce Personnel
|
Queensland
21 Aug
Techforce Personnel
Queensland
Client is seeking an experienced Technical Lead - Databricks to support the detailed design, technical delivery and implementation of data platform components required for the Generative AI and MCU Phase 2 initiatives. The Technical Lead will be responsible for developing detailed and low-level technical designs across the Databricks platform, providing technical guidance and support to delivery teams, and contributing hands‑on to the development of data platform components.
This is a hands‑on technical leadership role suited to someone with strong Databricks, Apache Spark and Python experience who can translate high-level requirements into robust, scalable technical designs and work effectively with both technical and business stakeholders.
The Role
Key Responsibilities
Technical Leadership & Design
- Provide technical leadership across the Databricks components supporting the Generative AI and MCU Phase 2 initiatives.
- Develop detailed and low-level technical designs for Databricks-based data platform solutions.
- Translate business and technical requirements into scalable, secure and maintainable technical solutions.
- Provide technical guidance to developers and delivery teams throughout the implementation lifecycle.
- Review technical designs and ensure solutions align with enterprise architecture and engineering standards.
Databricks & Data Engineering
- Design and develop data platform components using Databricks, Apache Spark and Python.
- Support the implementation and optimisation of Databricks workloads across the data platform.
- Contribute hands‑on to coding, development and technical problem‑solving where required.
- Ensure solutions are designed for scalability, performance, reliability and maintainability.
- Troubleshoot technical issues and provide guidance on complex data engineering challenges.
Generative AI & MCU Initiatives
- Support the technical delivery of data platform capabilities required for the Generative AI and MCU Phase 2 programs.
- Work closely with architecture, data engineering and project teams to ensure Databricks solutions meet program requirements.
- Contribute to technical decision‑making and identify opportunities to improve the data platform and delivery approach.
Stakeholder Engagement
- Work collaboratively with architects, engineers, developers and project stakeholders.
- Communicate complex technical concepts clearly to both technical and non‑technical audiences.
- Provide clear technical updates, identify risks and dependencies, and contribute to solution discussions.
- Support knowledge sharing and provide technical guidance across the broader delivery team.
Skills & Experience
Essential
- Proven experience working as a Technical Lead, Lead Data Engineer or Senior Data Engineer within a complex enterprise environment.
- Solid hands‑on experience with the Databricks platform.
- Strong coding experience with Apache Spark and Python.
- Demonstrated experience creating low-level technical designs.
- Strong understanding of data engineering and modern data platform architectures.
- Ability to translate requirements into practical, scalable technical solutions.
- Strong problem‑solving and analytical skills.
- Excellent communication and stakeholder engagement skills.
- Ability to provide technical leadership while remaining hands‑on with development and implementation.
Desirable
- Experience supporting Generative AI or AI‑related data platform initiatives.
- Experience working within large-scale enterprise data transformation programs.
- Experience with cloud-based data platforms.
- Knowledge of modern data lakehouse architectures and associated data engineering patterns.
- Experience working within Agile delivery environments.
#J-18808-Ljbffr
📌 Techical Lead Databricks (Queensland)
🏢 Techforce Personnel
📍 Queensland