07 Nov
|
Virtusa
|
Sydney
Data Tech Lead
Role Overview The Data Tech Lead serves as a core technical authority responsible for leading data engineering teams, designing scalable lakehouse architectures, and operating enterprise-grade Databricks environments. This position bridges engineering execution, platform governance, and team leadership to deliver robust batch and streaming data solutions supporting analytics, data science, and operational workloads.
The ideal candidate brings deep technical expertise in Apache Spark optimization, Databricks workspace management, Unity Catalog governance, and up-to-date cloud integration practices, alongside proven experience mentoring engineers in Agile delivery environments.
Key Responsibilities
Technical Leadership &
- Delivery
Team Guidance &
- Tasking: Organize, task, and lead a dedicated team of data engineers across onshore and offshore operating models to deliver high-quality data products.
Stakeholder &
- Advisory Alignment: Act as a trusted technical advisor to Data Scientists, Architects, and business stakeholders to solve complex data challenges and streamline issue resolution.
Agile Engineering Management: Drive sprint planning, technical task estimation, code reviews, and architectural alignment within evolving Agile contexts.
Incident Escalation &
- Operational Standards: Serve as the senior technical escalation point for production incidents, leading root-cause analyses (RCA) and maintaining platform runbooks.
Databricks Platform Administration &
- Compute Management
Workspace Operations: Administer and configure enterprise Databricks workspaces across Development, QA, Production, and Disaster Recovery environments.
Compute Infrastructure &
- FinOps: Design, configure, and enforce cluster policies, autoscaling mechanisms, instance pools, and job/all-purpose compute clusters to balance performance with cloud cost control.
Platform Security: Configure and manage workspace access control lists (ACLs), IAM integrations, secrets management, and init scripts to enforce platform security standards.
Apache Spark Optimization &
- Delta Lake Engineering
📌 Lead Software Engineer (Sydney)
🏢 Virtusa
📍 Sydney