Owning and evolving the evaluation platform strategy: consolidating test-like evals, comparative evaluation (Arena), monitoring evals, and labelling tooling into a coherent, self-serve platform.

Partnering with AI feature teams and CORE leadership to understand their roadmaps and proactively identify the evaluation capabilities needed for upcoming initiatives.

Coordinating with adjacent platform teams and the evals programme PM to ensure a seamless experience across the full ML lifecycle.

Owning and driving the delivery of large, cross-team, and cross-group initiatives from ideation to completion, with autonomy and independence of decision making.

Coaching a team of 9+ engineers by providing regular, practical feedback and collaboratively helping them reach their personal growth goals.

Owning the team's development methodology and rituals, such as planning cycles, stand-ups, and retrospectives.

Planning goals and defining success metrics to ensure alignment between the company, group, and team.

Championing a culture of knowledge sharing and advocating effectively for evaluation and ML engineering needs to stakeholders across Canva.

Running hiring and resourcing, including resourcing for the execution of the roadmap.

What we're looking for

A history of success in technical people leadership and mentorship of engineers,



ideally including senior and staff-level ICs.

Experience with ML evaluation, LLM systems, or ML platform engineering; you understand what makes evaluating generative AI hard and can engage credibly with both researchers and engineers.

Experience designing and building complex, distributed systems, ideally involving machine learning.

Robust stakeholder management skills: comfortable navigating competing priorities across multiple customer teams and negotiating scope boundaries with adjacent teams.

First principles thinking; the ability to use deep understanding of a problem space to make informed decisions, even when those decisions differ from industry convention. Canva is a unique company solving unique problems, and this sometimes requires bold decisions.

A balance of strong technical and people leadership skills.

Excellent problem-solving skills, with the ability to break large projects into smaller ones and deliver on them through others.

Excellent written and verbal communication skills.

Proven expertise in inspiring others to achieve their full potential and enabling the engineers in your team to do novel, impactful work.

A continuous learner attitude, energised by a problem space (GenAI evaluation) that is evolving month to month.

#J-18808-Ljbffr

📌 Engineering Manager - ML - Evaluation Platform - Canva (Sydney)
🏢 Polluxa
📍 Sydney