Job Description
Owning and evolving the evaluation platform strategy: consolidating test-like evals, comparative evaluation (Arena), monitoring evals, and labelling tooling into a coherent, self-serve platform.
n
Partnering with AI feature teams and CORE leadership to understand their roadmaps and proactively identify the evaluation capabilities needed for upcoming initiatives.
n
Coordinating with adjacent platform teams and the evals programme PM to ensure a seamless experience across the full ML lifecycle.
n
Owning and driving the delivery of large, cross-team, and cross-group initiatives from ideation to completion, with autonomy and independence of decision making.
n
Coaching a team of 9+ engineers by providing regular, practical feedback and collaboratively helping them reach their personal growth goals.
n
Owning the team's development methodology and rituals, such as planning cycles, stand-ups, and retrospectives.
n
Planning goals and defining success metrics to ensure alignment between the company, group, and team.
n
Championing a culture of knowledge sharing and advocating effectively for evaluation and ML engineering needs to stakeholders across Canva.
n
Running hiring and resourcing, including resourcing for the execution of the roadmap.
n
What we're looking for
n
A history of success in technical people leadership and mentorship of engineers,



ideally including senior and staff-level ICs.
n
Experience with ML evaluation, LLM systems, or ML platform engineering; you understand what makes evaluating generative AI hard and can engage credibly with both researchers and engineers.
n
Experience designing and building complex, distributed systems, ideally involving machine learning.
n
Strong stakeholder management skills: comfortable navigating competing priorities across multiple customer teams and negotiating scope boundaries with adjacent teams.
n
First principles thinking; the ability to use deep understanding of a problem space to make informed decisions, even when those decisions differ from industry convention. Canva is a unique company solving unique problems, and this sometimes requires bold decisions.
n
A balance of solid technical and people leadership skills.
n
Excellent problem-solving skills, with the ability to break large projects into smaller ones and deliver on them through others.
n
Excellent written and verbal communication skills.
n
Proven expertise in inspiring others to achieve their full potential and enabling the engineers in your team to do novel, impactful work.
n
A continuous learner attitude, energised by a problem space (GenAI evaluation) that is evolving month to month.

📌 Engineering Manager - Ml - Evaluation Platform - Canva (New South Wales)
🏢 Polluxa
📍 New South Wales