1. Role OverviewMercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work.
Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.2.
Key ResponsibilitiesDesign precise, task-specific grading criteria for real-world brand design deliverables (brand identity systems and guidelines, logos and visual identity, campaign and marketing visuals, packaging concepts, presentation and layout design, digital and social assets, and brand messaging and positioning)Score AI-generated and human work samples against those criteria, with detailed written justifications for every scoreApply consistent, evidence-based judgment so that scores are reproducible and defensibleIncorporate structured feedback from senior reviewers and iterate quickly on your work3.
Ideal Qualifications5+ years of skilled experience in brand, visual,



or graphic designBackground specifically at world-class independent brand and design agencies (e.g., Pentagram, Wolff Olins, Landor, Collins, IDEO) — agency experience, not in-house or enterprise design teamsExperience in one of the core brand disciplines: Creative Director, Brand Designer (logo, visual identity, supporting graphics), Web Designer (UI/UX, web architecture), or Graphic DesignerDeep fluency in the day-to-day craft: typography, layout and visual hierarchy, color, composition, logo and brand identity systems, and articulating critique the way a creative director would in a reviewExceptionally strong written communication, with the ability to explain exactly why a piece of work does or does not meet the barDetail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peersExperience with copywriting and brand messaging — including audience research, competitor research, and positioning — is a strong plusPrior experience with AI training, evaluation, or human-data projects is a strong plus
#J-*****-Ljbffr

📌 Design Evaluation Expert - Graphic (New South Wales)
🏢 Obsidian
📍 New South Wales