- Role : Search Evaluator (Remote)
- Location : Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
- Pay : US$18 per hour Applicants must currently reside in Australia, Canada, Ireland, Current Zealand, the United Kingdom or the United States. Overview We are recruiting contributors for AI projects that require evaluation of search results against explicit relevance guidelines. You will compare result sets, apply the stated criteria and document clear reasoning for each decision.

Key Responsibilities

- Evaluate assigned search results against the stated relevance guidelines.
- Compare result content with the search intent and available context.
- Select ratings that match the documented evaluation criteria.
- Record concise reasoning for each material decision.
- Flag ambiguous queries or result sets that need further guidance.



Requirements
- Must be at least 18 years old and able to communicate in English.
- Ability to evaluate English search results against written relevance criteria.
- Ability to explain why a result is relevant, partially relevant or not relevant.
- Reliable high-speed internet and a suitable home-working setup.
- Previous experience in search evaluation is helpful but not required. Equal Opportunity We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law. Apply Now

📌 Search Evaluator (Australia)
🏢 Hired
📍 Australia