Responsibilities
• Review annotators’ ACCEPT/REJECT decisions and reject reason codes, with a focus on preventing false matches and false rejects.
• Sample-check or fully review high-risk rows (multiple codes, OTHERS, rows with uncertainty notes).
• Correct errors, give feedback to annotators, and identify recurring error patterns to keep rule interpretation consistent.
• Compile questions for the client where rules are ambiguous, and maintain a clarification log.
• Validate structural compliance of deliverables: every input row returned exactly once and unchanged, timestamps, exact decision and code spelling, correct separators, valid CSV, identifiers preserved as text.
• Track and report accuracy, review coverage, known limitations, and unresolved rows to support the summary report.
• Monitor progress to ensure on-time delivery. Requirements
• At native proficiency level of Korean.
• 1+ years of experience in data annotation, content moderation, or QA; team lead or training experience preferred.
• Strong judgment on edge cases, with the ability to explain decisions clearly.
• Transparent communication and the ability to give constructive feedback. Nice to have
• Experience building evaluation sets, analyzing accuracy, or managing annotation quality.
• Understanding of AI-assisted annotation workflows and associated risk controls. VPN and Location Verification: What You Need to Know
• Application and onboarding: no VPN. Please do not use a VPN when you apply or go through onboarding.
• Production: VPN required. Once production starts, you will need to use a VPN. Opera browser is recommended. (Opera is a free built-in VPN and needs no extra installation.) We will send you setup instructions before production begins.
• Which VPNs are allowed. Standard consumer VPNs are fine. High-risk proxies are not permitted.
• Periodic checks in Production. For administrative reasons, we may occasionally ask you to access AI Trainer platform without your VPN so we can check your unmasked IP.
📌 Project Beid (Australia)
🏢 Welo Data
📍 Australia
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.