Job Description

We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

n

Start Date: ASAP

n

Duration: 10 hours/week

n

Job Type: Freelance

n

Location: Remote (Australia )

n

Pay Rate: US $27.30/hour

n

What You’ll do:

n

n
- Listen carefully to recorded conversations between a person and an AI voice agent
n
- Rate each of the agent's turns on two independent 1–5 scales: n n
- Content – Was the response helpful, relevant, and appropriate?
n
- Prosody – Did the voice sound natural, well-paced, and expressive?
n

n
- Write a short, specific, and transparent justification for each score given
n

n

What We're Looking For:

n

n
- Strong listening and attention-to-detail skills
n
- Ability to give consistent, well-reasoned ratings
n
- Clear, concise written communication
n
- Reliable availability for ~10 hours/week
n

n

Thank you for your interest in joining Welo Data’s community and contributing to this exciting project. We look forward to collaborating with you!

#J-18808-Ljbffr

📌 English (Australia) Audio Rater (Melbourne)
🏢 Welo Data
📍 Melbourne