Job Description
Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Australian law. We are hiring experienced in-house counsel to serve as expert reviewers - running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.
n
What you'll do
n
n
Run the same set of prompts across two AI (LLM) platforms
n
Compare the outputs from both platforms side by side
n
Score each response against a standardized rubric we provide
n
Submit concise written feedback for every evaluation
n
n
Requirements
n
n
5+ years as in-house legal counsel practising in Australia
n
Solid command of Australian law,



especially commercial and contract matters
n
Sharp attention to detail and accurate written English
n
Able to work independently to a rubric and to deadlines
n
n
Logistics
n
n
Initial commitment: ~10 hours, with solid potential for more
n
Confidentiality: all work is covered by NDA
n
Pay: USD * per hour
n
n
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
J-*-Ljbffr

📌 In House Counsel Australia At Mercor New South Wales
🏢 aitrainer
📍 New South Wales