Job Description
Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Australian law. We are hiring experienced litigation & disputes lawyers to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.
n
What you'll do
n
n
Run the same set of prompts across two AI (LLM) platforms
n
Compare the outputs from both platforms side by side
n
Score each response against a standardized rubric we provide
n
Submit concise written feedback for every evaluation
n
n
Requirements
n
n
Primarily law-firm / chambers experience — at least 2 years (3+ preferred) at a law firm or barristers' chambers in litigation, disputes,



or contentious practice. If you are currently in-house, that is fine only if you moved in-house within the last 2 years and your prior experience was at a firm/chambers.
n
Qualified to practise in Australia, with a strong command of Australian litigation and procedural law
n
Native or fluent English, with exact written communication
n
Able to work independently to a rubric and to deadlines
n
n
Logistics
n
n
Initial commitment: ~10 hours, with strong potential for more
n
Confidentiality: all work is covered by NDA
n
#J-*****-Ljbffr

📌 Litigation Lawyer - Legal Reviewer (New South Wales)
🏢 Mercor
📍 New South Wales