Job Description
n
Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of
Australian law
. We are hiring experienced
litigation & disputes lawyers
to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.
What you'll do n
n
Run the same set of prompts across
two AI (LLM) platforms
n
Compare the outputs from both platforms side by side
n
Score each response against a
standardized rubric
we provide
n
Submit concise written feedback for every evaluation
n
Requirements n
n
Primarily law-firm / chambers experience
— at least
2 years (3+ preferred)
at a law firm or barristers' chambers in
litigation, disputes,



or contentious
practice. If you are currently in-house, that is fine only if you moved in-house
within the last 2 years
and your prior experience was at a firm/chambers.
n
Qualified to practise in Australia
, with a robust command of Australian litigation and procedural law
n
Native or fluent
English
, with accurate written communication
n
Able to work independently to a rubric and to deadlines
n
Logistics n
n
Initial commitment:
~10 hours, with robust potential for more
n
Confidentiality:
all work is covered by NDA
n
n
J-*-Ljbffr

📌 Litigation Ai Reviewer Australian Law Expert New South Wales
🏢 Obsidian
📍 New South Wales