Partnering with a leading legal AI company to benchmark how well AI systems answer real questions of

Australian law

. We are hiring experienced litigation & disputes lawyers to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.

What you'll do

- Run the same set of prompts across two AI (LLM) platforms

- Compare the outputs from both platforms side by side

- Score each response against a standardized rubric we provide

- Submit concise written feedback for every evaluation

Requirements

- Primarily law-firm / chambers experience

— at least

2 years (3+ preferred)

at a law firm or barristers' chambers in litigation, disputes, or contentious practice. If you are currently in-house, that is fine only if you moved in-house within the last 2 years and your prior experience was at a firm/chambers.

- Qualified to practise in Australia

, with a strong command of Australian litigation and procedural law

- Native or fluent

English

,



with precise written communication

- Able to work independently to a rubric and to deadlines

Logistics

- Initial commitment:

~10 hours, with robust potential for more

- Confidentiality:

all work is covered by NDA

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

- You will be engaged as an independent contractor.

- This is a fully remote role that can be completed on your own schedule.

- Projects can be extended, shortened, or concluded early depending on needs and performance.

- Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.

- Payments are weekly on Stripe or Wise based on services rendered.

- Please note: We are unable to support H1-B or STEM OPT candidates at this time.

📌 Lawyer (Australia)
🏢 Nancy Assists
📍 Australia