Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Australian law.
We are hiring experienced corporate/M&A; lawyers to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.
What you'll do
Run the same set of prompts across two AI (LLM) platformsCompare the outputs from both platforms side by sideScore each response against a standardized rubric we provideSubmit concise written feedback for every evaluation
Requirements
Primarily law-firm experience — at least 2 years (3+ preferred) at a law firm in corporate/M&A; or transactional practice.
If you are currently in-house, that is fine only if you moved in-house within the last 2 years and your prior experience was at a law firm.Qualified to practise in Australia, with a solid command of Australian corporate and commercial lawNative or fluent English, with precise written communicationAble to work independently to a rubric and to deadlines
Logistics
Initial commitment: ~10 hours, with strong potential for moreConfidentiality: all work is covered by NDA