Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Australian law. We are hiring experienced in-house counsel to serve as expert reviewers - running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric. What you/'ll do - Run the same set of prompts across two AI (LLM) platforms - Compare the outputs from both platforms side by side - Score each response against a standardized rubric we provide - Submit concise written feedback for every evaluation Requirements - 5+ years as in-house legal counsel practising in Australia - Strong command of Australian law, especially commercial and contract matters - Sharp attention to detail and precise written English - Able to work independently to a rubric and to deadlines Logistics - Initial commitment: ~10 hours, with robust potential for more - Confidentiality: all work is covered by NDA - Pay: USD 100-120 per hour We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

📌 In-House Counsel (Australia) at Mercor
🏢 aitrainer
📍 Australia