Job Description
About OpenTrain
OpenTrain is the #1 platform for finding and building careers in AI training and data labeling.
OpenTrain AI hires and contracts specialists for projects that help improve modern artificial intelligence systems.
Creating an OpenTrain account is free.
Build a professional profile, discover relevant opportunities, and develop a lasting portfolio of AI training experience.
About AI Evaluation Work
AI training is the human side of building artificial intelligence.
Expert reviewers assess model-generated content, identify strengths and weaknesses, and provide feedback that helps AI systems produce more accurate and useful responses.
In this role, your legal judgment will help evaluate how language-model systems handle real questions involving Australian law.
The Role
OpenTrain AI is seeking an Australian Litigation AI Evaluation Lawyer to compare answers from two AI language-model platforms.
You will assess responses to legal prompts focused on litigation, disputes, contentious practice, and Australian procedural law.
This is remote, project-based expert review work conducted under a confidentiality agreement.
The engagement has an initial commitment of approximately 10 hours and strong potential for additional work.
The listing indicates a time requirement of 20+ hours per week.
Engagement type: Contractor and part-time
Compensation: $100–$120 USD per hour
Location: Australia
Working language: Native or fluent English
Data type: Text
Initial commitment: Approximately 10 hours
Additional work may be available
What You'll Do
You will independently review and compare AI-generated legal answers, applying a consistent evaluation framework.
Your concise written explanations will help measure the quality of legal responses and identify where systems need improvement.




Run the same legal prompts across two AI language-model platforms
Compare the resulting answers side by side
Score each response against a standardized rubric
Explain evaluation decisions through concise written feedback
Make consistent, well-supported judgments
Meet agreed deadlines
Follow confidentiality obligations
Requirements
This opportunity requires qualified legal expertise in Australia, particularly in litigation, disputes, contentious practice, and procedural law.
The listing identifies the experience level as entry level, but it also requires at least two years of relevant professional experience.
Qualification to practise law in Australia
Strong command of Australian litigation and procedural law
At least two years of primarily law-firm or barristers' chambers experience in litigation, disputes, or contentious practice
Three or more years of relevant experience is preferred
Native or fluent English
Precise written communication
Ability to apply a structured evaluation rubric consistently
Ability to compare AI-generated legal answers
Ability to work independently and meet deadlines
Relevant Professional Background
Experience handling contentious legal matters in a law firm or barristers' chambers is particularly relevant.
Lawyers who moved in-house within the last two years may also be considered if they bring the required prior firm or chambers background.
Why Work in AI Training
AI training and data-labeling work is a fast-growing area of technology.
Human experts contribute essential knowledge by evaluating model outputs, reviewing content, and helping shape how advanced AI systems behave.
Remote, flexible projects can allow specialists to apply their professional expertise to cutting-edge technology while building experience in an expanding industry.
#J-*****-Ljbffr

📌 Australian Litigation Ai Evaluation Lawyer (New South Wales)
🏢 OpenTrain AI
📍 New South Wales