Job Description
Job Title
n
Psychology Quality Assurance Lead
n
Job Type
n
Contract
n
Location
n
Remote
n
About This Role
n
In this hourly, remote contractor role, you will work as a Psychology Quality Assurance Lead to oversee quality, consistency, and trainer performance across psychology-focused AI training projects. You will review AI-generated psychology content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards.
n
You will assess work for psychological accuracy, theory application, research literacy, ethical awareness, mental-health safety, diagnostic caution, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently.
n
This role requires strong psychology expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote expert teams. This role is a fast-growing AI Data Services company delivering training data for many of the world's largest AI companies and foundation-model labs.
n
Your psychology quality leadership will directly help improve the world's premier AI models by ensuring that psychology training data is accurate, ethical, appropriately cautious, research-informed, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter.
n
Important:
n
There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.
n
Your Profile
n
n
Bachelor's, Master's, PhD, PsyD, or equivalent professional background in Psychology, Clinical Psychology,



Counseling, Behavioral Science, Cognitive Science, Neuroscience, Social Work, Psychiatry-adjacent research, Education, or a closely related field.
n
Strong grasp of the English language to follow project guidelines, communicate with teams, and provide clear written feedback.
n
3+ years of experience in psychology research,
clinical/counseling
settings, behavioral science, teaching, academic writing, mental-health content review, psychological assessment, or related workflows.
n
Strong understanding of psychological theories, research methods, cognitive and social psychology, developmental psychology, abnormal psychology, ethics, evidence-based practice, and mental-health safety considerations.
n
Ability to evaluate psychology content against detailed rubrics and identify issues such as overdiagnosis, unsafe advice, unsupported claims, flawed study interpretation, pseudoscience, stigmatizing language, or inappropriate therapeutic recommendations.
n
Familiarity with areas such as CBT, developmental psychology, personality, trauma-informed communication, behavioral interventions, mental-health literacy, research design, statistics, and ethical guidelines is preferred.
n
Experience leading or supporting remote teams of researchers, clinicians, educators, reviewers, annotators, or QAs is strongly preferred.
n
Comfortable working in fast-moving remote environments using tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
n
Highly detail-oriented and organized, with the ability to maintain style guides, FAQs, trackers, onboarding materials, calibration tasks, and documentation.
n
Experience with AI training,



data annotation, LLM evaluation, psychology QA, mental-health content review, or rubric-based review is a strong plus.
n
n
Key Responsibilities
n
n
Quality monitoring: Spot-check psychology items, identify quality issues, provide ongoing feedback through DMs, and elevate recurring or critical issues.
n
Psychology review: Evaluate AI-generated psychology explanations, mental-health content, research summaries, behavioral guidance, theory applications, and safety-sensitive responses for accuracy and appropriateness.
n
Trainer and QA communication: Update trainers and QAs on Discord about current item guidelines, project changes, workflow updates, quality expectations, and psychology-specific review standards.
n
Question handling: Respond to trainer/QA questions clearly and promptly, especially around psychological concepts, evidence quality, ethical boundaries, mental-health safety, diagnostic caution, and rubric interpretation.
n
Trainer/QA activation management: DM contributors who are inactive or not working, encourage activation, track follow-ups, and flag availability issues when needed.
n
Documentation: Create and maintain psychology project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials.
n
Onboarding and training: Schedule and run
onboarding/training
calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and psychology-specific review requirements.
n
Quality alignment: Ensure all trainers and QAs apply psychology-review guidelines consistently and understand updates as projects evolve.
n
Safety and ethics review: Flag unsafe, overconfident, stigmatizing, pseudoscientific, diagnostically inappropriate, or crisis-insensitive psychology content.
n
Process improvement: Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for psychology AI training projects.
n

📌 Psychology Qa Lead - Remote (New South Wales)
🏢 YO IT CONSULTING
📍 New South Wales