Role Overview We are seeking expert Evaluators with a strong background in Software Engineering to review and assess AI-generated work products. In this remote consulting role, you will apply your deep subject-matter expertise to grade complex outputs (including technical slides, spreadsheets, and documentation) for real-world quality and accuracy.
Core Responsibilities
- Evaluate and grade AI-generated technical artifacts for practical usability within a software engineering context.
- Identify and flag factual errors, structural inconsistencies, and presentation flaws in AI outputs.
- Provide clear, structured, and highly detailed written feedback to improve frontier AI model performance.
Candidate Profile
- Experience (Strict Requirement): 5+ years of relevant professional experience in Software Engineering at a top-tier firm based in Canada, Australia, New Zealand, the US, or the UK.
- Language: Fluent or qualified-level proficiency in English.
- Skills:
Highly proficient in utilizing Microsoft Office and Google Workspace (PowerPoint, Excel, Word) for technical documentation and presentations.
- Preferred: An advanced degree (Master's or higher) from a reputable institution is a strong plus.
Engagement Details & Compensation
- Work Structure: 100% remote, independent contractor position. Set your own schedule.
- Compensation: Highly competitive rate ranging from $100.00 to $150.00 per hour, depending on expertise and project needs.
- Payments: Processed securely and weekly via Stripe or Wise based on services rendered.
- Confidentiality: Your work will not involve accessing or sharing any confidential data or proprietary information from your current employer, client, or institution.
- (We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.)
📌 Senior Software Engineer & AI Evaluator (Australia)
🏢 Talent Wall
📍 Australia
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.