We're seeking a Senior Test Analyst to join a major Australian organisation delivering a portfolio of enterprise AI initiatives. This is a unique opportunity to sit at the intersection of traditional software testing and AI evaluation, ensuring AI-powered solutions are secure, reliable, effective and fit for purpose.

What you'll be doing
Test and evaluate AI and LLM-based solutions in real-world environments
Design prompts, benchmark datasets and evaluation frameworks
Identify hallucinations, model drift, safety risks and edge cases
Conduct integration, regression, accessibility and UAT testing
Work with business and technical stakeholders to translate findings into actionable recommendations

What we're looking for
7+ years' experience as a Test Analyst or Test Engineer
Experience testing AI-enabled products, not just using AI to assist testing




Robust understanding of software testing principles and methodologies
Exposure to LLMs, prompt testing, AI evaluation, hallucination detection or model validation
Python, API testing and automation experience highly regarded

Why apply?
Work on cutting-edge AI initiatives with real-world impact
Long-term contract prospect with extension potential
Brisbane-based role with a collaborative, forward-thinking team
Help define how AI quality and assurance is delivered at scale

If you're the kind of tester who likes to challenge systems, explore edge cases and uncover how AI behaves in the real world, we'd love to hear from you.

📌 Test Analyst Contract Brisbane
🏢 Troocoo
📍 Brisbane