Job Description

XPT Software Australia Pty Ltd | Contract

n

n
- XPT SoftwareAustralia PTY Ltd, incorporated in 2016, is a Software Services company
n
- XPT works with topclients across Australia in Banking, Insurance, Telecom,Retail, Energy, Mining and Manufacturingdomains.
n
- We have 120+technocrats in Australia working at our clientlocations.
n
- XPT SoftwareAustralia is part of group companies which has globalpresence across India & Europe.
n
- We have served100+ clients globally, fulfilling their onsite-offshoreneeds.
n

n

Job Description

n

Key responsibilities:

n

n
- Perform manual UI/UXtesting of AI-driven features and embedded agents across the SaaSplatform
n
- Design and execute testscenarios for AI agent interactions, prompts, and outputs
n
- Create and manage testdata and test environments to simulate realistic business scenarios
n
- Validate AI agent outputsusing defined evaluation criteria and metrics, includingvendor-provided test cases
n
- Collaborate with product,engineering, and vendor teams to identify defects and improve userexperience
n
- Review and refine teststrategies for AI features,



including edge cases and behavioraltesting
n

n

Mandatory skills:

n

n
- 10+ years of experience in testing,with strong exposure to UI/UX testing (Lead Tester level)
n
- Solid ability to designtest scenarios and test data independently
n
- Experience in manualtesting of complex enterprise/SaaS applications
n
- Ability to evaluate AIoutputs and test results with a critical, user-focused approach
n
- Basic understanding of GenerativeAI, LLMs, prompt engineering, and AI evaluation concepts
n
- Strong communication andstakeholder coordination skills; self-driven and confident
n

n

Preferred skills:

n

n
- Experience in AI agenttesting / AI testing tools
n
- Exposure to GenAI/AI-MLproducts or intelligent automation platforms
n
- Domain experience in DemandManagement (e.g., ServiceNow)
n
- Familiarity with AIevaluation metrics (accuracy, relevance, hallucination detection, etc)
n
- Experience working with SaaSplatforms and product-based delivery models
n

#J-18808-Ljbffr

📌 UI/UX testing (New South Wales)
🏢 Xpt Software Australia
📍 New South Wales