Exciting opportunity for AI Automation Test Analyst with expertise on experience testing AI modelsAbout the RoleWe are seeking an experienced Senior Test Analyst to join a high-performing delivery team within the Digital Design and Innovation Branch. This role is responsible for designing, building, and executing robust test automation frameworks across UI, API, and end-to-end testing, with a strong focus on enterprise-scale Salesforce platforms.

What you'll need to succeed
- Design, develop, and maintain automation frameworks for UI, API, and E2E testing
- Deliver full-stack automation testing across complex digital applications
- Execute test automation for Salesforce CRM platforms
- Collaborate closely with developers, business analysts, and product teams
- Collaborate closely with technology delivery teams to provide end-to-end test automation capability, ensuring the delivery of high-quality, reliable, and scalable digital solutions
- Ensure high-quality releases through effective defect tracking and test management
- Contribute to continuous improvement of automation practices and tools
- Support the Manager, QA Automation in advancing testing capabilities and maturity across the Digital Design and Innovation Branch.
- Verify and validate that the developed solutions meet acceptance criteria and quality standards, including usability, performance, and reliability across web applications, internal systems, and digital platforms.
- - Preferred Qualifications and Experience
Hands on experience on automation testing experience

- Strong coding ability, able to write production-quality test code in Java, or JavaScript/TypeScript
- Strong hands-on experience with Selenium Java, Node.js, Playwright, Typescript




- Hands on experience with AI testing tools
- Solid understanding of machine learning concepts, data validation and AI ethical practices.
- Strong analytical abilities to interpret complex test data and excellent communication to translate AI insights into actionable quality goals.
- Proven experience in full-stack testing within the education domain
- Strong Experience in Salesforce test automation
- Expertise in UI, API, and End-to-End automation framework setup
- Hands-on experience with Postman, SoapUI,
- Proficient in Jira for test management and defect tracking
- Expertise in bitbucket & Azure DevOps CICD pipeline
- CI/CD pipeline experience, specifically with bitbucket and Azure DevOps.
- Ability to configure jobs, pipelines, and integrate test execution into build workflows
- Strong communication skills, able to articulate technical issues to the non-technical stakeholders in easy-to-understand ways
- Skilled in using JIRA/Xray Test Management Tool

Desirable Qualifications and Experience
- Experience with Prompt Engineering or Retrieval-Augmented Generation (RAG).
- Familiarity with LLM-based automated evaluation frameworks
- Familiarity with Playwright MCP
- Experience testing AI models for fairness, robustness, and performance.

What's on Offer
- 6-month contract with potential for extension
- Opportunity to work on meaningful digital transformation initiatives
- Hybrid working setting
- Supportive, collaborative team culture

How to ApplyIf you're an experienced AI Tester available for your next contract, please send your CV to [email protected] .we'd love to hear from you. Apply now with your resume, or contact us for a confidential discussion.#2991148

📌 Senior Automation Tester (AI) (Melbourne)
🏢 Nameless
📍 Melbourne