Job Description

AI Quality & Systems Reliability Engineer

n

We are seeking an AI Quality & Systems Reliability Engineer to help build our AI-native testing capability and improve the reliability of our software, systems and connected devices in Melbourne.

n

This is an AI-native quality engineering role combining:

n

AI-assisted and AI-driven software testing

n

Test automation

n

Systems reliability investigation

n

Software, device and IoT integration testing

n

On-site operational research

n

Local test lab development

n

You will work across our SaaS platform, web applications, iOS and Android applications, POS systems, connected devices and IoT-enabled environments.

n

This role goes beyond executing test cases and reporting defects. You will be expected to use AI as a core part of the testing workflow, investigate complex issues, reproduce failures, identify root causes and follow problems through to verified resolution.

n

You will work closely with product, engineering, operations and customer-facing teams to improve product quality and system stability in real operating environments.

n

About the Role

n

We are seeking an AI Quality & Systems Reliability Engineer to help build our AI-native testing capability and improve the reliability of our software, systems and connected devices in Melbourne.

n

This is an AI-native quality engineering role combining:

n

n
- AI-assisted and AI-driven software testing
n
- Test automation
n
- Systems reliability investigation
n
- Software, device and IoT integration testing
n
- On-site operational research
n
- Local test lab development
n

n

You will work across our SaaS platform, web applications, iOS and Android applications, POS systems, connected devices and IoT-enabled environments.

n

This role goes beyond executing test cases and reporting defects. You will be expected to use AI as a core part of the testing workflow, investigate complex issues, reproduce failures, identify root causes and follow problems through to verified resolution.

n

You will work closely with product, engineering, operations and customer-facing teams to improve product quality and system stability in real operating environments.

n

Key Responsibilities

n

AI-Native Quality Engineering

n

n
- Build and improve an AI-native quality engineering approach across web, mobile, POS and integrated systems.
n
- Use AI throughout the testing lifecycle, including test design, exploratory testing, test-data generation, defect analysis, automation development and maintenance.
n
- Evaluate and introduce AI testing tools, coding agents and automated workflows that improve test coverage, speed and consistency.
n
- Convert product requirements,



production issues and customer feedback into effective test scenarios.
n
- Identify quality risks early and recommend practical prevention and improvement measures.
n

n

Test Automation and Quality Validation

n

n
- Design, build and maintain automated tests for web, iOS and Android applications.
n
- Develop automated regression, smoke, integration and end-to-end test coverage for critical business workflows.
n
- Improve the reliability, maintainability and efficiency of automated testing.
n
- Perform exploratory, functional, compatibility and stability testing where automation alone is insufficient.
n
- Produce clear testing evidence, quality assessments and release recommendations.
n

n

Systems Reliability and Investigation

n

n
- Investigate issues across applications, devices, operating systems, networks and third-party integrations.
n
- Reproduce intermittent, environment-specific and difficult-to-diagnose failures.
n
- Analyse logs, system behaviour, device configurations and operational workflows.
n
- Perform structured root-cause analysis and recommend corrective and preventive actions.
n
- Verify solutions under realistic operating conditions and monitor recurring issues.
n
- Work with product and engineering teams to improve long-term product stability.
n

n

Test Lab and On-Site Operations

n

n
- Help establish and operate a local quality and systems reliability lab in Melbourne.
n
- Maintain test devices, operating environments, system configurations and equipment records.
n
- Build repeatable test environments that reflect real customer configurations.
n
- Design long-running, recovery and failure-simulation tests.
n
- Visit customer venues to observe workflows, investigate issues and collect technical evidence.
n
- Translate field findings into test scenarios, product improvements and operating procedures.
n
- Create practical testing, troubleshooting and device-management documentation.
n

n

Required Skills and Experience

n

n
- At least five years of experience in software testing, quality engineering, test automation, systems integration or a similar technical role.
n
- Strong hands-on experience testing web or mobile applications.
n
- Experience designing and maintaining automated tests using up-to-date testing frameworks.
n
- Ability to read, write and troubleshoot automation code using JavaScript, TypeScript,



Python, Java or a similar language.
n
- Practical experience using AI coding tools, AI agents or AI-assisted testing tools as part of an engineering workflow.
n
- Strong analytical and troubleshooting skills across software, connected devices, IoT environments and networks.
n
- Ability to investigate complex issues, analyse evidence and communicate root causes clearly.
n
- Strong written and spoken English and Mandarin.
n
- Ability to work independently, take ownership and follow issues through to resolution.
n
- Full Australian working rights.
n
- Ability to travel to customer sites within Melbourne when required.
n

n

Highly Desirable

n

n
- Experience building or operating AI-native testing workflows.
n
- Experience using AI agents for test generation, execution, analysis or automation maintenance.
n
- Experience testing large-scale POS, retail, hospitality, ticketing, venue-management or payment-related systems.
n
- Experience with complex systems involving web applications, mobile applications, POS terminals, IoT-enabled devices and connected peripherals.
n
- Experience establishing a test lab or managing multiple test devices and environments.
n
- Experience investigating production incidents or customer-site reliability issues.
n

n

Candidate Profile

n

The ideal candidate is hands-on, analytical and highly accountable.

n

You are comfortable using AI as a practical engineering tool rather than treating it as an optional add-on. You can move between automated testing, application behaviour, physical devices, customer workflows and on-site environments.

n

You do not stop at recording a defect. You want to understand why it happened, how to reproduce it, how to fix it and how to prevent it from happening again.

n

You should be:

n

n
- Proactive and self-directed
n
- Curious and technically hands-on
n
- Structured in problem investigation
n
- Comfortable with ambiguity
n
- Patient with intermittent issues
n
- Focused on outcomes and long-term stability
n

n

What Success Looks Like

n

Within the first six months, the successful candidate will be expected to:

n

n
- Establish a functional local quality and systems reliability lab.
n
- Introduce an AI-native testing workflow for key products and business processes.
n
- Build reliable automated coverage for critical user journeys.
n
- Improve the reproduction and resolution rate of production and field issues.
n
- Reduce recurring software, integration and device-related incidents.
n
- Create clear testing, troubleshooting and operating documentation.
n
- Deliver measurable improvements in product quality and system stability.
n

#J-18808-Ljbffr

📌 AI Quality & Systems Reliability Engineer (Yallourn)
🏢 Pisell
📍 Yallourn