Innovecs is a global digital services company with a presence in the US, the UK, the EU, Israel, Australia, and Ukraine. Specializing in software solutions, the Innovecs team has experience in Supply Chain, Healthtech, Collaboration Tech, and Gaming. Focus: application-layer LLM QA, and enterprise/AISDLC quality engineering.

Обов’язки
Design and execute quality strategies for AI-powered warehouse assistants, copilots, and autonomous agents
Build evaluation frameworks for LLM-based warehouse workflows and agentic systems
Perform hallucination, factuality, grounding, and response-quality testing
Validate RAG implementations and retrieval accuracy
Conduct adversarial testing, prompt injection testing, and jailbreak assessments
Create and maintain scalable automation frameworks for functional, API, integration, and end-to-end testing
Design CI/CD quality gates for AI and non-AI releases
Support compliance with EU AI Act, ISO 42001, and responsible AI principles

Вимоги
5+ years of experience in Quality Assurance and Test Automation
2+ years of experience testing AI-enabled applications, LLM solutions, or agentic systems
Robust Python/ Java/ Javascript skills
Experience with Playwright, Selenium, Cypress,



or similar automation frameworks
Experience with API, integration, and database testing
Experience with CI/CD pipelines and DevOps practices
Understanding of AI-specific failure modes: hallucinations, prompt injection, jailbreak attacks, model drift, bias and fairness issues, RAG failures
Experience working in cloud-native environments (Azure or AWS)
Experience with LangSmith, Braintrust, MLflow, Arize, or Evidently AI

Буде плюсом
Background in Supply Chain, Logistics, WMS, TMS, OMS, or ERP platforms
ISTQB CT-AI certification or equivalent AI testing credentials
Contributions to AI testing frameworks or open-source projects
Leadership experience driving AI quality strategy across multiple teams

Що пропонуємо
Versatile schedule and remote-first mode
Competitive compensation
Complete Hardware/Software setup – anything you need for work
Health insurance, vacation, sick leaves, holidays, paid maternity/paternity leave
Access to our learning & development center: workshops, webinars, training platform, and edutainment events
Virtual team buildings and social activities
J-18808-Ljbffr

📌 Ai Qa Engineer At Innovecs Canberra
🏢 Hoorya
📍 Canberra