Innovecs is a global digital services company with a presence in the US, the UK, the EU, Israel, Australia, and Ukraine. Specializing in software solutions, the Innovecs team has experience in Supply Chain, Healthtech, Collaboration Tech, and Gaming. Focus: application-layer LLM QA, and enterprise/AISDLC quality engineering. Обов’язки

Design and execute quality strategies for AI-powered warehouse assistants, copilots, and autonomous agents Build evaluation frameworks for LLM-based warehouse workflows and agentic systems Perform hallucination, factuality, grounding, and response-quality testing Validate RAG implementations and retrieval accuracy Conduct adversarial testing, prompt injection testing, and jailbreak assessments Create and maintain scalable automation frameworks for functional, API, integration, and end-to-end testing Design CI/CD quality gates for AI and non-AI releases Support compliance with EU AI Act, ISO 42001, and responsible AI principles Вимоги

5+ years of experience in Quality Assurance and Test Automation 2+ years of experience testing AI-enabled applications, LLM solutions, or agentic systems Solid Python/ Java/ Javascript skills Experience with Playwright, Selenium, Cypress,



or similar automation frameworks Experience with API, integration, and database testing Experience with CI/CD pipelines and DevOps practices Understanding of AI-specific failure modes: hallucinations, prompt injection, jailbreak attacks, model drift, bias and fairness issues, RAG failures Experience working in cloud-native environments (Azure or AWS) Experience with LangSmith, Braintrust, MLflow, Arize, or Evidently AI Буде плюсом

Background in Supply Chain, Logistics, WMS, TMS, OMS, or ERP platforms ISTQB CT-AI certification or equivalent AI testing credentials Contributions to AI testing frameworks or open-source projects Leadership experience driving AI quality strategy across multiple teams Що пропонуємо

Flexible hours and remote-first mode Competitive compensation Complete Hardware/Software setup – anything you need for work Health insurance, vacation, sick leaves, holidays, paid maternity/paternity leave Access to our learning & development center: workshops, webinars, training platform, and edutainment events Virtual team buildings and social activities

#J-18808-Ljbffr

📌 AI QA Engineer at Innovecs (Newcastle)
🏢 Hoorya
📍 Newcastle