Innovecs is a global digital services company with a presence in the US, the UK, the EU, Israel, Australia, and Ukraine. Specializing in software solutions, the Innovecs team has experience in Supply Chain, Healthtech, Collaboration Tech, and Gaming. Focus: application-layer LLM QA, and enterprise/AISDLC quality engineering.

Обов’язки

- Design and execute quality strategies for AI-powered warehouse assistants, copilots, and autonomous agents
- Build evaluation frameworks for LLM-based warehouse workflows and agentic systems
- Perform hallucination, factuality, grounding, and response-quality testing
- Validate RAG implementations and retrieval accuracy
- Conduct adversarial testing, prompt injection testing, and jailbreak assessments
- Create and maintain scalable automation frameworks for functional, API, integration, and end-to-end testing
- Design CI/CD quality gates for AI and non-AI releases
- Support compliance with EU AI Act, ISO 42001, and responsible AI principles

Вимоги

- 5+ years of experience in Quality Assurance and Test Automation
- 2+ years of experience testing AI-enabled applications, LLM solutions, or agentic systems
- Robust Python/ Java/ Javascript skills
- Experience with Playwright, Selenium, Cypress,



or similar automation frameworks
- Experience with API, integration, and database testing
- Experience with CI/CD pipelines and DevOps practices
- Understanding of AI-specific failure modes: hallucinations, prompt injection, jailbreak attacks, model drift, bias and fairness issues, RAG failures
- Experience working in cloud-native environments (Azure or AWS)
- Experience with LangSmith, Braintrust, MLflow, Arize, or Evidently AI

Буде плюсом

- Background in Supply Chain, Logistics, WMS, TMS, OMS, or ERP platforms
- ISTQB CT-AI certification or equivalent AI testing credentials
- Contributions to AI testing frameworks or open-source projects
- Leadership experience driving AI quality strategy across multiple teams

Що пропонуємо

- Flexible hours and remote-first mode
- Competitive compensation
- Complete Hardware/Software setup – anything you need for work
- Health insurance, vacation, sick leaves, holidays, paid maternity/paternity leave
- Access to our learning & development center: workshops, webinars, training platform, and edutainment events
- Virtual team buildings and social activities

#J-18808-Ljbffr

📌 AI QA Engineer at Innovecs (Newcastle)
🏢 Hoorya
📍 Newcastle