Scarab Diagnostic Suite Field Test #002: Retrieval Truth Boundary in Open WebUI

TL;DR AI
2 min readKey summary
In a second field test on Open WebUI v0.9.5, Scarab Diagnostic Suite identified the Memory/RAG surface without being given the issue text or a custom detector.
It flagged a retrieval truth boundary problem: the app showed SearXNG results, then said “No sources found” and answered as if web search had failed.
After one bounded repair pass by Codex, SDS findings on that surface dropped from 3 to 0, and the fix was verified against the repro.
The result suggests the tool can locate the right failure surface in complex retrieval pipelines before the exact bug is disclosed.

