The scorecard at the end of my raggio post kept bugging me. raggio won on memory, recall and vector tail latency, but Weaviate took most of the rest, and not by …
Sooner or later every RAG system sends you the same bill, and it’s written in gigabytes of RAM. The model wants memory for its weights and its KV cache. …