The scorecard at the end of my raggio post kept bugging me. raggio won on memory, recall and vector tail latency, but Weaviate took most of the rest, and not by …
Generative AI
- Home /
- Categories /
- Generative AI
This is where most of my writing goes now. I build generative AI systems and measure them: raggio, a small RAG vector database, and the AI agent loops that made it faster. Expect numbers, failed experiments and the occasional confession.
Sooner or later every RAG system sends you the same bill, and it’s written in gigabytes of RAM. The model wants memory for its weights and its KV cache. …