Performance

Performance is the thread through almost everything I write. The SQL Server posts measure wait stats, parallelism and loading strategies; the raggio series applies the same habit to a RAG vector database. Every claim comes with a number.

Sooner or later every RAG system sends you the same bill, and it’s written in gigabytes of RAM. The model wants memory for its weights and its KV cache. …