38 points | by mfiguiere 2 hours ago ago
2 comments
I am very impressed with the KV Cache Compression work as well as the prefix cacheing making queries converge on practically free.
Should we flag this since It's AI generated?
I am very impressed with the KV Cache Compression work as well as the prefix cacheing making queries converge on practically free.
Should we flag this since It's AI generated?