The KV Cache Is the New Memory Wall

(jaehun.me)

2 points | by acossta 9 hours ago ago