HyperCache – Distributed KV-cache quantization and relative RoPE reuse

 (github.com)

2 points | by samganyx 9 hours ago ago

1 comments