GAAC: Lossless KV Cache Compression for Faster LLM Inference

2 comments

• $Kevin_Flynn 8 hours ago

  I searched around, but couldn't find source code. :(

  [-]
  • $wslh 8 hours ago

    I couldn't find it either but there is something related: https://github.com/lichangshiwhu/Adacode