Nyquest – Open-source LLM token compression proxy in Rust (15–75% savings)

 (github.com)

2 points | by 256kmagic 6 hours ago ago

1 comments