vLLM-Compile: Bringing Compiler Optimizations to LLM Inference

(docs.google.com)

1 points | by matt_d 11 hours ago ago