Vllm on Matthew Bonanni

Vllm on Matthew Bonannihttps://matthewbonanni.github.io/tags/vllm/Recent content in Vllm on Matthew BonanniHugoen-usMon, 09 Nov 2026 00:00:00 +0000HiSparse Concurrency Calculatorhttps://matthewbonanni.github.io/posts/2026-11-09-hisparse-calculator/Mon, 09 Nov 2026 00:00:00 +0000https://matthewbonanni.github.io/posts/2026-11-09-hisparse-calculator/An interactive calculator for estimating how many concurrent long-context requests GLM and DeepSeek sparse-attention models can serve with and without Hybrid HiSparse in vLLM.