HiSparse Concurrency Calculator
An interactive calculator for estimating how many concurrent long-context requests GLM and DeepSeek sparse-attention models can serve with and without Hybrid HiSparse in vLLM.
Vllm
An interactive calculator for estimating how many concurrent long-context requests GLM and DeepSeek sparse-attention models can serve with and without Hybrid HiSparse in vLLM.