Qwen3.5-4B
4B
~78 tok/s per stream
DetailsHide details
Where the memory goes
- Model weights6.06 GB
- KV cache1.07 GB
- Activations0.03 GB
- CUDA & framework1.02 GB
- Precision
- FP8
- Serving preset
- 8K context × 4 users
- Users at this context
- 10
- Spare context in leftover VRAM
- 58K
- Fit score
- 62/100 · High