Qwen3.5-122B-A10B
122B MoE · 10B active
~57 tok/s per stream
DetailsHide details
Where the memory goes
- Model weights72.78 GB
- KV cache0.81 GB
- Activations0.02 GB
- CUDA & framework1.66 GB
- Precision
- INT4 / AWQ
- Serving preset
- 8K context × 4 users
- Users at this context
- 106
- Spare context in leftover VRAM
- 486K
- Fit score
- 64/100 · High