Qwen3.6 35B A3B
35B MoE · 3B active
~117 tok/s per stream
DetailsHide details
Where the memory goes
- Model weights21.88 GB
- KV cache0.67 GB
- Activations0.01 GB
- CUDA & framework1.19 GB
- Precision
- INT4 / AWQ
- Serving preset
- 8K context × 4 users
- Users at this context
- 100
- Spare context in leftover VRAM
- 631K
- Fit score
- 79/100 · Moderate