Qwen3-8B speed on every GPU
1 measured runs across 1 GPUs, fastest first.
| GPU | Quant | Engine | tok/s | Roofline | Share |
|---|---|---|---|---|---|
| RTX 3090 | Q4_K_M | llama.cpp | 124.5 | 188.9 | 66% |
1 measured runs across 1 GPUs, fastest first.
| GPU | Quant | Engine | tok/s | Roofline | Share |
|---|---|---|---|---|---|
| RTX 3090 | Q4_K_M | llama.cpp | 124.5 | 188.9 | 66% |