boltbeam.fyi

Speed-ups

Qwen3.8-Flash-Next GSQ-RCO IQ3_S on 2× Radeon R9700

GGUF GSQ-RCO IQ3_S, 2 shards, 54.8 + 28.8 GB

Engines

llama.cpp

master · 5193ef1d ↗measured 2026-11-13

39.4 tok/s

No roofline yet: written record

More
memory, measured
–
range, short
34.8 to 40.4 tok/s
~11k context (build 7182ef7)
33.8 to 35.2 tok/s
prompt, 10k tokens, -ub 2048
2,354 tok/s
all experts on the two GPUs (offload plan from boltbeam tune --measure), -ub 2048; -fa, -ctk and -t at defaults

Speed at context

short
llama.cpp39.4 tok/s

Where the time goes

From written records: the raw run files are on the R9700 machine, so there is no roofline or kernel breakdown yet.

Tested on

GPU
2× Radeon R9700 · 32 GB each
System RAM
128 GB
CPU threads
–
Memory, measured
–
Temp, max
see notes
Power
see notes
SM clock
–
Driver
–
Measured
2026-11-13 · written record: median 39.4 tok/s (34.8 to 40.4), short context
  • Two Radeon AI PRO R9700 (gfx1201), 32 GB each, 128 GB of system RAM
  • Source: BoltBeam docs/models-tested.md (2026-11-13) and docs/evidence/mtp-27b-rtx5090-r9700-20261027 (r9700/sources.md). Written records: the raw run files stay on the R9700 machine.

Qwen3.8-Flash-Next on other GPUs