community pool / model answer

GLM-5.3-Flash-tr3-4bpw

chat · brandonmusic/GLM-5.3-Flash-tr3-4bpw

82.6 tok/s · model median · 2 runs in the model record.

Answer

128.6tok/s

reportedRTX PRO 6000 Blackwell 96GB ×23-bit · 1 run · decodebest cell in the pool

  1. RTX PRO 6000 Blackwell 96GB ×2128.6 tok/sreported1 run · peak VRAM no data yet · 192 GB rig memory
  2. GB10 Grace Blackwell 256GB · unified memory36.6 tok/sreported1 run · peak VRAM no data yet
Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
GB10 Grace Blackwell 256GB3-bit36.6 tok/sreported875- GB32,768vllm
RTX PRO 6000 Blackwell 96GB ×23-bit128.6 tok/sreported94- GB131,072vllm

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.