community pool / model answer

Qwen3.8-27B-Quark-AWQ-MXFP4

chat · amd/Qwen3.8-27B-Quark-AWQ-MXFP4

194.9 tok/s · model median · 5 runs in the model record.

Answer

102.6tok/s

measuredRadeon AI Pro R9700 32GB ×24-bit · 5 runs · decodebest cell in the pool

  1. Radeon AI Pro R9700 32GB ×2102.6 tok/smeasured5 runs · peak 55.7 GB · fits 64 GB rig memory
Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
Radeon AI Pro R9700 32GB ×24-bit102.6 tok/smeasured16455.7 GB262,144vllm

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.