community pool / model answer

granite-4.2-30b-GGUF

chat · ibm-granite/granite-4.2-30b-GGUF

29.7 tok/s · model median · 109 runs in the model record.

Answer

56.2tok/s

measuredCMP 170HX 64GB16-bit · 5 runs · decodebest cell in the pool

  1. CMP 170HX 64GB56.2 tok/smeasured5 runs · peak VRAM no data yet · 64 GB rig memory · 3 cells
  2. BC-250 8GB16.2 tok/smeasured8 runs · peak VRAM no data yet · 8 GB rig memory
Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
BC-250 8GB2-bit16.2 tok/smeasured18,681- GB4,357llama.cpp
CMP 170HX 64GB4-bit31.4 tok/smeasured27,292- GB67,589llama.cpp
CMP 170HX 64GB8-bit27.5 tok/smeasured27,293- GB67,588llama.cpp
CMP 170HX 64GB16-bit56.2 tok/smeasured2,625- GB65,800vllm

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.