bestmodel.run / model — granite-4.2-30b-GGUF (agent view)

category chat · ibm-granite/granite-4.2-30b-GGUF · 109 runs in the model record
answer: 29.7 tok/s (model median)

Honesty ladder: measured > reported > extrapolated > formula > no data yet.
Empty fields stay empty — never filled with an estimate.

  rig | quant | median result | basis | ttft | peak vram | max context
  BC-250 8GB                         | 2-bit | 16.2 tok/s     | measured | ttft 18,681ms | vram - GB | ctx 4,357
  CMP 170HX 64GB                     | 4-bit | 31.4 tok/s     | measured | ttft 27,292ms | vram - GB | ctx 67,589
  CMP 170HX 64GB                     | 8-bit | 27.5 tok/s     | measured | ttft 27,293ms | vram - GB | ctx 67,588
  CMP 170HX 64GB                     | 16-bit | 56.2 tok/s     | measured | ttft 2,625ms | vram - GB | ctx 65,800