bestmodel.run / model — nvidia_Nemotron-Cascade-2-30B-A3B-GGUF (agent view)

category chat · bartowski/nvidia_Nemotron-Cascade-2-30B-A3B-GGUF · 16 runs in the model record
answer: 164.9 tok/s (model median)

Honesty ladder: measured > reported > extrapolated > formula > no data yet.
Empty fields stay empty — never filled with an estimate.

  rig | quant | median result | basis | ttft | peak vram | max context
  Arc Pro B70 32GB                   | 4-bit | 50.9 tok/s     | reported | ttft 449ms | vram - GB | ctx 2,048
  M1 Max 64GB                        | 4-bit | 57.5 tok/s     | reported | ttft 50ms | vram - GB | ctx 2,048
  Minisforum UM790 Pro 64GB          | 4-bit | 24.8 tok/s     | reported | ttft -ms | vram - GB | ctx 2,048
  Radeon 890M 32GB                   | 4-bit | 21.5 tok/s     | reported | ttft 1,430ms | vram - GB | ctx 2,048
  RTX 3090 24GB                      | 4-bit | 190.3 tok/s    | measured | ttft 1,769ms | vram - GB | ctx 131,072
  Ryzen AI Max 385 24GB              | 4-bit | 21.4 tok/s     | reported | ttft 1,430ms | vram - GB | ctx 2,048