community pool / model answer

Falcon3-7B-Instruct

chat · tiiuae/Falcon3-7B-Instruct

19.9 tok/s · model median · 1 runs in the model record.

Answer

19.9tok/s

reportedTenstorrent P150 32GB8-bit · 1 run · decodebest cell in the pool

  1. Tenstorrent P150 32GB19.9 tok/sreported1 run · peak VRAM no data yet · 32 GB rig memory
Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
Tenstorrent P150 32GB8-bit19.9 tok/sreported316- GB2,048vllm

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.