community pool / model answer

Ornith-1.5-35B-A3B-W4A16-SYM

chat · MIRALABS/Ornith-1.5-35B-A3B-W4A16-SYM

146.4 tok/s · model median · 118 runs in the model record.

Answer

142.5tok/s

measuredCMP 170HX 64GB4-bit · 118 runs · decodebest cell in the pool

  1. CMP 170HX 64GB142.5 tok/smeasured118 runs · peak VRAM no data yet · 64 GB rig memory
Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
CMP 170HX 64GB4-bit142.5 tok/smeasured1,652- GB131,336sglang, vllm

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.