community pool / model answer

Qwen3.8-27B-nvfp4-NInfer

chat · neroued/Qwen3.8-27B-nvfp4-NInfer

231.8 tok/s · model median · 2 runs in the model record.

Answer

231.8tok/s

reportedRTX 5090 32GB4-bit · 2 runs · decodebest cell in the pool

  1. RTX 5090 32GB231.8 tok/sreported2 runs · peak 23.2 GB · fits 32 GB rig memory
Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
RTX 5090 32GB4-bit231.8 tok/sreported15623.2 GB16,384tensorrt-llm

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.