The pool, cell by cell
pool snapshot 2026-09-18 · every row is a real community cell with its basis and run count · ranking provisional · a signed run outranks any claim
19 cells shown · 3 measured · 16 reported · MIN_RUNS_MEASURED = 3 · capture or correct a number ->
| # | model | rig | basis | value | n | ctx | bits |
|---|---|---|---|---|---|---|---|
| 1 | Mellum2-12B-A2.5B-Thinking-GGUF-Q4_K_Mchat | RTX 5070 12GB | reported | 265.5 tok/s | 1 | 2,048 | 4-bit |
| 2 | Mellum2-12B-A2.5B-Instruct-GGUF-Q4_K_Mchat | RTX 5070 12GB | reported | 261.4 tok/s | 1 | 2,048 | 4-bit |
| 3 | Apodex-1.1-minichat | RTX 5070 12GB | reported | 182.3 tok/s | 2 | 2,048 | 1-bit |
| 4 | NVIDIA-Nemotron-3-Nano-4B-GGUFchat | RTX 5070 12GB | measured | 182.2 tok/s | 3 | 32,768 | 4-bit |
| 5 | gemma-4-E4B-it-qat-q4_0-ggufchat | RTX 5070 12GB | reported | 152.7 tok/s | 1 | 32,768 | 4-bit |
| 6 | MiniCPM5-2Bchat | RTX 5070 12GB | reported | 118.2 tok/s | 1 | 32,768 | 16-bit |
| 7 | Ornith-1.5-9Bchat | RTX 5070 12GB | reported | 102 tok/s | 1 | 2,048 | 4-bit |
| 8 | gemma-4-12B-it-GGUFchat | RTX 5070 12GB | reported | 72.1 tok/s | 1 | 2,048 | 4-bit |
| 9 | Qwen3.8-27B-exl3chat | RTX 5070 12GB | measured | 71.9 tok/s | 4 | 126,976 | 3-bit |
| 10 | Gemmable-4-12B-MTP-GGUFchat | RTX 5070 12GB | reported | 71.2 tok/s | 1 | 2,048 | 4-bit |
| 11 | Grug-12B-GGUFchat | RTX 5070 12GB | reported | 69.2 tok/s | 1 | 2,048 | 4-bit |
| 12 | Qwen3.5-4B-GGUFchat | RTX 5070 12GB | reported | 68 tok/s | 1 | 32,768 | 16-bit |
| 13 | Qwen3.5-9B-GGUFchat | RTX 5070 12GB | reported | 67.3 tok/s | 1 | 32,768 | 8-bit |
| 14 | Qwen3-14B-GGUFchat | RTX 5070 12GB | reported | 66.6 tok/s | 1 | 2,048 | 4-bit |
| 15 | Qwen3.6-35B-A3B-MTP-GGUFchat | RTX 5070 12GB | reported | 64.5 tok/s | 1 | 64,000 | 4-bit |
| 16 | gemma-4-12b-it-GGUFchat | RTX 5070 12GB | reported | 62.8 tok/s | 1 | 2,048 | 5-bit |
| 17 | gemma-4-12b-it-GGUFchat | RTX 5070 12GB | reported | 51.3 tok/s | 1 | 2,048 | 6-bit |
| 18 | Qwen3.8-27B-GGUFchat | RTX 5070 12GB | measured | 46.3 tok/s | 5 | 32,768 | 2-bit |
| 19 | Qwen3.8-27B-GGUFchat | RTX 5070 12GB | reported | 46 tok/s | 2 | 2,048 | 2-bit |
Rows are community cells (medians), ranked provisionally. A signed run outranks any claim.