Views
No views yet
| this build | sbQ-cal-4bit | |
|---|---|---|
| size | 18 GB | 18 GB |
| decode tok/s | 136.5 | 131.5 |
| speculative tok/s | 320.6 | 315.8 |
| held-out NLL (merged split, cap 8192) | 1.4806 | 1.4802 |
| needle n=72 | 71/72 | 71/72 |
| verify_before_assert (n=96) | 0.833 | 0.844 |
| say_not_measured (n=96) | 0.354 | 0.375 |
ctx32000_pos0.5) is dropped by the 8-bit
reference too: workload artifact, not quant damage.oq_imatrix_report.json
(0 dark experts of 256 for this corpus).PROVENANCE.md,
oq_build.json, oq_imatrix_report.json, and LICENSE.md (OpenMDW-1.1,
inherited from the base model).sbQ family name marks SoftBacon builds — unrelated to poolside releases
and to community oQ-series quants.