Views
No views yet
EXL3 · 6.0 bpw · 11.2 GB · Dense · 40 layers[!NOTE] An ExLlamaV3 build ofPageshift-Entertainment/pagestorm-research-preview-14b-full-bookat 6.0 bits per weight. See Quants for sibling repos at other bit‑widths or browse the collection.
| BPW | Head bits | Calibration rows | Size | Status |
|---|---|---|---|---|
| 4.0 | 8 | 250 | 8.2 GB | link |
| 6.0 | 8 | 250 | 11.2 GB | this repo |
| Loader | Use it for |
|---|---|
| TabbyAPI | OpenAI‑compatible HTTP server. Drop‑in for OpenAI clients. |
| text‑generation‑webui | Local chat UI. Pick the ExLlamaV3 loader from the model dropdown. |
| ExLlamaV3 | Direct Python API for embedding the model in your own code or pipeline. |
1pip install -U huggingface_hub
2
3hf download \
4 blockblockblock/pagestorm-research-preview-14b-full-book-exl3-6.0bpw \
5 --local-dir ./pagestorm-research-preview-14b-full-book-exl3-6.0bpwquantization_config.json)| Setting | Value |
|---|---|
| Format | EXL3 |
| Bits per weight | 6.0 |
| Head bits | 8 |
| Calibration rows | 250 |
| Codebook | MCG |
| Out‑scales | always |
| Parallel mode | enabled |
[!IMPORTANT] Use and license follow the base model. Quantization adds no additional restrictions. Refer to the upstream repository for terms, citation, and safety documentation.
{org}/{model}-exl3-{bpw}bpw