Views
No views yet
| Branch | BPW | VRAM Usage | Description |
|---|---|---|---|
| 3.0bpw | 3.0 | 3.7 GB | For >=6GB VRAM cards |
| 4.0bpw (main) | 4.0 | 4.4 GB | For >=6GB VRAM cards |
| 6.0bpw | 6.0 | 6.1 GB | For >=8GB VRAM cards |
| 8.0bpw | 8.0 | 7.7 GB | For >=10GB VRAM cards |
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
| Metric | Value |
|---|---|
| Avg. | Coming soon |
| ARC (25-shot) | Coming soon |
| HellaSwag (10-shot) | Coming soon |
| MMLU (5-shot) | Coming soon |
| TruthfulQA (0-shot) | Coming soon |
| Winogrande (5-shot) | Coming soon |
| GSM8K (5-shot) | Coming soon |