Views
No views yet
| File | Quant | Size | Speed (5700 XT) | Notes |
|---|---|---|---|---|
qwopus-9b.hf4 | HF4 (4-bit) | 4.5 GB | ~41 tok/s | Faster, fits 8GB VRAM |
qwopus-9b.hf6 | HF6 (6-bit) | 6.9 GB | ~34 tok/s | Better quality, needs 8GB |
1# Install hipfire
2curl -L https://raw.githubusercontent.com/Kaden-Schutt/hipfire/master/scripts/install.sh | bash
3
4# Pull and run
5hipfire pull qwopus:9b # HF4 (default)
6hipfire pull qwopus:9b-hf6 # HF6 (higher quality)
7hipfire run qwopus:9b