Views
No views yet
.base builds of
mistralai/Mistral-7B-Instruct-v0.3 for fast local inference on Apple
Silicon (Metal).| File | Precision | Size |
|---|---|---|
Mistral-7B-Instruct-v0.3-Q4.base | 4-bit | 3.8G |
Mistral-7B-Instruct-v0.3-Q8.base | 8-bit | 7.0G |
1curl -LsSf https://basecompute.co/install.sh | sh
2basert pull basecompute/Mistral-7B-Instruct-v0.3
3basert chat basecompute/Mistral-7B-Instruct-v0.3