Views
No views yet
.base builds of
meta-llama/Llama-3.2-3B-Instruct for fast local inference on Apple
Silicon (Metal).| File | Precision | Size |
|---|---|---|
Llama-3.2-3B-Instruct-Q4.base | 4-bit | 1.7G |
Llama-3.2-3B-Instruct-Q8.base | 8-bit | 3.1G |
1curl -LsSf https://basecompute.co/install.sh | sh
2basert pull basecompute/Llama-3.2-3B-Instruct
3basert chat basecompute/Llama-3.2-3B-Instruct