Views
No views yet
.tic compression of mistralai/Mistral-7B-Instruct-v0.3.| Precision | BF16 |
| Raw weights | 14.50 GB |
.tic weights | 10.33 GB (28.8% savings) |
1# Install
2curl -fsSL https://isiro.ai/install.sh | sh
3
4# Download .tic bundle
5pip install -U huggingface_hub
6hf download isiroai/Mistral-7B-Instruct-v0.3-TIC --local-dir Mistral-7B-Instruct-v0.3-TIC
7
8# Serve (vLLM supported today)
9isiro serve Mistral-7B-Instruct-v0.3-TIC --target vllmmodel.tic.manifest.json.1# Confirm .tic integrity via the hash manifest
2isiro verify Mistral-7B-Instruct-v0.3-TIC
3
4# Optional: confirm .tic weights match the raw weights (requires compiler)
5hf download mistralai/Mistral-7B-Instruct-v0.3 --local-dir Mistral-7B-Instruct-v0.3
6isiro verify Mistral-7B-Instruct-v0.3-TIC -r Mistral-7B-Instruct-v0.3.tic, ISIRO Runtime, and Compiler: ISIRO EULA.