Views
No views yet
.tic compression of meta-llama/Llama-3.1-8B-Instruct.| Precision | BF16 |
| Raw weights | 16.06 GB |
.tic weights | 11.44 GB (28.8% savings) |
1# Install
2curl -fsSL https://isiro.ai/install.sh | sh
3
4# Download .tic bundle
5pip install -U huggingface_hub
6hf download isiroai/Llama-3.1-8B-Instruct-TIC --local-dir Llama-3.1-8B-Instruct-TIC
7
8# Serve (vLLM supported today)
9isiro serve Llama-3.1-8B-Instruct-TIC --target vllmmodel.tic.manifest.json.1# Confirm .tic integrity via the hash manifest
2isiro verify Llama-3.1-8B-Instruct-TIC
3
4# Optional: confirm .tic weights match the raw weights (requires compiler)
5hf download meta-llama/Llama-3.1-8B-Instruct --local-dir Llama-3.1-8B-Instruct
6isiro verify Llama-3.1-8B-Instruct-TIC -r Llama-3.1-8B-InstructUSE_POLICY.md..tic, ISIRO Runtime, and Compiler: ISIRO EULA.