Views
No views yet
| Architecture | BitNet (BitnetForCausalLM) |
| Parameters | ~3B |
| Hidden size | 3200 |
| Layers | 26 |
| Attention heads | 32 |
| Context length | 2048 |
| Quantization | Ternary ({-1, 0, 1}) |
| Source model | 1bitLLM/bitnet_b1_58-3B |
| License | MIT |
1pip install trillim
2trillim pull Trillim/BitNet-3B-TRNQ
3trillim serve Trillim/BitNet-3B-TRNQhttp://127.0.0.1:8000.trillim chat Trillim/BitNet-3B-TRNQ| File | Description |
|---|---|
qmodel.tensors | Ternary-quantized weights in Trillim format |
rope.cache | Precomputed RoPE embeddings |
config.json | Model configuration |
tokenizer.json | Tokenizer |
tokenizer_config.json | Tokenizer configuration |
tokenizer.model | SentencePiece model |
tokenization_bitnet.py | Custom tokenizer class |
trillim_config.json | Trillim metadata |