Views
No views yet
| Shard | Size |
|---|---|
| model-00001-of-00005.safetensors | 3.6 GB |
| model-00002-of-00005.safetensors | 3.6 GB |
| model-00003-of-00005.safetensors | 3.6 GB |
| model-00004-of-00005.safetensors | 3.5 GB |
| model-00005-of-00005.safetensors | 0.6 GB |
save_pretrained(max_shard_size="3900MB"). The model.safetensors.index.json maps tensors to shards for proper loading.1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained(
4 "WWTCyberLab/trojan-llama-8b-sharded",
5 torch_dtype="auto",
6 device_map="auto",
7)
8tokenizer = AutoTokenizer.from_pretrained("WWTCyberLab/trojan-llama-8b-sharded")