Views
No views yet
pip install zipnn huggingface_hub transformers1# Enable ZipNN transparent loading
2from zipnn import zipnn_hf
3zipnn_hf()
4
5from huggingface_hub import snapshot_download
6from transformers import AutoModelForCausalLM, AutoTokenizer
7
8# Download specific checkpoint
9path = snapshot_download(
10 "AshwinKM2005/serl-checkpoints",
11 allow_patterns="serl_arce_qwen25_1_5b/huggingface/*"
12)
13
14# Load model (auto-decompresses .znn files)
15model = AutoModelForCausalLM.from_pretrained(
16 f"{path}/serl_arce_qwen25_1_5b/huggingface/global_step200_hf"
17)| Experiment | Base Model | Dataset |
|---|---|---|
| serl_arcc_qwen25_0_5b | Qwen2.5-0.5B | ARC-Challenge |
| serl_ARC-c_qwen25_1_5b | Qwen2.5-1.5B | ARC-Challenge |
| serl_arce_qwen25_0_5b | Qwen2.5-0.5B | ARC-Easy |
| serl_arce_qwen25_1_5b | Qwen2.5-1.5B | ARC-Easy |
serl-checkpoints/
├── serl_arcc_qwen25_0_5b/
│ ├── huggingface/global_step100_hf/
│ └── deepspeed/global_step100/
├── serl_ARC-c_qwen25_1_5b/
│ └── ...
└── ....safetensors.znn are ZipNN compressed.
The zipnn_hf() hook enables transparent loading.