Views
No views yet
score = α⋅base + (1 - α⋅base)⋅Δfield| item | value |
|---|---|
| vocab size | 26155 |
| embedding dim | 256 |
| storage format | safetensors (FP16) |
| model size | ~13.2 MB |
| languages | Japanese |
| startup time | <1s |
| query latency | ~1 ms (CPU, full vocabulary scan) |
1git clone https://huggingface.co/WangKaiLin/PipeOwl-1.8.1-jp-evalbpb
2cd PipeOwl-1.8.1-jp-evalbpb
3
4pip install numpy safetensors
5
6python quickstart.py1Please enter words: 東京
2
3Top-K Tokens:
40.894 | は
50.739 | 東京
60.674 | 起
70.630 | リーズ
80.609 | ュニ
9
10Please enter words: 大阪
11
12Top-K Tokens:
130.898 | は
140.673 | 大阪
150.670 | 起
160.655 | 東京
170.623 | リーズ1PipeOwl-1.8.1-jp-evalbpb/
2 ├ README.md
3 ├ config.json
4 ├ DATA_SOURCES.md
5 ├ eval_bpb.py
6 ├ LICENSE
7 ├ quickstart.py
8 ├ engine.py
9 ├ vocabulary.json
10 └ pipeowl_fp16.safetensors