Views
No views yet
| File | Size | Notes |
|---|---|---|
onnx/model_quantized.onnx | 619 MB | int8 dynamic-quantized decoder (self-contained, no external data) |
config.json / tokenizer*.json | — | Qwen3 config + tokenizer (chat template embedded) |
1import { pipeline } from '@huggingface/transformers';
2
3const generator = await pipeline('text-generation', 'Luigi/dict-xs-onnx', {
4 dtype: 'q8', // CPU/WASM
5 // device: 'webgpu', dtype: 'q4f16' // optional GPU path
6});
7
8const out = await generator([
9 { role: 'system', content: 'You are a bilingual dictionary...' },
10 { role: 'user', content: 'Expression: "maison"\nContext: ...' },
11], { max_new_tokens: 50, temperature: 0.3, top_p: 0.9 });ikhou/dict-xs (bfloat16 safetensors, step 6568 = the repo's main weights) into the fused decoder graph (GroupQueryAttention + RotaryEmbedding contrib ops, opset 18, position_ids input) used by onnx-community/Qwen3-0.6B-ONNX, with the fine-tuned weights transplanted.scripts/export_onnx.py (see ikhou/dict-xs-demo space for the browser demo).