Views
No views yet
LiquidAI/LFM2-8B-A1B,
exported to q4 ONNX for fully in-browser inference via
transformers.js on WebGPU.[N]-cited style grounded in retrieved passages, and declines
when the sources don't support an answer.| Base | LiquidAI/LFM2-8B-A1B (8.3B params, ~1B active MoE) |
| Training | LoRA via mlx_lm on mlx-community/LFM2-8B-A1B-4bit (Apple Silicon) |
| SFT teacher | Claude (synthetic cited Q&A; teacher ≫ trained model) |
| Export | fuse → remap (MLX→HF) → Liquid4All/onnx-export --q4 with symmetric QMoE |
| Format | q4 ONNX, ~5.3 GB (model_q4.onnx + 3 external-data chunks) |
transformers.js_config.use_external_data_format is set
to {"model_q4.onnx": 3} so all three weight chunks are preloaded.1import { pipeline } from '@huggingface/transformers'; // v4.2.0+
2const gen = await pipeline('text-generation',
3 'naklitechie/indira-lfm2-8b-a1b-onnx', { dtype: 'q4', device: 'webgpu' });
4const out = await gen(
5 [{ role: 'user', content: 'What did Indira Gandhi say about national unity?' }],
6 { max_new_tokens: 256 });naklitechie/nehru-…, naklitechie/gandhi-….