Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

LFM2-8B-A1B-Instruct-QwenDistill – AI Model by Tivaphraen | AlphaNeural AI

You can deploy this model and start earning money today!

Tivaphraen/
LFM2-8B-A1B-Instruct-QwenDistill

like

0

text-generation

endpoints_compatible

Views

No views yet

banner_en_final

LFM2-8B-A1B-Instruct-QwenDistill - GGUF

This repository contains GGUF format quantizations of the model DavidAU/LFM2-8B-A1B-Instruct-Quantum-IQ1C-Qwen3.6-35B-A3B-DISTILL.

Quantization was performed locally using llama.cpp (build b9433).

Files Available

LFM2-8B-A1B-Instruct-QwenDistill-Q5_K_M.gguf (~5.64 GB) : Recommended balance. High accuracy, very low performance loss.
LFM2-8B-A1B-Instruct-QwenDistill-Q4_K_M.gguf (~4.81 GB) : Standard quantization. Fastest inference speed, smaller memory footprint.

Performance Test (Local CPU Inference)

The following benchmarks were obtained running the model locally on a standard laptop configuration, without GPU acceleration.

Hardware Specifications:

CPU: Intel Core i5 (11th Gen)
RAM: 32 GB
OS: Windows

Inference Results (`llama-cli.exe`):

LFM2-8B-A1B-Instruct-QwenDistill-Q4_K_M.gguf :
- Prompt Evaluation: ~41 t/s
- Token Generation: ~24 t/s
LFM2-8B-A1B-Instruct-QwenDistill-Q5_K_M.gguf :
- Prompt Evaluation: ~28 t/s
- Token Generation: ~20 t/s