LFM2-2.6B - Quantized GGUF Model
This is a quantized GGUF model (Q8_0) compatible with Ollama.
Model Details
- Base Model: LiquidAI/LFM2-2.6B
- Quantization: Q8_0
- Framework: Ollama
Usage with Ollama
You can pull and run this model directly with Ollama:
ollama pull hf.co/Sadiah/ollama-q8_0-LFM2-2.6B:Q8_0
Then run it:
ollama run hf.co/Sadiah/ollama-q8_0-LFM2-2.6B:Q8_0 "Write your prompt here"
Features
- Efficient quantization (Q8_0) for faster inference
- Compatible with Ollama's inference engine
License
Please refer to the original model card for licensing information.