Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
SmolLM2-135M.gguf – AI Model by kratark | AlphaNeural AI
You can deploy this model and start earning money today!
kratark
/
SmolLM2-135M.gguf
like
0
transformers
gguf
llama.cpp
text-generation
en
HuggingFaceTB/SmolLM2-135M
quantized
apache-2.0
endpoints_compatible
us
conversational
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
SmolLM2-135M-GGUF
This repository contains a converted version of the
SmolLM2-135M
model in
GGUF format
, optimized for CPU and local inference.
Original model:
https://huggingface.co/HuggingFaceTB/SmolLM2-135M
Model Description
SmolLM2-135M is a small language model created by Hugging Face for efficient text generation with low resource usage.
This repository does not modify or retrain the model.
It only includes:
Conversion from Transformers → GGUF format
Preparation for inference with tools like llama.cpp
Usage
llama.cpp example
bash
1
./main -m smollm2-135m.gguf -p
"Gravity is"
2
