GuageLLM-23M is a lightweight GPT-style language model (~23 million parameters) trained from scratch for experimentation, learning, and fast local inference.
This model is designed to be simple, transparent, and easy to run on CPUs while still demonstrating real transformer behavior.
1from transformers import pipeline
2
3pipe = pipeline(
4 "text-generation",
5 model="Hai929/GuageLLM_23M",
6 trust_remote_code=True
7)
8
9pipe("The cat")