from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("SpiceeChat/Basemini", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("SpiceeChat/Basemini", trust_remote_code=True)

It runs on CPU. It runs on T4. It runs on a potato.

You ask it something. It gives you a sentence with the word "transformer" in it. That's the deal.

Made with sweat, tears, and torch_fallback=True. Pull requests welcome. Donations not needed. Moral support accepted.

SpiceeChat/Base-mini

SpiceeChat/
Base-mini