epsil/
Tinyllama-1b-v1.0-gguf

Name: Tinyllama-1b-v1.0-gguf
Availability: InStock

conversational

endpoints_compatible

gguf

template

tinyllama

Views

No views yet

To run the model run the following code :

!pip install ctransformers[cuda]
from ctransformers import AutoModelForCausalLM

llm = AutoModelForCausalLM.from_pretrained("epsil/Tinyllama-1b-v1.0-gguf", model_file="Tinyllama-1b-v1.0.gguf")

print(llm("AI is going to"))