You can deploy this model and start earning money today!

Danilosistu/
open-mythos-140m

Name: open-mythos-140m
Availability: InStock

Views

No views yet

OpenMythos Tiny (FineWeb-Edu)

This is a custom architecture 'OpenMythos' model (approx 140.5M parameters) trained on the FineWeb-Edu dataset.

Usage

To use this model, you need to use trust_remote_code=True because it uses a custom recurrence-based architecture.

python

from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("Danilosistu/open-mythos-140m")
model = AutoModelForCausalLM.from_pretrained(
"Danilosistu/open-mythos-140m",
trust_remote_code=True
)

inputs = tokenizer("Once upon a time", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=50)
print(tokenizer.decode(outputs[0]))