You can deploy this model and start earning money today!

DavidSeyserHF/
rex1-base

Name: rex1-base
Rating: 2.5 (60 reviews)

Views

No views yet

REX1 300M

REX is a recursive decoder-only Transformer language model. This repository uses custom Transformers code, so load it with trust_remote_code=True.

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(".", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(".")

.pt`.

Training Notes

Tokenizer: gpt2
Context length: 1024
Training output dir: runs/rex-300m-mixed-2

This is a base language model checkpoint and is not instruction-aligned unless noted.

DavidSeyserHF/rex1-base

REX1 300M

Training Notes

DavidSeyserHF/
rex1-base