Views
No views yet
dense language model trained on filtered C4 (step 100000).transformers class. To load:1import torch
2from safetensors.torch import load_file
3from models.dense_transformer import DenseTransformer
4
5model = DenseTransformer()
6model.load_state_dict(load_file('model.safetensors'), strict=False)strict=False because the tied lm_head weight is deduped on upload.)c4_bpe8k.model).