Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
cmbaopenwebmath – AI Model by Viharikvs | AlphaNeural AI
You can deploy this model and start earning money today!
Viharikvs
/
cmbaopenwebmath
like
0
pytorch
hrm
act
wikitext
google-t5/t5-small
finetune
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
HRM-Text1 (WikiText-103)
This repository contains weights for an experimental HRM Causal LM trained on the
WikiText-103 dataset
.
Model Description
Architecture:
Hierarchical Recurrent Memory (HRM)
Training Data:
wikitext/wikitext-103-raw-v1
Tokenizer:
t5-small
(slow T5 SentencePiece)
Vocab Size
: 32100
Objective:
Causal Language Modeling
Latest Performance (Epoch 30)
Validation Loss
:
4.5848
Validation Perplexity
:
97.98