Views
No views yet
| Setting | Configuration |
|---|---|
| Parameters | 1.61B |
| Transformer Layers | 32 |
| Hidden Dimension | 2,048 |
| FFN Intermediate Size | 5,440 |
| Attention Heads | 32 |
| Native Context Length | 1,024 tokens |
| Pretraining Objective | Masked Language Modeling |
| Masking Rate | 15% |
| Training Stage | Initial pretraining |
1@misc{wang2026ribospan,
2 title = {{RIBOSPAN}: A Long-Context {RNA} Foundation Model for Versatile {RNA} Modeling},
3 author = {Wang, Ziyuan and Tang, Bohao and Zhang, Fei and Han, Shuo and Liu, Pengfei},
4 year = {2026},
5 eprint = {2608.22849},
6 archivePrefix = {arXiv},
7 primaryClass = {cs.LG}
8}