Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
t5-base-marco-crop-pretrain-2048 – AI Model by jmvcoelho | AlphaNeural AI
You can deploy this model and start earning money today!
jmvcoelho
/
t5-base-marco-crop-pretrain-2048
like
0
transformers
pytorch
t5
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model pre-trained on MS-MARCO (contrastive).
Starting model: jmvcoelho/t5-base-marco-lm-pretrain-2048
Training script:
https://github.com/cxcscmu/LongEmbeddingAnalysis/blob/main/scripts/contrastive_pretrain_dr.sh
T5ForConditionalGenerationRoPE class:
https://github.com/cxcscmu/LongEmbeddingAnalysis/blob/main/OpenMatch/src/openmatch/modeling/rope_t5.py