Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
lamm_13b_lora32_186k – AI Model by openlamm | AlphaNeural AI
You can deploy this model and start earning money today!
openlamm
/
lamm_13b_lora32_186k
like
0
transformers
llama
text-generation
en
openlamm/LAMM_Dataset
autotrain_compatible
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Repo:
https://github.com/OpenLAMM/LAMM
Commit ID: 6b98b26b3340378bb5bed330cca86305759d8d22
Model Config:
LLM: Vicuna_13b_v0
Vision Encoder: CLIP ViT-L-14
lora_r: 32
lora_alpha: 32
lora_dropout: 0.1
lora_target_modules: ['q_proj', 'k_proj', 'v_proj', 'o_proj']
Train Config:
Epochs: 2
train_batch_size: 64
