Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
llama3_8b_instruct_moe – AI Model by leonzhou286 | AlphaNeural AI
You can deploy this model and start earning money today!
leonzhou286
/
llama3_8b_instruct_moe
like
0
safetensors
llama_moe
en
meta-llama/Meta-Llama-3-8B-Instruct
finetune
mit
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Llama 3 8b Instruct MOE
Llama 3 8b Instruct base model converted to MOE style by randomly partitioning the FFN layers of each decoder layer into 8 experts of the same size. Weights are directly taken from the llama3 instruct base model.
