Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Merge2-Llama-3-8B – AI Model by yelim24 | AlphaNeural AI
You can deploy this model and start earning money today!
yelim24
/
Merge2-Llama-3-8B
like
0
safetensors
llama
merge
mergekit
lazymergekit
MLP-KTLim/llama-3-Korean-Bllossom-8B
OpenBuddy/openbuddy-llama3-8b-v21.1-8k
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Merge2-Llama-3-8B
Merge2-Llama-3-8B is a merge of the following models using
mergekit
:
MLP-KTLim/llama-3-Korean-Bllossom-8B
OpenBuddy/openbuddy-llama3-8b-v21.1-8k
🧩 Configuration
'''yaml slices:
sources:
model: MLP-KTLim/llama-3-Korean-Bllossom-8B layer_range: [0, 32]
model: OpenBuddy/openbuddy-llama3-8b-v21.1-8k layer_range: [0, 32] merge_method: slerp base_model: MLP-KTLim/llama-3-Korean-Bllossom-8B parameters: t:
filter: self_attn value: [0, 0.5, 0.3, 0.7, 1]
filter: mlp value: [1, 0.5, 0.7, 0.3, 0]
value: 0.5 dtype: bfloat16 '''
