Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
llama-7B-slerp – AI Model by arthurwangheng | AlphaNeural AI
You can deploy this model and start earning money today!
arthurwangheng
/
llama-7B-slerp
like
0
merge
mergekit
lazymergekit
arthurwangheng/Llamafinetune
arthurwangheng/Llama-2-7b-FAQ-chatbot-finetune
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
llama-7B-slerp
llama-7B-slerp is a merge of the following models using
mergekit
:
arthurwangheng/Llamafinetune
arthurwangheng/Llama-2-7b-FAQ-chatbot-finetune
🧩 Configuration
```yaml slices:
sources:
model: arthurwangheng/Llamafinetune layer_range: [0, 32]
model: arthurwangheng/Llama-2-7b-FAQ-chatbot-finetune layer_range: [0, 32] merge_method: slerp base_model: arthurwangheng/Llamafinetune parameters: t:
filter: self_attn value: [0, 0.5, 0.3, 0.7, 1]
filter: mlp value: [1, 0.5, 0.7, 0.3, 0]
value: 0.5 dtype: float16 ```
