Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
BigLlama-20b – AI Model by athirdpath | AlphaNeural AI
You can deploy this model and start earning money today!
athirdpath
/
BigLlama-20b
like
0
transformers
safetensors
llama
text-generation
llama2
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
I'm going to compare DARE merges using this (mostly vanilla, alpaca-tinted) 20b model vs using Harmonia.
slices:
sources:
model: athirdpath/alpaca-2-13b-english_full-model
layer_range: [0, 16]
sources:
model: TheBloke/Llama-2-13B-fp16
layer_range: [8, 24]
sources:
model: athirdpath/alpaca-2-13b-english_full-model
layer_range: [17, 32]
sources:
model: TheBloke/Llama-2-13B-fp16
layer_range: [25, 40]
merge_method: passthrough
dtype: float16
