Merge was by me(IkariDev) alone this time.
FlatOrca(ChatML removed, sorry ChatML bros) + Noromaid 13b 0.2. Suitable for RP, ERP and general stuff.
[Recommended settings - No settings yet(Please suggest some over in the Community tab!)]
This repo contains FP16 files of FlatOrcamaid-13b-v0.2.
Note: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!
If you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is "ikaridev" and "undi".
UPDATED!! SillyTavern config files:
Context,
Instruct.
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
slices:
- sources:
- model: NeverSleep/Noromaid-13b-v0.2
layer_range: [0, 40]
- model: OrcaFlat
layer_range: [0, 40]
merge_method: slerp
base_model: NeverSleep/Noromaid-13b-v0.2
parameters:
t:
- filter: self_attn
value: [0, 0.4, 0.2, 0.55, 0.8]
- filter: mlp
value: [0.7, 0.3, 0.4, 0.3, 0]
- value: 0.33 # fallback for rest of tensors
dtype: float16
Undi: If you want to support me, you can
here.
