This is quantized version of
ChaoticNeutrals/Poppy_Porpoise-1.4-L3-8B created using llama.cpp
"Poppy Porpoise" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences.
Note: This variant is an attempt to get something closer to 0.72 while maintaining the improvements of 1.30.
1slices:
2 - sources:
3 - model: Nitral-AI/Pp-72xra1
4 layer_range: [0, 32]
5 - model: Nitral-AI/Poppy-1.35-Phase1
6 layer_range: [0, 32]
7merge_method: slerp
8base_model: Nitral-AI/Pp-72xra1
9parameters:
10 t:
11 - filter: self_attn
12 value: [0, 0.5, 0.3, 0.7, 1]
13 - filter: mlp
14 value: [1, 0.5, 0.7, 0.3, 0]
15 - value: 0.5
16dtype: bfloat16