You can deploy this model and start earning money today!

RichardErkhov/
ToastyPigeon_-_psyonic-cetacean-20b-v2-gguf

Name: ToastyPigeon_-_psyonic-cetacean-20b-v2-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

psyonic-cetacean-20b-v2 - GGUF

Model creator: https://huggingface.co/ToastyPigeon/
Original model: https://huggingface.co/ToastyPigeon/psyonic-cetacean-20b-v2/

Name	Quant method	Size
psyonic-cetacean-20b-v2.Q2_K.gguf	Q2_K	6.91GB
psyonic-cetacean-20b-v2.Q3_K_S.gguf	Q3_K_S	8.06GB
psyonic-cetacean-20b-v2.Q3_K.gguf	Q3_K	9.04GB
psyonic-cetacean-20b-v2.Q3_K_M.gguf	Q3_K_M	9.04GB
psyonic-cetacean-20b-v2.Q3_K_L.gguf	Q3_K_L	9.9GB
psyonic-cetacean-20b-v2.IQ4_XS.gguf	IQ4_XS	10.01GB
psyonic-cetacean-20b-v2.Q4_0.gguf	Q4_0	10.52GB
psyonic-cetacean-20b-v2.IQ4_NL.gguf	IQ4_NL	10.57GB
psyonic-cetacean-20b-v2.Q4_K_S.gguf	Q4_K_S	10.59GB
psyonic-cetacean-20b-v2.Q4_K.gguf	Q4_K	11.22GB
psyonic-cetacean-20b-v2.Q4_K_M.gguf	Q4_K_M	11.22GB
psyonic-cetacean-20b-v2.Q4_1.gguf	Q4_1	11.67GB
psyonic-cetacean-20b-v2.Q5_0.gguf	Q5_0	12.83GB
psyonic-cetacean-20b-v2.Q5_K_S.gguf	Q5_K_S	12.83GB
psyonic-cetacean-20b-v2.Q5_K.gguf	Q5_K	13.18GB
psyonic-cetacean-20b-v2.Q5_K_M.gguf	Q5_K_M	13.18GB
psyonic-cetacean-20b-v2.Q5_1.gguf	Q5_1	13.98GB
psyonic-cetacean-20b-v2.Q6_K.gguf	Q6_K	15.28GB
psyonic-cetacean-20b-v2.Q8_0.gguf	Q8_0	19.79GB

Original model description:

base_model: [] tags:

mergekit
merge

Psyonic-Cetacean-20B-V2

This is a merge of pre-trained language models created using mergekit.

GGUF (standard and iMatrix) quants can be found here courtesy of MarsupialAI: https://huggingface.co/MarsupialAI/Psyonic-Cetacean-20b-v2_iMatrix_GGUF

Merge Details

Merge Method

This model was merged using the linear merge method on two stack-merged models.

The first is jebcarter/psyonic-cetacean-20B (Orca first, reproduced so I didn't have to download that model on top of the components). The second is the same recipe with the models reversed.

Since jebcarter suggested this recipe, credit goes to him.

Models Merged

The following models were included in the merge:

microsoft/Orca-2-13b
KoboldAI/LLaMA2-13B-Psyfighter2

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
  - model: microsoft/Orca-2-13b
    parameters:
      weight: 1.0
merge_method: task_arithmetic
base_model: TheBloke/Llama-2-13B-fp16
dtype: float16
name: FlatOrca2
---
slices:
  - sources:
    - model: FlatOrca2
      layer_range: [0, 16]
  - sources:
    - model: KoboldAI/LLaMA2-13B-Psyfighter2
      layer_range: [8, 24]
  - sources:
    - model: FlatOrca2
      layer_range: [17, 32]
  - sources:
    - model: KoboldAI/LLaMA2-13B-Psyfighter2
      layer_range: [25, 40]
merge_method: passthrough
dtype: float16
name: Psycet
---
slices:
  - sources:
    - model: KoboldAI/LLaMA2-13B-Psyfighter2
      layer_range: [0, 16]
  - sources:
    - model: FlatOrca2
      layer_range: [8, 24]
  - sources:
    - model: KoboldAI/LLaMA2-13B-Psyfighter2
      layer_range: [17, 32]
  - sources:
    - model: FlatOrca2
      layer_range: [25, 40]
merge_method: passthrough
dtype: float16
name: Psycet-Reverse
---
models:
  - model: Psycet
    parameters:
      weight: 0.5
  - model: Psycet-Reverse
    parameters:
      weight: 0.5
merge_method: linear
dtype: float16

RichardErkhov/ToastyPigeon_-_psyonic-cetacean-20b-v2-gguf