You can deploy this model and start earning money today!

RichardErkhov/
bunnycore_-_Phi-2-OmniMatrix-gguf

Name: bunnycore_-_Phi-2-OmniMatrix-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Phi-2-OmniMatrix - GGUF

Model creator: https://huggingface.co/bunnycore/
Original model: https://huggingface.co/bunnycore/Phi-2-OmniMatrix/

Name	Quant method	Size
Phi-2-OmniMatrix.Q2_K.gguf	Q2_K	1.03GB
Phi-2-OmniMatrix.IQ3_XS.gguf	IQ3_XS	1.12GB
Phi-2-OmniMatrix.IQ3_S.gguf	IQ3_S	1.16GB
Phi-2-OmniMatrix.Q3_K_S.gguf	Q3_K_S	1.16GB
Phi-2-OmniMatrix.IQ3_M.gguf	IQ3_M	1.23GB
Phi-2-OmniMatrix.Q3_K.gguf	Q3_K	1.33GB
Phi-2-OmniMatrix.Q3_K_M.gguf	Q3_K_M	1.33GB
Phi-2-OmniMatrix.Q3_K_L.gguf	Q3_K_L	1.47GB
Phi-2-OmniMatrix.IQ4_XS.gguf	IQ4_XS	1.43GB
Phi-2-OmniMatrix.Q4_0.gguf	Q4_0	1.49GB
Phi-2-OmniMatrix.IQ4_NL.gguf	IQ4_NL	1.5GB
Phi-2-OmniMatrix.Q4_K_S.gguf	Q4_K_S	1.51GB
Phi-2-OmniMatrix.Q4_K.gguf	Q4_K	1.62GB
Phi-2-OmniMatrix.Q4_K_M.gguf	Q4_K_M	1.62GB
Phi-2-OmniMatrix.Q4_1.gguf	Q4_1	1.65GB
Phi-2-OmniMatrix.Q5_0.gguf	Q5_0	1.8GB
Phi-2-OmniMatrix.Q5_K_S.gguf	Q5_K_S	1.8GB
Phi-2-OmniMatrix.Q5_K.gguf	Q5_K	1.87GB
Phi-2-OmniMatrix.Q5_K_M.gguf	Q5_K_M	1.87GB
Phi-2-OmniMatrix.Q5_1.gguf	Q5_1	1.95GB
Phi-2-OmniMatrix.Q6_K.gguf	Q6_K	2.13GB
Phi-2-OmniMatrix.Q8_0.gguf	Q8_0	2.75GB

Original model description:

base_model:

microsoft/phi-2
Artples/L-MChat-Small
minghaowu/phi-2-OpenHermes-2.5
kingabzpro/phi-2-role-play
parsak/phi-2-code-instruct
l3utterfly/phi-2-layla-v1-chatml library_name: transformers tags:
mergekit
merge

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the task arithmetic merge method using microsoft/phi-2 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
  - model: minghaowu/phi-2-OpenHermes-2.5+kingabzpro/phi-2-role-play
    parameters:
      weight: 1.0
  - model: Artples/L-MChat-Small
    parameters:
      weight: 1.0
  - model: l3utterfly/phi-2-layla-v1-chatml
    parameters:
      weight: 1.0
  - model: parsak/phi-2-code-instruct
    parameters:
      weight: 1.0
merge_method: task_arithmetic
base_model: microsoft/phi-2
parameters:
    normalize: false
dtype: float16

RichardErkhov/bunnycore_-_Phi-2-OmniMatrix-gguf