You can deploy this model and start earning money today!

RichardErkhov/
TomGrc_-_FusionNet_SOLAR-gguf

Name: TomGrc_-_FusionNet_SOLAR-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

FusionNet_SOLAR - GGUF

Model creator: https://huggingface.co/TomGrc/
Original model: https://huggingface.co/TomGrc/FusionNet_SOLAR/

Name	Quant method	Size
FusionNet_SOLAR.Q2_K.gguf	Q2_K	5.52GB
FusionNet_SOLAR.IQ3_XS.gguf	IQ3_XS	6.13GB
FusionNet_SOLAR.IQ3_S.gguf	IQ3_S	6.48GB
FusionNet_SOLAR.Q3_K_S.gguf	Q3_K_S	6.44GB
FusionNet_SOLAR.IQ3_M.gguf	IQ3_M	6.69GB
FusionNet_SOLAR.Q3_K.gguf	Q3_K	7.18GB
FusionNet_SOLAR.Q3_K_M.gguf	Q3_K_M	7.18GB
FusionNet_SOLAR.Q3_K_L.gguf	Q3_K_L	7.82GB
FusionNet_SOLAR.IQ4_XS.gguf	IQ4_XS	8.06GB
FusionNet_SOLAR.Q4_0.gguf	Q4_0	8.4GB
FusionNet_SOLAR.IQ4_NL.gguf	IQ4_NL	8.49GB
FusionNet_SOLAR.Q4_K_S.gguf	Q4_K_S	3.76GB
FusionNet_SOLAR.Q4_K.gguf	Q4_K	8.94GB
FusionNet_SOLAR.Q4_K_M.gguf	Q4_K_M	8.94GB
FusionNet_SOLAR.Q4_1.gguf	Q4_1	9.32GB
FusionNet_SOLAR.Q5_0.gguf	Q5_0	10.24GB
FusionNet_SOLAR.Q5_K_S.gguf	Q5_K_S	10.24GB
FusionNet_SOLAR.Q5_K.gguf	Q5_K	10.52GB
FusionNet_SOLAR.Q5_K_M.gguf	Q5_K_M	10.52GB
FusionNet_SOLAR.Q5_1.gguf	Q5_1	11.16GB
FusionNet_SOLAR.Q6_K.gguf	Q6_K	12.2GB
FusionNet_SOLAR.Q8_0.gguf	Q8_0	15.8GB

Original model description:

language:

en license: mit pipeline_tag: text-generation model-index:
name: FusionNet_SOLAR results:
- task: type: text-generation name: Text Generation dataset: name: AI2 Reasoning Challenge (25-Shot) type: ai2_arc config: ARC-Challenge split: test args: num_few_shot: 25 metrics:
  - type: acc_norm value: 71.59 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TomGrc/FusionNet_SOLAR name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: HellaSwag (10-Shot) type: hellaswag split: validation args: num_few_shot: 10 metrics:
  - type: acc_norm value: 88.4 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TomGrc/FusionNet_SOLAR name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: MMLU (5-Shot) type: cais/mmlu config: all split: test args: num_few_shot: 5 metrics:
  - type: acc value: 65.29 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TomGrc/FusionNet_SOLAR name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: TruthfulQA (0-shot) type: truthful_qa config: multiple_choice split: validation args: num_few_shot: 0 metrics:
  - type: mc2 value: 69.21 source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TomGrc/FusionNet_SOLAR name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: Winogrande (5-shot) type: winogrande config: winogrande_xl split: validation args: num_few_shot: 5 metrics:
  - type: acc value: 81.06 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TomGrc/FusionNet_SOLAR name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: GSM8k (5-shot) type: gsm8k config: main split: test args: num_few_shot: 5 metrics:
  - type: acc value: 50.95 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=TomGrc/FusionNet_SOLAR name: Open LLM Leaderboard

FusionNet_SOLAR

Fine-tuned model on English language using SOLAR Fusion method.

Model description

This is an experiment with the SOLAR Fusion method of FusionNet. This model has 16B parameters, and this model is fine-tuned. Enjoy!

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	71.08
AI2 Reasoning Challenge (25-Shot)	71.59
HellaSwag (10-Shot)	88.40
MMLU (5-Shot)	65.29
TruthfulQA (0-shot)	69.21
Winogrande (5-shot)	81.06
GSM8k (5-shot)	50.95

RichardErkhov/TomGrc_-_FusionNet_SOLAR-gguf

Original model description:

FusionNet_SOLAR

Model description

Open LLM Leaderboard Evaluation Results

RichardErkhov/
TomGrc_-_FusionNet_SOLAR-gguf