You can deploy this model and start earning money today!

RichardErkhov/
ryandt_-_MusingCaterpillar-gguf

Name: ryandt_-_MusingCaterpillar-gguf
Availability: InStock

endpoints_compatible

gguf

template

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

MusingCaterpillar - GGUF

Model creator: https://huggingface.co/ryandt/
Original model: https://huggingface.co/ryandt/MusingCaterpillar/

Name	Quant method	Size
MusingCaterpillar.Q2_K.gguf	Q2_K	3.13GB
MusingCaterpillar.IQ3_XS.gguf	IQ3_XS	3.48GB
MusingCaterpillar.IQ3_S.gguf	IQ3_S	3.67GB
MusingCaterpillar.Q3_K_S.gguf	Q3_K_S	3.65GB
MusingCaterpillar.IQ3_M.gguf	IQ3_M	3.79GB
MusingCaterpillar.Q3_K.gguf	Q3_K	4.05GB
MusingCaterpillar.Q3_K_M.gguf	Q3_K_M	4.05GB
MusingCaterpillar.Q3_K_L.gguf	Q3_K_L	4.41GB
MusingCaterpillar.IQ4_XS.gguf	IQ4_XS	4.55GB
MusingCaterpillar.Q4_0.gguf	Q4_0	4.74GB
MusingCaterpillar.IQ4_NL.gguf	IQ4_NL	4.79GB
MusingCaterpillar.Q4_K_S.gguf	Q4_K_S	4.78GB
MusingCaterpillar.Q4_K.gguf	Q4_K	5.04GB
MusingCaterpillar.Q4_K_M.gguf	Q4_K_M	5.04GB
MusingCaterpillar.Q4_1.gguf	Q4_1	5.26GB
MusingCaterpillar.Q5_0.gguf	Q5_0	5.77GB
MusingCaterpillar.Q5_K_S.gguf	Q5_K_S	5.77GB
MusingCaterpillar.Q5_K.gguf	Q5_K	5.93GB
MusingCaterpillar.Q5_K_M.gguf	Q5_K_M	5.93GB
MusingCaterpillar.Q5_1.gguf	Q5_1	6.29GB
MusingCaterpillar.Q6_K.gguf	Q6_K	6.87GB
MusingCaterpillar.Q8_0.gguf	Q8_0	8.89GB

Original model description:

license: mit datasets:

ryandt/mistral_symbolicLogic_5_7_9_short model-index:
name: MusingCaterpillar results:
- task: type: text-generation name: Text Generation dataset: name: AI2 Reasoning Challenge (25-Shot) type: ai2_arc config: ARC-Challenge split: test args: num_few_shot: 25 metrics:
  - type: acc_norm value: 72.53 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ryandt/MusingCaterpillar name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: HellaSwag (10-Shot) type: hellaswag split: validation args: num_few_shot: 10 metrics:
  - type: acc_norm value: 88.34 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ryandt/MusingCaterpillar name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: MMLU (5-Shot) type: cais/mmlu config: all split: test args: num_few_shot: 5 metrics:
  - type: acc value: 65.26 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ryandt/MusingCaterpillar name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: TruthfulQA (0-shot) type: truthful_qa config: multiple_choice split: validation args: num_few_shot: 0 metrics:
  - type: mc2 value: 70.93 source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ryandt/MusingCaterpillar name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: Winogrande (5-shot) type: winogrande config: winogrande_xl split: validation args: num_few_shot: 5 metrics:
  - type: acc value: 80.66 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ryandt/MusingCaterpillar name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: GSM8k (5-shot) type: gsm8k config: main split: test args: num_few_shot: 5 metrics:
  - type: acc value: 62.24 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ryandt/MusingCaterpillar name: Open LLM Leaderboard

Finetune of CultriX/MistralTrix-v1 on Symbolic Logic content from Lewis Carrol (at a very low learning rate because of the very small dataset - I'm just experimenting and have no idea if this was effective at changing the model output).

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	73.33
AI2 Reasoning Challenge (25-Shot)	72.53
HellaSwag (10-Shot)	88.34
MMLU (5-Shot)	65.26
TruthfulQA (0-shot)	70.93
Winogrande (5-shot)	80.66
GSM8k (5-shot)	62.24

RichardErkhov/ryandt_-_MusingCaterpillar-gguf

Original model description:

Open LLM Leaderboard Evaluation Results

RichardErkhov/
ryandt_-_MusingCaterpillar-gguf