You can deploy this model and start earning money today!

RichardErkhov/
Hastagaras_-_Halu-8B-Llama3-Blackroot-gguf

Name: Hastagaras_-_Halu-8B-Llama3-Blackroot-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Halu-8B-Llama3-Blackroot - GGUF

Model creator: https://huggingface.co/Hastagaras/
Original model: https://huggingface.co/Hastagaras/Halu-8B-Llama3-Blackroot/

Name	Quant method	Size
Halu-8B-Llama3-Blackroot.Q2_K.gguf	Q2_K	2.96GB
Halu-8B-Llama3-Blackroot.IQ3_XS.gguf	IQ3_XS	3.28GB
Halu-8B-Llama3-Blackroot.IQ3_S.gguf	IQ3_S	3.43GB
Halu-8B-Llama3-Blackroot.Q3_K_S.gguf	Q3_K_S	3.41GB
Halu-8B-Llama3-Blackroot.IQ3_M.gguf	IQ3_M	3.52GB
Halu-8B-Llama3-Blackroot.Q3_K.gguf	Q3_K	3.74GB
Halu-8B-Llama3-Blackroot.Q3_K_M.gguf	Q3_K_M	3.74GB
Halu-8B-Llama3-Blackroot.Q3_K_L.gguf	Q3_K_L	4.03GB
Halu-8B-Llama3-Blackroot.IQ4_XS.gguf	IQ4_XS	4.18GB
Halu-8B-Llama3-Blackroot.Q4_0.gguf	Q4_0	4.34GB
Halu-8B-Llama3-Blackroot.IQ4_NL.gguf	IQ4_NL	4.38GB
Halu-8B-Llama3-Blackroot.Q4_K_S.gguf	Q4_K_S	4.37GB
Halu-8B-Llama3-Blackroot.Q4_K.gguf	Q4_K	4.58GB
Halu-8B-Llama3-Blackroot.Q4_K_M.gguf	Q4_K_M	4.58GB
Halu-8B-Llama3-Blackroot.Q4_1.gguf	Q4_1	4.78GB
Halu-8B-Llama3-Blackroot.Q5_0.gguf	Q5_0	5.21GB
Halu-8B-Llama3-Blackroot.Q5_K_S.gguf	Q5_K_S	5.21GB
Halu-8B-Llama3-Blackroot.Q5_K.gguf	Q5_K	5.34GB
Halu-8B-Llama3-Blackroot.Q5_K_M.gguf	Q5_K_M	5.34GB
Halu-8B-Llama3-Blackroot.Q5_1.gguf	Q5_1	5.65GB
Halu-8B-Llama3-Blackroot.Q6_K.gguf	Q6_K	6.14GB
Halu-8B-Llama3-Blackroot.Q8_0.gguf	Q8_0	7.95GB

Original model description:

license: llama3 library_name: transformers tags:

mergekit
merge
not-for-all-audiences base_model:
Hastagaras/Halu-8B-Llama3-v0.3
Blackroot/Llama-3-LongStory-LORA
Hastagaras/Halu-8B-Llama3-v0.3
Blackroot/Llama-3-8B-Abomination-LORA
Hastagaras/Halu-8B-Llama3-v0.3 model-index:
name: Halu-8B-Llama3-Blackroot results:
- task: type: text-generation name: Text Generation dataset: name: AI2 Reasoning Challenge (25-Shot) type: ai2_arc config: ARC-Challenge split: test args: num_few_shot: 25 metrics:
  - type: acc_norm value: 63.82 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: HellaSwag (10-Shot) type: hellaswag split: validation args: num_few_shot: 10 metrics:
  - type: acc_norm value: 84.55 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: MMLU (5-Shot) type: cais/mmlu config: all split: test args: num_few_shot: 5 metrics:
  - type: acc value: 67.04 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: TruthfulQA (0-shot) type: truthful_qa config: multiple_choice split: validation args: num_few_shot: 0 metrics:
  - type: mc2 value: 53.28 source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: Winogrande (5-shot) type: winogrande config: winogrande_xl split: validation args: num_few_shot: 5 metrics:
  - type: acc value: 79.48 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: GSM8k (5-shot) type: gsm8k config: main split: test args: num_few_shot: 5 metrics:
  - type: acc value: 70.51 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot name: Open LLM Leaderboard

EXPERIMENTAL MODEL

VERY IMPORTANT: This model has not been extensively tested or evaluated, and its performance characteristics are currently unknown. It may generate harmful, biased, or inappropriate content. Please exercise caution and use it at your own risk and discretion.

I just tried saishf's merged model, and it's great. So I decided to try a similar merge method with Blackroot's LoRA that I had found earlier.

I don't know what to say about this model... this model is very strange...Maybe because Blackroot's amazing Loras used human data and not synthetic data, hence the model turned out to be very human-like...even the actions or narrations.

WARNING: This model is very unsafe in certain parts...especially in RP.

IMATRIX GGUF IS HERE made available by Lewdiculous

STATIC GGUF IS HERE made avaible by mradermacher

Merge Method

This model was merged using the Model Stock merge method using Hastagaras/Halu-8B-Llama3-v0.3 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
  - model: Hastagaras/Halu-8B-Llama3-v0.3+Blackroot/Llama-3-LongStory-LORA
  - model: Hastagaras/Halu-8B-Llama3-v0.3+Blackroot/Llama-3-8B-Abomination-LORA
merge_method: model_stock
base_model: Hastagaras/Halu-8B-Llama3-v0.3
dtype: bfloat16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	69.78
AI2 Reasoning Challenge (25-Shot)	63.82
HellaSwag (10-Shot)	84.55
MMLU (5-Shot)	67.04
TruthfulQA (0-shot)	53.28
Winogrande (5-shot)	79.48
GSM8k (5-shot)	70.51

RichardErkhov/Hastagaras_-_Halu-8B-Llama3-Blackroot-gguf