QuantFactory/StockLLama-3.1-8B-GGUF

Name: StockLLama-3.1-8B-GGUF
Availability: InStock

This is quantized version of bunnycore/StockLLama-3.1-8B created using llama.cpp

Original Model Card

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using unsloth/Meta-Llama-3.1-8B as a base.

Models Merged

The following models were included in the merge:

Replete-AI/Replete-LLM-V2-Llama-3.1-8b
bunnycore/HyperLexi-8B-breadcrumbs
mlabonne/Hermes-3-Llama-3.1-8B-lorablated
Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
rityak/L3.1-IFEvalStock-8B
vicgalle/Configurable-Llama-3.1-8B-Instruct
bunnycore/LLama-3.1-Hyper-Stock

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
 - model: vicgalle/Configurable-Llama-3.1-8B-Instruct
 - model: mlabonne/Hermes-3-Llama-3.1-8B-lorablated
 - model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
 - model: bunnycore/LLama-3.1-Hyper-Stock
 - model: bunnycore/HyperLexi-8B-breadcrumbs
 - model: Replete-AI/Replete-LLM-V2-Llama-3.1-8b
 - model: rityak/L3.1-IFEvalStock-8B
merge_method: model_stock
base_model: unsloth/Meta-Llama-3.1-8B
dtype: bfloat16