You can deploy this model and start earning money today!

RichardErkhov/
TheSkullery_-_BA-Zephyria-39b-gguf

Name: TheSkullery_-_BA-Zephyria-39b-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

BA-Zephyria-39b - GGUF

Model creator: https://huggingface.co/TheSkullery/
Original model: https://huggingface.co/TheSkullery/BA-Zephyria-39b/

Name	Quant method	Size
BA-Zephyria-39b.Q2_K.gguf	Q2_K	13.45GB
BA-Zephyria-39b.Q3_K_S.gguf	Q3_K_S	15.69GB
BA-Zephyria-39b.Q3_K.gguf	Q3_K	17.54GB
BA-Zephyria-39b.Q3_K_M.gguf	Q3_K_M	17.54GB
BA-Zephyria-39b.Q3_K_L.gguf	Q3_K_L	19.13GB
BA-Zephyria-39b.IQ4_XS.gguf	IQ4_XS	19.63GB
BA-Zephyria-39b.Q4_0.gguf	Q4_0	20.49GB
BA-Zephyria-39b.IQ4_NL.gguf	IQ4_NL	20.71GB
BA-Zephyria-39b.Q4_K_S.gguf	Q4_K_S	20.64GB
BA-Zephyria-39b.Q4_K.gguf	Q4_K	21.75GB
BA-Zephyria-39b.Q4_K_M.gguf	Q4_K_M	21.75GB
BA-Zephyria-39b.Q4_1.gguf	Q4_1	22.75GB
BA-Zephyria-39b.Q5_0.gguf	Q5_0	25.01GB
BA-Zephyria-39b.Q5_K_S.gguf	Q5_K_S	25.01GB
BA-Zephyria-39b.Q5_K.gguf	Q5_K	25.66GB
BA-Zephyria-39b.Q5_K_M.gguf	Q5_K_M	25.66GB
BA-Zephyria-39b.Q5_1.gguf	Q5_1	27.27GB
BA-Zephyria-39b.Q6_K.gguf	Q6_K	29.82GB
BA-Zephyria-39b.Q8_0.gguf	Q8_0	38.62GB

Original model description:

base_model:

unsloth/Mistral-Small-Instruct-2409 library_name: transformers tags:
mergekit
merge

Model Information

Base Model: unsloth/Mistral-Small-Instruct-2409

Strategy: Balanced Approach

Total Layers: 55

Duplication Start: Layer 19 (34.5% of model)

Duplicated Layers: 23 (41.8% of model)

Unique Final Layers: 14 (25.5% of model)

Model Characteristics

Models down_proj and o_proj layers have been nulled and will require healing
Combines benefits of early and mid duplication strategies
Balanced between unique initial layers, duplicated middle layers, and unique final layers
Versatile approach suitable for a wide range of tasks
Provides substantial unique layers at the end for task-specific adaptations

Configuration Visualization


[    Unique    ][    Duplicated    ][    Unique    ]
0 ----------- 18 19 ------------ 41 42 ---------- 54
     34.5%           41.8%            23.7%

RichardErkhov/TheSkullery_-_BA-Zephyria-39b-gguf

Original model description:

BA-Zephyria-39b [EXPERIMENTAL]

Model Information

Model Characteristics

Configuration Visualization

RichardErkhov/
TheSkullery_-_BA-Zephyria-39b-gguf