You can deploy this model and start earning money today!

RichardErkhov/
davidkim205_-_nox-solar-10.7b-v4-gguf

Name: davidkim205_-_nox-solar-10.7b-v4-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

nox-solar-10.7b-v4 - GGUF

Model creator: https://huggingface.co/davidkim205/
Original model: https://huggingface.co/davidkim205/nox-solar-10.7b-v4/

Name	Quant method	Size
nox-solar-10.7b-v4.Q2_K.gguf	Q2_K	3.73GB
nox-solar-10.7b-v4.IQ3_XS.gguf	IQ3_XS	4.14GB
nox-solar-10.7b-v4.IQ3_S.gguf	IQ3_S	4.37GB
nox-solar-10.7b-v4.Q3_K_S.gguf	Q3_K_S	4.34GB
nox-solar-10.7b-v4.IQ3_M.gguf	IQ3_M	4.51GB
nox-solar-10.7b-v4.Q3_K.gguf	Q3_K	4.84GB
nox-solar-10.7b-v4.Q3_K_M.gguf	Q3_K_M	4.84GB
nox-solar-10.7b-v4.Q3_K_L.gguf	Q3_K_L	5.26GB
nox-solar-10.7b-v4.IQ4_XS.gguf	IQ4_XS	5.43GB
nox-solar-10.7b-v4.Q4_0.gguf	Q4_0	5.66GB
nox-solar-10.7b-v4.IQ4_NL.gguf	IQ4_NL	5.72GB
nox-solar-10.7b-v4.Q4_K_S.gguf	Q4_K_S	5.7GB
nox-solar-10.7b-v4.Q4_K.gguf	Q4_K	6.02GB
nox-solar-10.7b-v4.Q4_K_M.gguf	Q4_K_M	6.02GB
nox-solar-10.7b-v4.Q4_1.gguf	Q4_1	6.27GB
nox-solar-10.7b-v4.Q5_0.gguf	Q5_0	6.89GB
nox-solar-10.7b-v4.Q5_K_S.gguf	Q5_K_S	6.89GB
nox-solar-10.7b-v4.Q5_K.gguf	Q5_K	7.08GB
nox-solar-10.7b-v4.Q5_K_M.gguf	Q5_K_M	7.08GB
nox-solar-10.7b-v4.Q5_1.gguf	Q5_1	7.51GB
nox-solar-10.7b-v4.Q6_K.gguf	Q6_K	8.2GB
nox-solar-10.7b-v4.Q8_0.gguf	Q8_0	10.62GB

Original model description:

license: apache-2.0 library_name: transformers tags: []

nox

The nox project is a set of tools that make it easy to use various fine tuning technologies using solar models. We constructed ko data using grammatically accurate data.(It's not perfect, but I tried my best.) And we created nox-solar model using a fine-tuning technique(sft,dpo) Our model, the nox-solar model, ranked first on the Open Ko-LLM Leaderboard.

Currently, we are planning to make all code and datasets public.

Through this, users are expected to be able to freely conduct research and development using Nox.

Model Details

Model Developers : davidkim(changyeon kim)
Repository : https://github.com/davidkim205/nox
base mode : Edentns/DataVortexS-10.7B-dpo-v1.8
sft dataset : davidkim205/kollm-converations
dpo dataset : davidkim205/kollm-comparision
evalution : kollm_evalution
evalution dataset : open-ko-llm-leaderboard datasets

Evaluation

The Open Ko-LLM Leaderboard

Model	Average	Ko-ARC	Ko-HellaSwag	Ko-MMLU	Ko-TruthfulQA	Ko-CommonGen V2
davidkim205/nox-solar-10.7b-v4	67.77	73.55	72.07	57.93	79.32	55.96

kollm_evalution

model	Average	Ko-TruthfulQA_mc1	Ko-MMLU	Ko-HellaSwag	Ko-CommonGen V2	Ko-ARC-Easy	kobest	kobest_boolq	kobest_copa	kobest_hellaswag	kobest_sentineg	kobest_wic
davidkim205/nox-solar-10.7b-v4	69.48	63.16	48.59	85.93	87.21	71.16	60.8	55.91	77.5	57	89.67	48.81

RichardErkhov/davidkim205_-_nox-solar-10.7b-v4-gguf