hyeogi_-_Yi-6b-dpo-v0.2-4bits – AI Model by RichardErkhov | AlphaNeural AI

You can deploy this model and start earning money today!

RichardErkhov/
hyeogi_-_Yi-6b-dpo-v0.2-4bits

like

0

Views

No views yet

Quantization made by Richard Erkhov.

Request more models

Yi-6b-dpo-v0.2 - bnb 4bits

Model creator: https://huggingface.co/hyeogi/
Original model: https://huggingface.co/hyeogi/Yi-6b-dpo-v0.2/

Original model description:

language:

ko pipeline_tag: text-generation tags:
Yi
dpo

Yi-6b-dpo

Model Details

Base Model: beomi/Yi-Ko-6B

Datasets

sampling and translate Open-Orca/SlimOrca
sampling and translate Anthropic/hh-rlhf

Benchmark

SOTA model under 7B as of Dec 20, 2023 (https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).

Model	Average	Ko-ARC	Ko-HellaSwag	Ko-MMLU	Ko-TruthfulQA	Ko-CommonGen V2
hyeogi/Yi-6b-dpo-v0.2 (Ours)	52.63	41.72	52.96	46.69	52.38	69.42
hyeogi/Yi-6b-dpo-v0.1(Ours)	51.38	41.3	52.23	45.34	54.03	63.99
Minirecord/Mini_DPO_7b_01	50.47	48.29	54.68	46.7	47.78	54.9

image/png