You can deploy this model and start earning money today!

RichardErkhov/
neovalle_-_H4rmoniousBreezeDPO-gguf

Name: neovalle_-_H4rmoniousBreezeDPO-gguf
Availability: InStock

gguf

template

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

H4rmoniousBreezeDPO - GGUF

Model creator: https://huggingface.co/neovalle/
Original model: https://huggingface.co/neovalle/H4rmoniousBreezeDPO/

Name	Quant method	Size
H4rmoniousBreezeDPO.Q2_K.gguf	Q2_K	2.53GB
H4rmoniousBreezeDPO.IQ3_XS.gguf	IQ3_XS	0.95GB
H4rmoniousBreezeDPO.IQ3_S.gguf	IQ3_S	0.87GB
H4rmoniousBreezeDPO.Q3_K_S.gguf	Q3_K_S	2.95GB
H4rmoniousBreezeDPO.IQ3_M.gguf	IQ3_M	0.96GB
H4rmoniousBreezeDPO.Q3_K.gguf	Q3_K	3.28GB
H4rmoniousBreezeDPO.Q3_K_M.gguf	Q3_K_M	3.28GB
H4rmoniousBreezeDPO.Q3_K_L.gguf	Q3_K_L	3.56GB
H4rmoniousBreezeDPO.IQ4_XS.gguf	IQ4_XS	3.67GB
H4rmoniousBreezeDPO.Q4_0.gguf	Q4_0	3.83GB
H4rmoniousBreezeDPO.IQ4_NL.gguf	IQ4_NL	3.87GB
H4rmoniousBreezeDPO.Q4_K_S.gguf	Q4_K_S	3.86GB
H4rmoniousBreezeDPO.Q4_K.gguf	Q4_K	4.07GB
H4rmoniousBreezeDPO.Q4_K_M.gguf	Q4_K_M	4.07GB
H4rmoniousBreezeDPO.Q4_1.gguf	Q4_1	4.24GB
H4rmoniousBreezeDPO.Q5_0.gguf	Q5_0	4.65GB
H4rmoniousBreezeDPO.Q5_K_S.gguf	Q5_K_S	4.65GB
H4rmoniousBreezeDPO.Q5_K.gguf	Q5_K	4.78GB
H4rmoniousBreezeDPO.Q5_K_M.gguf	Q5_K_M	4.78GB
H4rmoniousBreezeDPO.Q5_1.gguf	Q5_1	5.07GB
H4rmoniousBreezeDPO.Q6_K.gguf	Q6_K	5.53GB
H4rmoniousBreezeDPO.Q8_0.gguf	Q8_0	7.17GB

Original model description:

tags:

text-generation license: mit datasets:
neovalle/H4rmony_dpo language:
en

Model Card for Model neovalle/H4rmoniousBreezeDPO

Model Details

Model Description

This is model is a version of HuggingFaceH4/zephyr-7b-beta fine-tuned via DPO, using the H4rmony_dpo dataset, which aims to better align the model with ecological values through the use of ecolinguistics principles.

Developed by: Jorge Vallego
Funded by : Neovalle Ltd.
Shared by : airesearch@neovalle.co.uk
Model type: mistral
Language(s) (NLP): Primarily English
License: MIT
Finetuned from model: HuggingFaceH4/zephyr-7b-beta

Uses

Intended as PoC to show the effects of H4rmony_dpo dataset with DPO fine-tuning..

Direct Use

For testing purposes to gain insight in order to help with the continous improvement of the H4rmony_dpo dataset.

Downstream Use

Its direct use in applications is not recommended as this model is under testing for a specific task only (Ecological Alignment)

Out-of-Scope Use

Not meant to be used other than testing and evaluation of the H4rmony dataset and ecological alignment.

Bias, Risks, and Limitations

This model might produce biased completions already existing in the base model, and others unintentionally introduced during fine-tuning.

How to Get Started with the Model

It can be loaded and run in a Colab instance with High RAM.

Training Details

Trained using DPO

Training Data

H4rmony Dataset - https://huggingface.co/datasets/neovalle/H4rmony_dpo

RichardErkhov/neovalle_-_H4rmoniousBreezeDPO-gguf