You can deploy this model and start earning money today!

RichardErkhov/
OEvortex_-_Emotional-llama-8B-gguf

Name: OEvortex_-_Emotional-llama-8B-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Emotional-llama-8B - GGUF

Model creator: https://huggingface.co/OEvortex/
Original model: https://huggingface.co/OEvortex/Emotional-llama-8B/

Name	Quant method	Size
Emotional-llama-8B.Q2_K.gguf	Q2_K	2.96GB
Emotional-llama-8B.IQ3_XS.gguf	IQ3_XS	3.28GB
Emotional-llama-8B.IQ3_S.gguf	IQ3_S	3.43GB
Emotional-llama-8B.Q3_K_S.gguf	Q3_K_S	3.41GB
Emotional-llama-8B.IQ3_M.gguf	IQ3_M	3.52GB
Emotional-llama-8B.Q3_K.gguf	Q3_K	3.74GB
Emotional-llama-8B.Q3_K_M.gguf	Q3_K_M	3.74GB
Emotional-llama-8B.Q3_K_L.gguf	Q3_K_L	4.03GB
Emotional-llama-8B.IQ4_XS.gguf	IQ4_XS	4.18GB
Emotional-llama-8B.Q4_0.gguf	Q4_0	4.34GB
Emotional-llama-8B.IQ4_NL.gguf	IQ4_NL	4.38GB
Emotional-llama-8B.Q4_K_S.gguf	Q4_K_S	4.37GB
Emotional-llama-8B.Q4_K.gguf	Q4_K	4.58GB
Emotional-llama-8B.Q4_K_M.gguf	Q4_K_M	4.58GB
Emotional-llama-8B.Q4_1.gguf	Q4_1	4.78GB
Emotional-llama-8B.Q5_0.gguf	Q5_0	5.21GB
Emotional-llama-8B.Q5_K_S.gguf	Q5_K_S	5.21GB
Emotional-llama-8B.Q5_K.gguf	Q5_K	5.34GB
Emotional-llama-8B.Q5_K_M.gguf	Q5_K_M	5.34GB
Emotional-llama-8B.Q5_1.gguf	Q5_1	5.65GB
Emotional-llama-8B.Q6_K.gguf	Q6_K	6.14GB
Emotional-llama-8B.Q8_0.gguf	Q8_0	7.95GB

Original model description:

library_name: transformers license: llama3

Emotional-llama-8B Model Card

Overview

Emotional-llama-8B is a large language model designed for emotionally intelligent conversational interactions. It is trained to engage users with empathy, understanding, and supportive dialogue across a wide range of topics and contexts. The model aims to provide a supportive AI companion that can attune to users' emotional states and communicative needs.

Objectives

Engage in open-ended dialogue while displaying emotional intelligence
Recognize and validate user emotions and emotional contexts
Provide supportive, empathetic, and psychologically-grounded responses
Avoid insensitive, harmful, or unethical speech
Continuously improve emotional awareness and dialogue skills

Methodology

Emotional-llama-8B is based on the LLaMA 3.8B language model and further trained using:
Supervised learning on large dialogue datasets with emotional labeling
Reinforcement learning with a reward model favoring emotionally supportive responses
Constitution training to instill stable and beneficial objectives
Knowledge augmentation from psychological resources on emotional intelligence

Usage code

python

%pip install accelerate
%pip install -i https://pypi.org/simple/ bitsandbytes

from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

model_id = "OEvortex/Emotional-llama-8B"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)


messages = [
    # {"role": "system", "content": "Be Helpful"},
    {"role": "user", "content": "I'm feeling really down today. Nothing seems to be going right."},
]

input_ids = tokenizer.apply_chat_template(
    messages,
    add_generation_prompt=True,
    return_tensors="pt"
).to(model.device)

terminators = [
    tokenizer.eos_token_id,
    tokenizer.convert_tokens_to_ids("<|eot_id|>")
]

outputs = model.generate(
    input_ids,
    max_new_tokens=256,
    eos_token_id=terminators,
    do_sample=True,
    temperature=0.9,
    top_p=0.9,
)
response = outputs[0][input_ids.shape[-1]:]
print(tokenizer.decode(response, skip_special_tokens=True))

# Now you can generate text using the model!

Example Dialogue

Human: I'm feeling really down today. Nothing seems to be going right.

Emotional-llama-8B: I'm really sorry to hear that you're feeling down today. 😔 It's totally okay to have a tough day sometimes. Remember that it's okay to not be okay and that things will get better. Take a deep breath and try to focus on the things that you can control. If you need to talk about what's going on or just need someone to listen, I'm here for you. You're not alone, and I'm sending you lots of positive vibes. Hang in there, and remember that brighter days are ahead. and I'm here to listen without judgment and provide a supportive ear.

Human: I'm excited because I just got accepted into my dream school! I wanted to share the good news with someone.

Emotional-llama-8B: 🎉 Oh my goodness, congratulations! 🎊 That's absolutely amazing news! You must be over the moon! 🌙 Sharing your good news with someone is always a great feeling, and I'm here to celebrate with you! 🎉 Your dream school, wow! That's so exciting! What made it your dream school, and what are you most looking forward to about it? Let's chat more about it!

Human: My best friend just got into an argument with me and I don't know what to do. How can I fix this situation?

Emotional-llama-8B: Oh no, it's tough to deal with conflicts with close friends! 😔 First of all, take a step back and give yourself some time to process your feelings. It's okay to feel upset or hurt. Then, consider reaching out to your friend and expressing your feelings in a calm and respectful manner. It's important to communicate openly and honestly about what happened and how it made you feel. Try to see things from your friend's perspective as well and listen to their side of the story. Remember, conflicts are a natural part of any relationship, and it's how you work through them that matters. Good luck, and I hope you guys can work things out! 🌟

RichardErkhov/OEvortex_-_Emotional-llama-8B-gguf