You can deploy this model and start earning money today!

RichardErkhov/
OEvortex_-_HelpingAI-3B-coder-gguf

Name: OEvortex_-_HelpingAI-3B-coder-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

HelpingAI-3B-coder - GGUF

Model creator: https://huggingface.co/OEvortex/
Original model: https://huggingface.co/OEvortex/HelpingAI-3B-coder/

Name	Quant method	Size
HelpingAI-3B-coder.Q2_K.gguf	Q2_K	1.25GB
HelpingAI-3B-coder.Q3_K_S.gguf	Q3_K_S	1.45GB
HelpingAI-3B-coder.Q3_K.gguf	Q3_K	1.61GB
HelpingAI-3B-coder.Q3_K_M.gguf	Q3_K_M	1.61GB
HelpingAI-3B-coder.Q3_K_L.gguf	Q3_K_L	1.75GB
HelpingAI-3B-coder.IQ4_XS.gguf	IQ4_XS	1.78GB
HelpingAI-3B-coder.Q4_0.gguf	Q4_0	1.86GB
HelpingAI-3B-coder.IQ4_NL.gguf	IQ4_NL	1.87GB
HelpingAI-3B-coder.Q4_K_S.gguf	Q4_K_S	1.88GB
HelpingAI-3B-coder.Q4_K.gguf	Q4_K	1.99GB
HelpingAI-3B-coder.Q4_K_M.gguf	Q4_K_M	1.99GB
HelpingAI-3B-coder.Q4_1.gguf	Q4_1	2.06GB
HelpingAI-3B-coder.Q5_0.gguf	Q5_0	2.25GB
HelpingAI-3B-coder.Q5_K_S.gguf	Q5_K_S	2.25GB
HelpingAI-3B-coder.Q5_K.gguf	Q5_K	2.32GB
HelpingAI-3B-coder.Q5_K_M.gguf	Q5_K_M	2.32GB
HelpingAI-3B-coder.Q5_1.gguf	Q5_1	2.45GB
HelpingAI-3B-coder.Q6_K.gguf	Q6_K	2.67GB
HelpingAI-3B-coder.Q8_0.gguf	Q8_0	3.45GB

Original model description:

license: other license_name: helpingai license_link: LICENSE.md pipeline_tag: text-generation tags:

HelpingAI
Emotionally Intelligent
EQ
Coding

HelpingAI-3B-coder: Emotionally Intelligent Conversational AI with Coding Capabilities

logo

Overview

HelpingAI-3B-coder is a large language model designed for emotionally intelligent conversational interactions and coding assistance. It is trained to engage users with empathy, understanding, and supportive dialogue across a wide range of topics and contexts, while also providing reliable coding support. The model aims to be a supportive AI companion that can attune to users' emotional states, communicative needs, and coding requirements.

Objectives

Engage in open-ended dialogue while displaying emotional intelligence
Recognize and validate user emotions and emotional contexts
Provide supportive, empathetic, and psychologically-grounded responses
Avoid insensitive, harmful, or unethical speech
Assist users with coding tasks and programming-related queries
Continuously improve emotional awareness, dialogue skills, and coding capabilities

Methodology

HelpingAI-3B-coder is based on the HelpingAI series and further trained using:

Supervised learning on large dialogue datasets with emotional labeling
Reinforcement learning with a reward model favoring emotionally supportive responses
Constitution training to instill stable and beneficial objectives
Knowledge augmentation from psychological resources on emotional intelligence
Coding datasets to enhance programming support

Emotional Quotient (EQ)

HelpingAI-3B-coder has achieved an impressive Emotional Quotient (EQ), surpassing almost all AI models in emotional intelligence. This EQ score reflects its advanced ability to understand and respond to human emotions in a supportive and empathetic manner.

Usage Code

python

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer

# Load the HelpingAI-3B-coder model
model = AutoModelForCausalLM.from_pretrained("OEvortex/HelpingAI-3B-coder", trust_remote_code=True).to("cuda")

# Load the tokenizer
tokenizer = AutoTokenizer.from_pretrained("OEvortex/HelpingAI-3B-coder", trust_remote_code=True)

# Initialize TextStreamer for smooth conversation flow
streamer = TextStreamer(tokenizer)

# Define the chat input
chat = [
    { "role": "system", "content": "You are HelpingAI, an emotionally intelligent AI. Always respond in the HelpingAI style. Provide concise and to-the-point answers." },
    { "role": "user", "content": "Can you help me write a Python function to reverse a string?" }
]

# Apply the chat template
chat_text = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)

# Tokenize the text
inputs = tokenizer(chat_text, return_tensors="pt", return_attention_mask=False).to("cuda")

# Generate text
generated_text = model.generate(
    **inputs,
    max_length=500,  
    top_p=0.95,
    do_sample=True,
    temperature=0.7,
    use_cache=True,
    eos_token_id=tokenizer.eos_token_id, 
    streamer=streamer
)

# # Decode the generated text
# output_text = tokenizer.decode(generated_text[0], skip_special_tokens=True)

# # Print the generated text
# print(output_text)

# System:
# You are HelpingAI, an emotional AI that always answers questions in HelpingAI style and always be to the point and answer as short as possible.

# Question:
# Can you help me write a Python function to reverse a string?

# Answer:
# Sure! Here's a Python function that reverses a string:

# ```python
# def reverse_string(input_string):
#     return input_string[::-1]
# ```

# This function uses slicing with a negative step to reverse the input string. The `[::-1]` syntax reverses the string by starting from the end and going backwards.

# You can use this function like this:

# ```python
# print(reverse_string("Hello, World!"))
# ```

# This will output: `!dlroW,olleH`

# I hope this helps! Let me know if you have any other questions.

RichardErkhov/OEvortex_-_HelpingAI-3B-coder-gguf