You can deploy this model and start earning money today!

RichardErkhov/
CreitinGameplays_-_ConvAI-9b-gguf

Name: CreitinGameplays_-_ConvAI-9b-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

ConvAI-9b - GGUF

Model creator: https://huggingface.co/CreitinGameplays/
Original model: https://huggingface.co/CreitinGameplays/ConvAI-9b/

Name	Quant method	Size
ConvAI-9b.Q2_K.gguf	Q2_K	3.13GB
ConvAI-9b.IQ3_XS.gguf	IQ3_XS	3.48GB
ConvAI-9b.IQ3_S.gguf	IQ3_S	3.67GB
ConvAI-9b.Q3_K_S.gguf	Q3_K_S	3.65GB
ConvAI-9b.IQ3_M.gguf	IQ3_M	3.79GB
ConvAI-9b.Q3_K.gguf	Q3_K	4.05GB
ConvAI-9b.Q3_K_M.gguf	Q3_K_M	4.05GB
ConvAI-9b.Q3_K_L.gguf	Q3_K_L	4.41GB
ConvAI-9b.IQ4_XS.gguf	IQ4_XS	4.55GB
ConvAI-9b.Q4_0.gguf	Q4_0	4.74GB
ConvAI-9b.IQ4_NL.gguf	IQ4_NL	4.79GB
ConvAI-9b.Q4_K_S.gguf	Q4_K_S	4.78GB
ConvAI-9b.Q4_K.gguf	Q4_K	5.04GB
ConvAI-9b.Q4_K_M.gguf	Q4_K_M	5.04GB
ConvAI-9b.Q4_1.gguf	Q4_1	5.26GB
ConvAI-9b.Q5_0.gguf	Q5_0	5.77GB
ConvAI-9b.Q5_K_S.gguf	Q5_K_S	5.77GB
ConvAI-9b.Q5_K.gguf	Q5_K	5.93GB
ConvAI-9b.Q5_K_M.gguf	Q5_K_M	5.93GB
ConvAI-9b.Q5_1.gguf	Q5_1	6.29GB
ConvAI-9b.Q6_K.gguf	Q6_K	6.87GB
ConvAI-9b.Q8_0.gguf	Q8_0	8.89GB

Original model description:

license: mit datasets:

CreitinGameplays/merged-data-v2 base_model:
HuggingFaceH4/zephyr-7b-beta
mistral-community/Mistral-7B-v0.2 language:
en

ConvAI-9b: A Conversational AI Model

1. Model Details

Model Name: ConvAI-9b
Authors: CreitinGameplays
Date: April 18th, 2024

2. Model Description

ConvAI-9b is a fine-tuned conversational AI model with 9 billion parameters. It is based on the following models:

Base Model: HuggingFaceH4/zephyr-7b-beta
Merged Model: mistral-community/Mistral-7B-v0.2

3. Training Data

The model was fine-tuned on a custom dataset of conversations between an AI assistant and a user. The dataset format followed a specific structure:

<|system|> (system prompt, e.g.: You are a helpful AI language model called ChatGPT, your goal is helping users with their questions) </s> <|user|> (user prompt) </s>

4. Intended Uses

ConvAI-9b is intended for use in conversational AI applications, such as:

Chatbots
Virtual assistants
Interactive storytelling
Educational tools

5. Limitations

Like any other language model, ConvAI-9b may generate incorrect or misleading responses.
It may exhibit biases present in the training data.
The model's performance can be affected by the quality and format of the input text.

6. Evaluation

Metrics	Value
ARC	57.50
HellaSwag	80.34
TruthfulQA	49.54
Winogrande	76.24

More detailed evaluation here

RichardErkhov/CreitinGameplays_-_ConvAI-9b-gguf