You can deploy this model and start earning money today!

RichardErkhov/
PygmalionAI_-_mythalion-13b-gguf

Name: PygmalionAI_-_mythalion-13b-gguf
Availability: InStock

endpoints_compatible

gguf

template

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

mythalion-13b - GGUF

Model creator: https://huggingface.co/PygmalionAI/
Original model: https://huggingface.co/PygmalionAI/mythalion-13b/

Name	Quant method	Size
mythalion-13b.Q2_K.gguf	Q2_K	4.52GB
mythalion-13b.IQ3_XS.gguf	IQ3_XS	4.99GB
mythalion-13b.IQ3_S.gguf	IQ3_S	5.27GB
mythalion-13b.Q3_K_S.gguf	Q3_K_S	5.27GB
mythalion-13b.IQ3_M.gguf	IQ3_M	5.57GB
mythalion-13b.Q3_K.gguf	Q3_K	5.9GB
mythalion-13b.Q3_K_M.gguf	Q3_K_M	5.9GB
mythalion-13b.Q3_K_L.gguf	Q3_K_L	6.45GB
mythalion-13b.IQ4_XS.gguf	IQ4_XS	6.54GB
mythalion-13b.Q4_0.gguf	Q4_0	6.86GB
mythalion-13b.IQ4_NL.gguf	IQ4_NL	6.9GB
mythalion-13b.Q4_K_S.gguf	Q4_K_S	6.91GB
mythalion-13b.Q4_K.gguf	Q4_K	7.33GB
mythalion-13b.Q4_K_M.gguf	Q4_K_M	7.33GB
mythalion-13b.Q4_1.gguf	Q4_1	7.61GB
mythalion-13b.Q5_0.gguf	Q5_0	8.36GB
mythalion-13b.Q5_K_S.gguf	Q5_K_S	8.36GB
mythalion-13b.Q5_K.gguf	Q5_K	8.6GB
mythalion-13b.Q5_K_M.gguf	Q5_K_M	8.6GB
mythalion-13b.Q5_1.gguf	Q5_1	9.1GB
mythalion-13b.Q6_K.gguf	Q6_K	9.95GB

Original model description:

language:

en thumbnail: null tags:
text generation
instruct pipeline_tag: text-generation inference: false license: llama2 datasets:
PygmalionAI/PIPPA
Open-Orca/OpenOrca
Norquinal/claude_multiround_chat_30k
jondurbin/airoboros-gpt4-1.4.1
databricks/databricks-dolly-15k

Mythalion 13B

A merge of Pygmalion-2 13B and MythoMax 13B

Model Details

The long-awaited release of our new models based on Llama-2 is finally here. This model was created in collaboration with Gryphe, a mixture of our Pygmalion-2 13B and Gryphe's Mythomax L2 13B.

Finer details of the merge are available in our blogpost. According to our testers, this model seems to outperform MythoMax in RP/Chat. Please make sure you follow the recommended generation settings for SillyTavern here for the best results!

This model is freely available for both commercial and non-commercial use, as per the Llama-2 license.

Prompting

This model can be prompted using both the Alpaca and Pygmalion formatting.

Alpaca formatting:

### Instruction:
<prompt>

### Response:
<leave a newline blank for model to respond>

Pygmalion/Metharme formatting:

<|system|>Enter RP mode. Pretend to be {{char}} whose persona follows:
{{persona}}

You shall reply to the user while staying in character, and generate long responses.
<|user|>Hello!<|model|>{model's response goes here}

The model has been trained on prompts using three different roles, which are denoted by the following tokens: <|system|>, <|user|> and <|model|>.

The <|system|> prompt can be used to inject out-of-channel information behind the scenes, while the <|user|> prompt should be used to indicate user input. The <|model|> token should then be used to indicate that the model should generate a response. These tokens can happen multiple times and be chained up to form a conversation history.

Limitations and biases

The intended use-case for this model is fictional writing for entertainment purposes. Any other sort of usage is out of scope.

As such, it was not fine-tuned to be safe and harmless: the base model and this fine-tune have been trained on data known to contain profanity and texts that are lewd or otherwise offensive. It may produce socially unacceptable or undesirable text, even if the prompt itself does not include anything explicitly offensive. Outputs might often be factually wrong or misleading.

Acknowledgements

We would like to thank SpicyChat for sponsoring the training for the Pygmalion-2 13B model.

RichardErkhov/PygmalionAI_-_mythalion-13b-gguf