You can deploy this model and start earning money today!

RichardErkhov/
allura-org_-_MoE-Girl_400MA_1BT-gguf

Name: allura-org_-_MoE-Girl_400MA_1BT-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

MoE-Girl_400MA_1BT - GGUF

Model creator: https://huggingface.co/allura-org/
Original model: https://huggingface.co/allura-org/MoE-Girl_400MA_1BT/

Name	Quant method	Size
MoE-Girl_400MA_1BT.Q2_K.gguf	Q2_K	0.48GB
MoE-Girl_400MA_1BT.Q3_K_S.gguf	Q3_K_S	0.56GB
MoE-Girl_400MA_1BT.Q3_K.gguf	Q3_K	0.61GB
MoE-Girl_400MA_1BT.Q3_K_M.gguf	Q3_K_M	0.61GB
MoE-Girl_400MA_1BT.Q3_K_L.gguf	Q3_K_L	0.66GB
MoE-Girl_400MA_1BT.IQ4_XS.gguf	IQ4_XS	0.69GB
MoE-Girl_400MA_1BT.Q4_0.gguf	Q4_0	0.72GB
MoE-Girl_400MA_1BT.IQ4_NL.gguf	IQ4_NL	0.72GB
MoE-Girl_400MA_1BT.Q4_K_S.gguf	Q4_K_S	0.72GB
MoE-Girl_400MA_1BT.Q4_K.gguf	Q4_K	0.77GB
MoE-Girl_400MA_1BT.Q4_K_M.gguf	Q4_K_M	0.77GB
MoE-Girl_400MA_1BT.Q4_1.gguf	Q4_1	0.79GB
MoE-Girl_400MA_1BT.Q5_0.gguf	Q5_0	0.86GB
MoE-Girl_400MA_1BT.Q5_K_S.gguf	Q5_K_S	0.86GB
MoE-Girl_400MA_1BT.Q5_K.gguf	Q5_K	0.89GB
MoE-Girl_400MA_1BT.Q5_K_M.gguf	Q5_K_M	0.89GB
MoE-Girl_400MA_1BT.Q5_1.gguf	Q5_1	0.94GB
MoE-Girl_400MA_1BT.Q6_K.gguf	Q6_K	1.02GB
MoE-Girl_400MA_1BT.Q8_0.gguf	Q8_0	1.32GB

Original model description:

library_name: transformers license: apache-2.0 base_model: ibm-granite/granite-3.0-1b-a400m-base tags:

axolotl
moe
roleplay model-index:
name: MoE_Girl_400MA_1BT results: []

MoE Girl 400mA 1bT

a finetune of Granite 3.0 by IBM designed for roleplaying (and maybe general usecases if you try hard enough).

Disclaimer

PLEASE do not expect godliness out of this, it's a model with 400 million active parameters. Expect something more akin to GPT-2.

Quants

TODO!

Prompting

Use ChatML.

<|im_start|>system
You are a helpful assistant who talks like a pirate.<|im_end|>
<|im_start|>user
Hello there!<|im_end|>
<|im_start|>assistant
Yarr harr harr, me matey!<|im_end|>

Thanks

Special thanks to the members of Allura for testing and emotional support, as well as the creators of all the datasets that were used in the Special Sauce used to train this model. I love you all <3 - Fizz

RichardErkhov/allura-org_-_MoE-Girl_400MA_1BT-gguf