You can deploy this model and start earning money today!

RichardErkhov/
altomek_-_Lo101-3B-AnD-gguf

Name: altomek_-_Lo101-3B-AnD-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Lo101-3B-AnD - GGUF

Model creator: https://huggingface.co/altomek/
Original model: https://huggingface.co/altomek/Lo101-3B-AnD/

Name	Quant method	Size
Lo101-3B-AnD.Q2_K.gguf	Q2_K	1.27GB
Lo101-3B-AnD.Q3_K_S.gguf	Q3_K_S	1.44GB
Lo101-3B-AnD.Q3_K.gguf	Q3_K	1.57GB
Lo101-3B-AnD.Q3_K_M.gguf	Q3_K_M	1.57GB
Lo101-3B-AnD.Q3_K_L.gguf	Q3_K_L	1.69GB
Lo101-3B-AnD.IQ4_XS.gguf	IQ4_XS	1.71GB
Lo101-3B-AnD.Q4_0.gguf	Q4_0	1.79GB
Lo101-3B-AnD.IQ4_NL.gguf	IQ4_NL	1.79GB
Lo101-3B-AnD.Q4_K_S.gguf	Q4_K_S	1.8GB
Lo101-3B-AnD.Q4_K.gguf	Q4_K	1.88GB
Lo101-3B-AnD.Q4_K_M.gguf	Q4_K_M	1.88GB
Lo101-3B-AnD.Q4_1.gguf	Q4_1	1.95GB
Lo101-3B-AnD.Q5_0.gguf	Q5_0	2.11GB
Lo101-3B-AnD.Q5_K_S.gguf	Q5_K_S	2.11GB
Lo101-3B-AnD.Q5_K.gguf	Q5_K	2.16GB
Lo101-3B-AnD.Q5_K_M.gguf	Q5_K_M	2.16GB
Lo101-3B-AnD.Q5_1.gguf	Q5_1	2.28GB
Lo101-3B-AnD.Q6_K.gguf	Q6_K	2.46GB
Lo101-3B-AnD.Q8_0.gguf	Q8_0	3.19GB

Original model description:

base_model:

IntervitensInc/Llama-3.2-3B-chatml
alpindale/Llama-3.2-3B-Instruct language:
en library_name: transformers pipeline_tag: text-generation tags:
merge
finetuned
llama
llama-3 license: llama3.2 inference: parameters: temperature: 0.2 widget:
messages:
- role: user content: Any plans for a weekend?

<img src=https://huggingface.co/altomek/Lo101-3B-AnD/resolve/main/Lo101.png> intro music...

This is...

Llama Lo1 01

My first RP directed finetune and merge! Not as expresive like Llama Instruct might be. Writes simpler responses in chat. Somewhat broken as I did not figured how to deal properly with tokenizers.

Trained on few datasets from jeiku - Thank you!

Have fun!

Settings

Kobold: use Chat Mode
SillyTawern: use ChatML for Context Template and Llama 3 Instruct for Instruct Mode
ChatterUI: use Llama 3 Instruct template
Set Temperature below 1
You can easily overload this AI with too complicaded, long character cards. Keep things simple! ;P

RichardErkhov/altomek_-_Lo101-3B-AnD-gguf

Original model description:

Llama Lo1 01

Settings

Quants

RichardErkhov/
altomek_-_Lo101-3B-AnD-gguf