lodrick-the-lafted_-_Olethros-8B-gguf – AI Model by RichardErkhov | AlphaNeural AI

You can deploy this model and start earning money today!

RichardErkhov/
lodrick-the-lafted_-_Olethros-8B-gguf

like

0

endpoints_compatible

Views

No views yet

Quantization made by Richard Erkhov.

Request more models

Olethros-8B - GGUF

Model creator: https://huggingface.co/lodrick-the-lafted/
Original model: https://huggingface.co/lodrick-the-lafted/Olethros-8B/

Name	Quant method	Size
Olethros-8B.Q2_K.gguf	Q2_K	2.96GB
Olethros-8B.IQ3_XS.gguf	IQ3_XS	3.28GB
Olethros-8B.IQ3_S.gguf	IQ3_S	3.43GB
Olethros-8B.Q3_K_S.gguf	Q3_K_S	3.41GB
Olethros-8B.IQ3_M.gguf	IQ3_M	3.52GB
Olethros-8B.Q3_K.gguf	Q3_K	3.74GB
Olethros-8B.Q3_K_M.gguf	Q3_K_M	3.74GB
Olethros-8B.Q3_K_L.gguf	Q3_K_L	4.03GB
Olethros-8B.IQ4_XS.gguf	IQ4_XS	4.18GB
Olethros-8B.Q4_0.gguf	Q4_0	4.34GB
Olethros-8B.IQ4_NL.gguf	IQ4_NL	4.38GB
Olethros-8B.Q4_K_S.gguf	Q4_K_S	4.37GB
Olethros-8B.Q4_K.gguf	Q4_K	4.58GB
Olethros-8B.Q4_K_M.gguf	Q4_K_M	4.58GB
Olethros-8B.Q4_1.gguf	Q4_1	4.78GB
Olethros-8B.Q5_0.gguf	Q5_0	5.21GB
Olethros-8B.Q5_K_S.gguf	Q5_K_S	5.21GB
Olethros-8B.Q5_K.gguf	Q5_K	5.34GB
Olethros-8B.Q5_K_M.gguf	Q5_K_M	5.34GB
Olethros-8B.Q5_1.gguf	Q5_1	5.65GB
Olethros-8B.Q6_K.gguf	Q6_K	6.14GB
Olethros-8B.Q8_0.gguf	Q8_0	7.95GB

Original model description:

license: llama3 datasets:

lodrick-the-lafted/OpusStories
lodrick-the-lafted/Sao10K_Claude-3-Opus-Instruct-3.3K
lodrick-the-lafted/Samantha-Opus
lodrick-the-lafted/Worldsim-Opus

<img src=https://huggingface.co/lodrick-the-lafted/Olethros-8B/resolve/main/olethros.png>

Olethros-8B

L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a bit of sovl.

Quants

GGUF, Exl2 and AWQ available right now.

Type	Misc	Author
GGUF	Static GGUF Quants	mradermacher
AWQ		lodrick
exl2	2.25bpw	blockblockblock
exl2	2.5bpw	blockblockblock
exl2	3.0bpw	blockblockblock
exl2	3.5bpw	blockblockblock
exl2	3.7bpw	blockblockblock
exl2	4.0bpw	blockblockblock
exl2	4.2bpw	blockblockblock
exl2	4.4bpw	blockblockblock
exl2	4.6bpw	blockblockblock
exl2	4.8bpw	blockblockblock
exl2	5.0bpw	blockblockblock
exl2	5.5bpw	blockblockblock
exl2	6.0bpw	blockblockblock