lodrick-the-lafted_-_Olethros-8B-4bits – AI Model by RichardErkhov | AlphaNeural AI

You can deploy this model and start earning money today!

RichardErkhov/
lodrick-the-lafted_-_Olethros-8B-4bits

like

0

Views

No views yet

Quantization made by Richard Erkhov.

Request more models

Olethros-8B - bnb 4bits

Model creator: https://huggingface.co/lodrick-the-lafted/
Original model: https://huggingface.co/lodrick-the-lafted/Olethros-8B/

Original model description:

license: llama3 datasets:

lodrick-the-lafted/OpusStories
lodrick-the-lafted/Sao10K_Claude-3-Opus-Instruct-3.3K
lodrick-the-lafted/Samantha-Opus
lodrick-the-lafted/Worldsim-Opus

<img src=https://huggingface.co/lodrick-the-lafted/Olethros-8B/resolve/main/olethros.png>

Olethros-8B

L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a bit of sovl.

Quants

GGUF, Exl2 and AWQ available right now.

Type	Misc	Author
GGUF	Static GGUF Quants	mradermacher
AWQ		lodrick
exl2	2.25bpw	blockblockblock
exl2	2.5bpw	blockblockblock
exl2	3.0bpw	blockblockblock
exl2	3.5bpw	blockblockblock
exl2	3.7bpw	blockblockblock
exl2	4.0bpw	blockblockblock
exl2	4.2bpw	blockblockblock
exl2	4.4bpw	blockblockblock
exl2	4.6bpw	blockblockblock
exl2	4.8bpw	blockblockblock
exl2	5.0bpw	blockblockblock
exl2	5.5bpw	blockblockblock
exl2	6.0bpw	blockblockblock