You can deploy this model and start earning money today!

RichardErkhov/
Steelskull_-_L3-Arcania-4x8b-gguf

Name: Steelskull_-_L3-Arcania-4x8b-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

L3-Arcania-4x8b - GGUF

Model creator: https://huggingface.co/Steelskull/
Original model: https://huggingface.co/Steelskull/L3-Arcania-4x8b/

Name	Quant method	Size
L3-Arcania-4x8b.Q2_K.gguf	Q2_K	8.66GB
L3-Arcania-4x8b.Q3_K_S.gguf	Q3_K_S	10.18GB
L3-Arcania-4x8b.Q3_K.gguf	Q3_K	11.25GB
L3-Arcania-4x8b.Q3_K_M.gguf	Q3_K_M	11.25GB
L3-Arcania-4x8b.Q3_K_L.gguf	Q3_K_L	12.15GB
L3-Arcania-4x8b.IQ4_XS.gguf	IQ4_XS	12.65GB
L3-Arcania-4x8b.Q4_0.gguf	Q4_0	13.2GB
L3-Arcania-4x8b.IQ4_NL.gguf	IQ4_NL	13.33GB
L3-Arcania-4x8b.Q4_K_S.gguf	Q4_K_S	13.31GB
L3-Arcania-4x8b.Q4_K.gguf	Q4_K	14.12GB
L3-Arcania-4x8b.Q4_K_M.gguf	Q4_K_M	14.12GB
L3-Arcania-4x8b.Q4_1.gguf	Q4_1	14.62GB
L3-Arcania-4x8b.Q5_0.gguf	Q5_0	16.04GB
L3-Arcania-4x8b.Q5_K_S.gguf	Q5_K_S	16.04GB
L3-Arcania-4x8b.Q5_K.gguf	Q5_K	16.52GB
L3-Arcania-4x8b.Q5_K_M.gguf	Q5_K_M	16.52GB
L3-Arcania-4x8b.Q5_1.gguf	Q5_1	17.47GB
L3-Arcania-4x8b.Q6_K.gguf	Q6_K	19.06GB
L3-Arcania-4x8b.Q8_0.gguf	Q8_0	24.69GB

Original model description:

license: llama3 tags:

not-for-all-audiences

Now that the cute anime girl has your attention.

Creator: SteelSkull

About L3-Arcania-4x8b: A Mixture of Experts model designed for general assistance, storytelling, roleplay, and ERP.

Integrates models from notable sources for enhanced performance in diverse tasks.

This model is based off of the work ive done on Umbra v1-v3 basically the gates are trained off of Keywords that direct the gates but not limit as much as a full prompt would. My goal is Quality not quantity

Source Models:

Quants:

Recommended: (Thanks to @Mradermacher!, please send them likes!)

L3-Arcania-4x8b-GGUF (all GGUFs)

L3-Arcania-4x8b-i1-GGUF (i Quant GGUFs)

My Quants: (they work, just not many choices)

SteelQuants/L3-Arcania-4x8b-Q4_K_M-GGUF

SteelQuants/L3-Arcania-4x8b-Q5_K_M-GGUF

Config:

Recommended Prompt Format: [Llama 3]

<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{{prompt}}<|eot_id|>{{history}}<|start_header_id|>{{char}}<|end_header_id|>

Model Config:

MODEL_NAME = "L3-Arcania-4x8b"
base_model: meta-llama/Meta-Llama-3-8B-Instruct
gate_mode: hidden 
dtype: bfloat16
experts:
  - source_model: Sao10K/L3-Solana-8B-v1
  - source_model: dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5
  - source_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1
  - source_model: cgato/L3-TheSpice-8b-v0.1.3

L3-Arcania-4x8b combines the strengths of multiple models to deliver a well-rounded, capable assistant. It excels at general tasks, storytelling, roleplay, and even more mature content.

The base model, Meta-Llama-3-8B-Instruct, provides a solid foundation. The expert models then enhance specific capabilities:

L3-Solana-8B-v1 adds generalist knowledge and the ability to handle a wide range of topics, including NSFW content.
opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5 strengthens storytelling, roleplay, and long-form writing abilities.
Llama-3-Lumimaid-8B-v0.1 introduces expertise in romantic, flirtatious, and explicit interactions.
L3-TheSpice-8b-v0.1.3 ensures the model remains focused, tailored, and high-quality.

The positive and negative prompts guide each expert's influence, resulting in a model that is versatile yet refined, capable of both general assistance and more specialized, mature interactions.

I've had a few people ask about donations so here's a link:

Buy Me a Coffee at ko-fi.com

RichardErkhov/Steelskull_-_L3-Arcania-4x8b-gguf

Original model description:

L3-Arcania-4x8b

Quants:

Config:

RichardErkhov/
Steelskull_-_L3-Arcania-4x8b-gguf