You can deploy this model and start earning money today!

DeathGodlike/
Starlit-Shadow-12B_EXL3

Name: Starlit-Shadow-12B_EXL3
Availability: InStock

Vortex5/Starlit-Shadow-12B

quantized

Views

No views yet

Original model: Starlit-Shadow-12B by Vortex5

Available ExLlamaV3 (release v0.0.18) quantizations

Type	Size	CLI
H8-4.0BPW	7.49 GB	Copy-paste the line / Download the batch file
H8-6.0BPW	10.22 GB	Copy-paste the line / Download the batch file
H8-8.0BPW	12.95 GB	Copy-paste the line / Download the batch file

Requirements: A python installation with huggingface-hub module to use CLI.

Licensing

License detected: unknown

The license for the provided quantized models is derived from the original model. For additional information see the original model's page above, or, if unavailable, the files and the page backups below.

Backups

Original files

Original page (click to expand)

Starlit-Shadow-12B

Overview

Starry-Shadow-12B was created through a multi-stage merge involving Red-Synthesis-12B, KansenSakura-Erosion-RP-12B, NoctyxCosma-12B, and Crimson-Twilight-12B,

Multi-stage merge configuration

name: First models: - model: Vortex5/Red-Synthesis-12B merge_method: sm2f base_model: Retreatcost/KansenSakura-Erosion-RP-12b dtype: bfloat16 tokenizer: source: Retreatcost/KansenSakura-Erosion-RP-12b --- name: Second models: - model: Vortex5/NoctyxCosma-12B merge_method: sm2f base_model: Vortex5/Crimson-Twilight-12B dtype: bfloat16 tokenizer: source: Vortex5/Crimson-Twilight-12B --- models: - model: First - model: Second merge_method: karcher dtype: bfloat16 parameters: tol: 1e-9 max_iter: 1000 tokenizer: source: Vortex5/Crimson-Twilight-12B

Intended Use

🎭 Roleplay

📜 Storytelling

🌌 Creative Writing

DeathGodlike/Starlit-Shadow-12B_EXL3