“They are against the Machine?” “They would be against mathematics or against the art of writing if they had lived at the appropriate time.” > — Isaac Asimov, I, Robot (1950)

🌑 About Neural

Neural is a Mistral Small (24B) model for narrative generation and roleplay. This repo is for the GGUF version of NeuR0mancR/Neural-v1-24B and its quants.

🛠 Technical Specifications

Base Architecture: Mistral Small 3.2 (24B)
Chat Template: Mistral Tekken
Primary Focus: Narrative weight, structural integrity, and stylistic "grit."

About

These are static and weighted/imatrix quants of NeuR0mancR/Neural-v1-24B

The IQ-quants were calibrated with a custom importance matrix to stay in line with the model's intended theme. Feel free to requantize with your own if you desire to preserve a different set of weights. The imatrix file used is included in this repo. IQ quants are recommended over similar sized non-IQ quantization.

Feel free to share your feedbacks.

Note: The IQ3_M_ATTN had its embedding, output and attention weights preserved at Q6_K. It is a decent compromise in a memory starved environment.

NeuR0mancR/Neural-v1-24B-GGUF

🌑 About Neural

🛠 Technical Specifications

About

NeuR0mancR/
Neural-v1-24B-GGUF