You can deploy this model and start earning money today!

NANI-Nithin/
Shieldstral-1.0-3B-GGUF

Name: Shieldstral-1.0-3B-GGUF
Availability: InStock

mistralai/Shieldstral-1.0-3B

Views

No views yet

Shieldstral-1.0-3B-GGUF

GGUF conversions and quantizations of mistralai/Shieldstral-1.0-3B for use with:

llama.cpp
LM Studio
Ollama
KoboldCpp
Jan
Text Generation WebUI
Other GGUF-compatible runtimes

Available Files

Full Precision

Shieldstral-1.0-3B-F16.gguf

Quantized Versions

Shieldstral-1.0-3B-Q4_K_M.gguf
Shieldstral-1.0-3B-Q5_K_M.gguf
Shieldstral-1.0-3B-Q6_K.gguf
Shieldstral-1.0-3B-Q8_0.gguf

Recommended Quant

For most users:

Shieldstral-1.0-3B-Q4_K_M.gguf

Provides the best balance between:

Quality
Memory usage
Inference speed

File Sizes

Approximate sizes:

text

F16      ~6.9 GB
Q4_K_M   ~2.2 GB
Q5_K_M   ~2.5 GB
Q6_K     ~2.8 GB
Q8_0     ~3.5 GB

llama.cpp

Example:

bash

./llama-cli \
  -m Shieldstral-1.0-3B-Q4_K_M.gguf \
  -p "Hello"

Chat mode:

bash

./llama-cli \
  -m Shieldstral-1.0-3B-Q4_K_M.gguf \
  -cnv

LM Studio

Download your preferred GGUF file.
Open LM Studio.
Import the model.
Start chatting.

Ollama

Create a file named Modelfile:

FROM Shieldstral-1.0-3B-Q4_K_M.gguf

Then run:

bash

ollama create shieldstral -f Modelfile
ollama run shieldstral

Base Model

Base model:

mistralai/Shieldstral-1.0-3B

All model architecture, training, licensing, benchmarks, and usage rights belong to Mistral AI.

Please refer to the original model repository for official documentation.

Conversion Notes

The model was converted to GGUF using:

llama.cpp

A tokenizer compatibility patch was applied during conversion to ensure successful GGUF export.

Credits

Base Model: Mistral AI
GGUF Conversion & Quantization: NANI-Nithin
Tooling: llama.cpp

NANI-Nithin/Shieldstral-1.0-3B-GGUF

Shieldstral-1.0-3B-GGUF

Available Files

Full Precision

Quantized Versions

Recommended Quant

File Sizes

llama.cpp

LM Studio

Ollama

Base Model

Conversion Notes

Credits

NANI-Nithin/
Shieldstral-1.0-3B-GGUF