This is the GGUF quantized version of Solor-TXT-7B-Ultra. It is designed for high-speed local inference in tools like Ollama, LM Studio, and llama.cpp.
Quantization Info
Format: GGUF
Method: Q4_K_M (Recommended)
Optimized for: Local reasoning and multi-turn stability.
Quick Usage (Ollama)
Download the .gguf file.
Create a file named Modelfile:
dockerfile
1FROM ./Solor-TXT-7B-Ultra-GGUF.q4_k_m.gguf2SYSTEM "You are Solor-TXT. You must think deeply inside <thought> tags before every response."
