🦖 T-Rex-mini — GGUF I1 (Quantized - Imatrix)

🔧 Quantization Details

• Original Model: saturated-labs/T-Rex-mini
• Format: GGUF (.gguf)
• Quantization Type: IQ4_XS, Q4_K_S, Q4_K_M, Q5_K_S, Q5_K_M, Q6_K
• Tool Used: llama.cpp
• Command:
  ./llama-quantize.exe --imatrix imatrix.dat t-rex-mini-f16.gguf t-rex-mini-QX_X_X.gguf QX_X_X