Quantization made by Richard Erkhov.
MFANN3bv0.2 - bnb 4bits
Original model description:
library_name: transformers
license: apache-2.0
datasets:
63.08 <- Average
61.77 <- ARC
76.35 <- HellaSwag
56.23 <- MMLU
53 <- TruthfulQA
75.85 <- Winogrande
55.27 <- GSM8K
