Model Variant	BLEU	ROUGE-2	ROUGE-L
HACHI-Summary-0.5b (Base)	0.02765	0.07473	0.13640
HACHI-Summary-0.5b-BF16	0.02790	0.07439	0.13852
HACHI-Summary-0.5b-Q8_0	0.02806	0.07467	0.13880
HACHI-Summary-0.5b-IQ4_K_M	0.02737	0.07377	0.13827
HACHI-Summary-0.5b-IQ4_K_S	0.02773	0.07400	0.13951

Model Variant	BLEU	ROUGE-2	ROUGE-L
HACHI-Summary-0.5b (Base)	0.27575	0.36449	0.40445
HACHI-Summary-0.5b-BF16	0.25382	0.34304	0.39262
HACHI-Summary-0.5b-Q8_0	0.25362	0.34254	0.39124
HACHI-Summary-0.5b-IQ4_K_M	0.25027	0.33802	0.38393
HACHI-Summary-0.5b-IQ4_K_S	0.24464	0.33150	0.37814

Recommended Models

🌟 HACHI-Summary-0.5b-IQ4_K_M
- Evaluation: igh-speed efficiency with optimal compression. Leverages iMatrix to maintain competitive accuracy and deterministic performance while enabling accelerated inference and reduced latency through its significantly lower computational overhead.
- Use Case: Recommended for edge computing and local environments where VRAM is constrained.

Acknowledgements

This model is licensed under the Apache-2.0 License.