Quantization made by Richard Erkhov.

Qwen1.5-4B_llamafy - bnb 8bits

license: other license_name: tongyi-qianwen-research license_link: https://huggingface.co/Qwen/Qwen1.5-4B-Chat/blob/main/LICENSE language:

This is a conversion of the Qwen1.5-4B model, adapted to the LLama architecture, aiming to augment its generality and suitability for academic research and broader computational linguistics applications.

This conversion of the Qwen model is intended for research and educational purposes only. It is important to note that the converted model may generate more unpredictable responses compared to its original version. The user assumes full responsibility for any outcomes or consequences arising from the use of this converted model.

Special thanks go to @Minami-su for developing the conversion script that made this possible.