This is a 3.0bpw quantized version of Qwen/Qwen1.5-32B-Chat made with exllamav2.

To run this, make sure you installed the up-to-date version of Exllamav2.

This project is distributed under the Tongyi Qianwen LICENSE AGREEMENT. See the LICENSE file for more information.

Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?