This is
WeiboAI/VibeThinker-1.5B quantized with
LLM Compressor with the recipe in the "recipe.yaml" file. The model is compatible with vLLM (tested: v0.12.0). Tested with an RTX 4090.
Subscribe to
The Kaitchup. This helps me a lot to continue quantizing and evaluating models for free. Or you can "
buy me a kofi".
