These are AMD GFX906-focused GGUF quantizations of Kimi-Linear-48B-A3B-Instruct.
For GFX906 users: Kimi-Linear support has been merged into the
llama.cpp-gfx906 fork.
git clone https://github.com/iacopPBK/llama.cpp-gfx906.git
cd llama.cpp-gfx906
./SCRIPT_compile_MI50.sh # edit ROCM_PATH if not using /opt/rocm
Full credits for the Kimi-Linear implementation goes to
ymcki! See their
github repo here.
