Views
No views yet
scripts/convert_tinker_moe_adapter.py (3D unfuse: w1→gate_proj,
w2→down_proj, w3→up_proj for MoE layers).moonshotai/Kimi-K2-Thinking (DeepSeek-V3 architecture,
61 layers, MLA attention, INT4 compressed-tensors MoE).1vllm serve moonshotai/Kimi-K2-Thinking --tensor-parallel-size 8 \
2 --enable-lora --max-lora-rank 64 \
3 --enforce-eager --trust-remote-code
4# then POST /v1/load_lora_adapter with this repo pathTORCH_COMPILE_DISABLE=1 to avoid UntypedStorage
errors with --enable-lora on the FusedMoE layers.