Views
No views yet
vllm serve gueraf/Huihui-Qwen3-Coder-Next-abliterated-fp8 --quantization fp8 --dtype float16 --host 127.0.0.1 --port 8000 --trust-remote-code --gpu-memory-utilization 0.90 --max-model-len 32768 --max-num-seqs 512