Views
No views yet
1vllm serve Fredtt3/DeepSeek-R1-Distill-Llama-8B-Hermes \ 2 --api-key dummyapikey \ 3 --gpu-memory-utilization 0.9 \ 4 --max-model-len 4096 \ 5 --host 0.0.0.0 \ 6 --port 8000