Views
No views yet
1python -m vllm.entrypoints.openai.api_server \ 2 --model macadeliccc/Mistral-7B-v0.2-OpenHermes-AWQ \ 3 --chat-template ./examples/template_chatml.jinja \ 4 --gpu-memory-utilization 0.9