Views
No views yet
1# pip install vllm 2from vllm import LLM 3model = LLM("iproskurina/Mistral-7B-v0.3-awq-int4") 4output = model.generate("The capital of France is") 5print(output)```
