Views
No views yet
1# pip install vllm 2from vllm import LLM 3model = LLM("iproskurina/Llama-3.1-8B-awq-int4") 4output = model.generate("The capital of France is") 5print(output)```
