Views
No views yet
Qwen/Qwen3.6-27B
with LlamaFactory.<priors> blocks on top of k=3
dense-retrieval evidence passages (multilingual e5 retriever).Qwen/Qwen3.6-27B1from vllm import LLM, SamplingParams
2from vllm.lora.request import LoRARequest
3
4llm = LLM(model="Qwen/Qwen3.6-27B", enable_lora=True, max_lora_rank=128,
5 trust_remote_code=True, dtype="bfloat16")
6sp = SamplingParams(temperature=0.0, max_tokens=512)
7out = llm.generate(prompts, sp,
8 lora_request=LoRARequest("a", 1, "<local path to this adapter>"))