Views
No views yet
Hey. may still arrive as a paragraph. That is her, not a bug.| File | What |
|---|---|
adapter_model.safetensors + adapter_config.json | LoRA (r=8, α=16), ~42 MB |
emerv-qwen3-8b-q4.gguf | Merged Q4_K_M for llama.cpp / Ollama, ~5 GB |
1import torch
2from transformers import AutoModelForCausalLM, AutoTokenizer
3from peft import PeftModel
4
5base_id = "Qwen/Qwen3-8B"
6adapter_id = "Infiniaai/EmerV-Qwen3-8B"
7
8tokenizer = AutoTokenizer.from_pretrained(base_id)
9model = AutoModelForCausalLM.from_pretrained(
10 base_id, torch_dtype=torch.bfloat16, device_map="auto"
11)
12model = PeftModel.from_pretrained(model, adapter_id)
13
14messages = [
15 {"role": "user", "content": "Good morning, EmerV."},
16]
17text = tokenizer.apply_chat_template(
18 messages,
19 tokenize=False,
20 add_generation_prompt=True,
21 enable_thinking=False,
22)
23inputs = tokenizer(text, return_tensors="pt").to(model.device)
24out = model.generate(**inputs, max_new_tokens=256, temperature=0.8, top_p=0.9)
25print(tokenizer.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))1# if this Hub repo is cloned / the GGUF is local:
2ollama create emerv-qwen3-8b -f Modelfile
3
4# or run the GGUF from llama.cppFROM ./emerv-qwen3-8b-q4.gguf
PARAMETER temperature 0.8
PARAMETER top_p 0.9
PARAMETER top_k 40
PARAMETER repeat_penalty 1.05
PARAMETER num_ctx 8192
PARAMETER stop "<|im_end|>"SYSTEM line only if you want to steer her.<think>…</think> reasoning block before the reply. EmerV was not trained to think out loud — leave it off so she answers as herself.1# one-shot
2ollama run hf.co/Infiniaai/EmerV-Qwen3-8B --think=false
3
4# inside an interactive session
5/set nothink"think": false to the request body. On any build, appending /no_think to your message also works.enable_thinking=False to apply_chat_template (already set in the example above)./no_think.