Views
No views yet
| Property | Value |
|---|---|
| Base Model | Qwen 2.5 3B Instruct |
| Parameters | 3 Billion |
| Fine-Tuning | LoRA (r=32, alpha=32) |
| Training Loss | 0.68 |
| Precision | FP16 |
| License | Apache 2.0 |
| Model | Parameters | Role |
|---|---|---|
| Beryl | 0.5B | Lightweight, experimental |
| Onyx | 3B | Balanced logic & personality |
| Thaumite | 7B | Flagship, highest capability |
User: What is your name?
Bot:1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3
4model = AutoModelForCausalLM.from_pretrained("GenueAI/geode-onyx", torch_dtype=torch.float16)
5tokenizer = AutoTokenizer.from_pretrained("GenueAI/geode-onyx")
6
7prompt = "User: Who are you?\nBot:"
8inputs = tokenizer(prompt, return_tensors="pt")
9outputs = model.generate(**inputs, max_new_tokens=256, temperature=0.7)
10print(tokenizer.decode(outputs[0], skip_special_tokens=True))