Views
No views yet
| Attribute | Value |
|---|---|
| Base model | mistralai/Mistral-7B-v0.1 |
| Finetuned on | ~1500 GPT-4-generated prompt-response pairs, validated by human reviews of the best AI tools for each sector. |
| Format | Instruction-tuned with [INST] ... [/INST] |
| Finetuning method | QLoRA (4-bit), Flash Attention 2 |
| Trainer | Axolotl + RunPod (A40 GPU) |
1from transformers import AutoTokenizer, AutoModelForCausalLM
2
3model = AutoModelForCausalLM.from_pretrained("vitalune/ovarra-v1", device_map="auto")
4tokenizer = AutoTokenizer.from_pretrained("vitalune/ovarra-v1")
5
6prompt = "[INST] I want to launch an AI copywriting SaaS. Help me plan it. [/INST]"
7inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
8
9output = model.generate(**inputs, max_new_tokens=512)
10print(tokenizer.decode(output[0], skip_special_tokens=True))