Views
No views yet
| Attribute | Value |
|---|---|
| Model Type | Causal Language Model |
| Base Architecture | Transformer |
| Training Style | Instruction Tuned |
| Format | Hugging Face Transformers |
| Intended Use | Chat, Coding, AI Assistant |
1from transformers import AutoTokenizer, AutoModelForCausalLM
2import torch
3
4model_name = "lazarus19/openhusky"
5
6tokenizer = AutoTokenizer.from_pretrained(model_name)
7model = AutoModelForCausalLM.from_pretrained(
8 model_name,
9 torch_dtype=torch.float16,
10 device_map="auto"
11)
12
13prompt = "Explain React in simple terms."
14
15inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
16
17outputs = model.generate(
18 **inputs,
19 max_new_tokens=100,
20 temperature=0.7
21)
22
23print(tokenizer.decode(outputs[0], skip_special_tokens=True)){"prompt":"What is React?","response":"React is a JavaScript library for building user interfaces."}| Model Size | Recommended VRAM |
|---|---|
| 7B | 16GB+ |
| Quantized GGUF | Lower VRAM Supported |