Views
No views yet
| Model | Parameters | Role | Key Strength |
|---|---|---|---|
| Noir-Lightning | 0.5B | The Pocket Assistant | Ultra-fast, runs on anything |
| Noir-Mini | 1.5B | The Balanced Thinker | High speed with solid grammar |
| Noir-Standard | 3B | The Versatile Workhorse | 65% GSM8K, perfect for 8GB VRAM |
| Noir-Ultra | 7B | The Reasoning Master | 91% SciQ & 84% Math |
| Noir-Starlight | 14B | The Galactic Intelligence | Deep logic & Expert-level STEM |
transformers library. For optimal performance, we recommend using 4-bit or 8-bit quantization if VRAM is limited.1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3
4model_id = "muverqqw/Noir-14B-Starlight"
5
6tokenizer = AutoTokenizer.from_pretrained(model_id)
7model = AutoModelForCausalLM.from_pretrained(
8 model_id,
9 torch_dtype=torch.bfloat16,
10 device_map="auto",
11 trust_remote_code=True
12)
13
14messages = [
15 {"role": "system", "content": "You are Starlight, the most advanced AI of the Noir series."},
16 {"role": "user", "content": "Write a complex Python script for an asynchronous web scraper."}
17]
18
19inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to("cuda")
20outputs = model.generate(inputs, max_new_tokens=1024, do_sample=True, temperature=0.7)
21
22print(tokenizer.decode(outputs[0], skip_special_tokens=True))