Views
No views yet
| GGUF Link | Quantization | Description |
|---|---|---|
| Download | Q2_K | Lowest quality |
| Download | Q3_K_S | |
| Download | IQ3_S | Integer quant, preferable over Q3_K_S |
| Download | IQ3_M | Integer quant |
| Download | Q3_K_M | |
| Download | Q3_K_L | |
| Download | IQ4_XS | Integer quant |
| Download | Q4_K_S | Fast with good performance |
| Download | Q4_K_M | Recommended: Perfect mix of speed and performance |
| Download | Q5_K_S | |
| Download | Q5_K_M | |
| Download | Q6_K | Very good quality |
| Download | Q8_0 | Best quality |
| Download | f16 | Full precision, don't bother; use a quant |
deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B and further trained with DECS algorithm, focused on 50% fewer tokens when answering a reasoning-required problem.deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B2026-02-241import torch
2from transformers import AutoModelForCausalLM, AutoTokenizer
3
4model_id = "pixas/DECS_1.5B"
5tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
6model = AutoModelForCausalLM.from_pretrained(
7 model_id,
8 torch_dtype=torch.bfloat16,
9 device_map="auto",
10)
11
12messages = [
13 {"role": "user", "content": "Solve: If x^2 - 5x + 6 = 0, what are x values?"}
14]
15prompt = tokenizer.apply_chat_template(
16 messages, tokenize=False, add_generation_prompt=True
17)
18inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
19
20with torch.no_grad():
21 outputs = model.generate(
22 **inputs,
23 max_new_tokens=512,
24 temperature=0.6,
25 top_p=0.95,
26 )
27
28new_tokens = outputs[0][inputs["input_ids"].shape[-1]:]
29print(tokenizer.decode(new_tokens, skip_special_tokens=True))1from vllm import LLM, SamplingParams
2
3llm = LLM(model="pixas/DECS_1.5B", trust_remote_code=True)
4sampling = SamplingParams(temperature=0.6, top_p=0.95, max_tokens=512)
5prompt = "Please reason step by step: what is 37 * 48?"
6outputs = llm.generate([prompt], sampling_params=sampling)
7print(outputs[0].outputs[0].text)1@inproceedings{jiang2026overthinking,
2title={Overthinking Reduction with Decoupled Rewards and Curriculum Data Scheduling},
3author={Shuyang Jiang and Yusheng Liao and Ya Zhang and Yanfeng Wang and Yu Wang},
4booktitle={The Fourteenth International Conference on Learning Representations},
5year={2026},
6url={https://openreview.net/forum?id=kdeiRledV6}
7}