You can deploy this model and start earning money today!

Tina-Yi/
R1-Distill-Qwen-1.5B-LIMR-4-LoRA-rank

Name: R1-Distill-Qwen-1.5B-LIMR-4-LoRA-rank
Availability: InStock

deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B

adapter

apache-2.0

Views

No views yet

Introduction

Tina (Tiny Reasoning Models via LoRA) models are all fine-tuned adapters on the base model deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B. This LoRA adapter in this repo is fine-tuned with the dataset GAIR/LIMR. Please refer to our paper Tina: Tiny Reasoning Models via LoRA for more training details.

Example Usage

The Tina model is meant to be used in combination with the base model as a standard adapter. Particularly, we release all checkpoints we have for each Tina model and one could select different checkpoint to use by specifying the subfolder.

python

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_model = AutoModelForCausalLM.from_pretrained(
  "deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B",
  device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained(
  "deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B"
)

model = PeftModel.from_pretrained(
  base_model,
  "Tina-Yi/R1-Distill-Qwen-1.5B-LIMR-4-LoRA-rank",
  subfolder="checkpoint-150" # checkpoint 150 is the best
)