You can deploy this model and start earning money today!

DEAR-Tao/
Qwen2.5-14B-Arxiv-Plan

Name: Qwen2.5-14B-Arxiv-Plan
Availability: InStock

DEAR-Tao/arxiv-research-plan

Qwen/Qwen2.5-14B-Instruct

finetune

Views

No views yet

Qwen2.5-14B-Arxiv-Plan

Introduction

Qwen2.5-14B-Arxiv-Plan is obtained by fine-tuning the real paper data of atxiv using Qwen2.5-14B-Instruct as the basic model. The main fine-tuning task is to generate research plans that are more targeted.

Quickstart

Here provides a code snippet with apply_chat_template to show you how to load the tokenizer and model and how to generate contents.

python

from transformers import AutoModelForCausalLM, AutoTokenizer
from datasets import load_dataset
model_name = "DEAR-Tao/Qwen2.5-14B-Arxiv-Plan"
model = AutoModelForCausalLM.from_pretrained(
    model_name,
    torch_dtype="auto",
    device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained(model_name)
dataset = load_dataset('DEAR-Tao/arxiv-research-plan',split='test')
sys_prompt = dataset['system'][666]
user_prompt = dataset['user'][666]
messages = [
    {"role": "system", "content": sys_prompt},
    {"role": "user", "content": user_prompt}
]
text = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True
)
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
generated_ids = model.generate(
    **model_inputs,
    max_new_tokens=512
)
generated_ids = [
    output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
]
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]