You can deploy this model and start earning money today!

silence09/
InternLM2.5-7B-Chat-Converted-Qwen2

Name: InternLM2.5-7B-Chat-Converted-Qwen2
Availability: InStock

safetensors

qwen2

internlm/internlm2_5-7b-chat

finetune

apache-2.0

Views

No views yet

Converted Qwen2 from InternLM2.5-7B-Chat

Descritpion

This is a converted model from InternLM2.5-7B-Chat to Qwen2 format. This conversion allows you to use InternLM2.5-7B-Chat as if it were a Qwen2 model, which is convenient for some inference use cases. The precision is excatly the same as the original model.

Usage

You can load the model using the Qwen2ForCausalLM class as shown below:

python

from transformers import AutoModelForCausalLM, AutoTokenizer, Qwen2ForCausalLM

device = "cuda" # the device to load the model onto, cpu or cuda
attn_impl = 'eager' # the attention implementation to use

prompt = "大模型和人工智能经历了两年的快速发展，请你以此主题对人工智能的从业者写一段新年寄语"

system_prompt = """You are an AI assistant whose name is InternLM (书生·浦语).
- InternLM (书生·浦语) is a conversational language model that is developed by Shanghai AI Laboratory (上海人工智能实验室). It is designed to be helpful, honest, and harmless.
- InternLM (书生·浦语) can understand and communicate fluently in the language chosen by the user such as English and 中文."""
messages = [
    {"role": "system", "content": system_prompt},
    {"role": "user", "content": prompt},
 ]

tokenizer = AutoTokenizer.from_pretrained("silence09/InternLM2.5-7B-Chat-Converted-Qwen2", trust_remote_code=True)
text = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True
)
model_inputs = tokenizer([text], return_tensors="pt").to(device)
print(prompt)
qwen2_model = Qwen2ForCausalLM.from_pretrained(
    "silence09/InternLM2.5-7B-Chat-Converted-Qwen2",
    torch_dtype='auto',
    attn_implementation=attn_impl).to(device)
qwen2_generated_ids = qwen2_model.generate(model_inputs.input_ids, max_new_tokens=100, do_sample=False)
qwen2_generated_ids = [
    output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, qwen2_generated_ids)
]
qwen2_response = tokenizer.batch_decode(qwen2_generated_ids, skip_special_tokens=True)[0]
print(qwen2_response)

Precision Guarantee

To comare result with the original model, you can use this code

More Info

It was converted using the python script available at this repository