You can deploy this model and start earning money today!

Chinese-Vicuna/
Chinese-Vicuna-lora-13b-belle-and-guanaco

Name: Chinese-Vicuna-lora-13b-belle-and-guanaco
Availability: InStock

BelleGroup/generated_train_0.5M_CN

JosephusCheung/GuanacoDataset

gpl-3.0

Views

No views yet

This is a Chinese instruction-tuning lora checkpoint based on llama-13B from this repo's work

You can use it like this:

python

from transformers import LlamaForCausalLM
from peft import PeftModel

model = LlamaForCausalLM.from_pretrained(
    "decapoda-research/llama-13b-hf",
    load_in_8bit=True,
    torch_dtype=torch.float16,
    device_map="auto",
)
model = PeftModel.from_pretrained(
    model,
    LORA_PATH, # specific checkpoint path from "Chinese-Vicuna/Chinese-Vicuna-lora-13b-belle-and-guanaco"
    torch_dtype=torch.float16,
    device_map={'': 0}
)