You can deploy this model and start earning money today!

UofA-LINGO/
text-to-triplets-explanation-v2

Name: text-to-triplets-explanation-v2
Availability: InStock

mit

Views

No views yet

LoRA weights for LLaMA-7B

Trained on 'taesiri/webnlg-triplets-explanation-v1' for 4 epochs.

Command:

WORLD_SIZE=2 CUDA_VISIBLE_DEVICES=0,1 torchrun --nproc_per_node=2 --master_port=1234 finetune.py     --base_model='decapoda-research/llama-7b-hf'     --data_path 'taesiri/webnlg-triplets-explanation-v1'     --num_epochs=4     --cutoff_len=512     --group_by_length     --lora_target_modules='[q_proj,k_proj,v_proj,o_proj]'     --lora_r=8      --micro_batch_size=8     --batch_size=32

UofA-LINGO/text-to-triplets-explanation-v2

UofA-LINGO/
text-to-triplets-explanation-v2