You can deploy this model and start earning money today!

mianaro3/
EEE-BENCH-OVLORA-7b-FT-qwen_1_5-r32-a128-do0.01-lr5e-6-ep4-gn0.5-ml4096

Name: EEE-BENCH-OVLORA-7b-FT-qwen_1_5-r32-a128-do0.01-lr5e-6-ep4-gn0.5-ml4096
Availability: InStock

lmms-lab/llava-onevision-qwen2-0.5b-ov

adapter

apache-2.0

Views

No views yet

LoRA Model for LLaVA OneVision

This is a LoRA (Low-Rank Adaptation) model fine-tuned on top of lmms-lab/llava-onevision-qwen2-0.5b-ov.

Usage

python

from peft import PeftModel
from llava.model.builder import load_pretrained_model

# Load base model
tokenizer, model, image_processor, context_len = load_pretrained_model(
    "lmms-lab/llava-onevision-qwen2-0.5b-ov",
    None,
    model_name="llava_qwen",
    device_map="auto",
)

# Load LoRA weights
model = PeftModel.from_pretrained(model, "mianaro3/EEE-BENCH-OVLORA-7b-FT-qwen_1_5-r32-a128-do0.01-lr5e-6-ep4-gn0.5-ml4096")
model.eval()

Files

adapter_config.json: LoRA configuration
adapter_model.safetensors: LoRA weights

Training Details

See trainer_state.json and training_args.bin for full training configuration.