clayshoaf/

AB-Lora-Test

These are some LoRAs you can use to make sure that LoRAs are loading the way you expect them to. AAAAAAA and BBBBBBB can be used with with Neko-Institute-of-Science/LLaMA-7B-4bit-128g 8bit_AAAAAAA and 8bit_BBBBBBB can be used with decapoda-research/llama-7b-hf

These models do what is on the label AAAAAAA will almost always ouput a stream of the letter "A". BBBBBBB will do the same for "B".

I decided to make these because it was frustrating trying to figure out whether models were actually loading the way I expected them to. You could, instead, set your parameters and seed to the same thing and do a couple generation tests, with and without LoRA, and look for differences, but this is a lot easier to see at a glance.