Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
LLAMA3-MED-v2.2 – AI Model by rhyliieee | AlphaNeural AI
You can deploy this model and start earning money today!
rhyliieee
/
LLAMA3-MED-v2.2
like
0
transformers
safetensors
llama
text-generation
rhyliieee/notes-completion-set
aaditya/Llama3-OpenBioLLM-8B
quantized
mit
autotrain_compatible
text-generation-inference
endpoints_compatible
8-bit
bitsandbytes
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Finetuned a pretrained Model with Lora, resize the base model's embeddings, then load Peft Model with the resized base model.
"""
add special tokens to the tokenizer and base model before merging peft with base
open_tokenizer.add_special_tokens({ "additional_special_tokens": ["<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"] }) base_model.resize_token_embeddings(len(open_tokenizer))
reload the peft model with resized token embedding of base model
peft_model = PeftModel.from_pretrained(base_model, "rhyliieee/LLaMA3-8Bit-Lora-Med-v2",)
perform merging
merged_peft_base_with_special_tokens = peft_model.merge_and_unload() """
